May 28 02:57:23.087586 np0000001589 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 28 02:57:24.834476 np0000001589 nova-compute[98297]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98297) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 02:57:24.834930 np0000001589 nova-compute[98297]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98297) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 28 02:57:24.834930 np0000001589 nova-compute[98297]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 28 02:57:24.964128 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:57:24.977241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.013s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:57:25.137533 np0000001589 nova-compute[98297]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 28 02:57:25.903007 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 28 02:57:25.903395 np0000001589 nova-compute[98297]: INFO nova.utils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] The long task thread pool MainProcess.long_task is initialized
May 28 02:57:25.903499 np0000001589 nova-compute[98297]: INFO nova.virt.driver [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Loading compute driver 'libvirt.LibvirtDriver'
May 28 02:57:26.003906 np0000001589 nova-compute[98297]: INFO nova.compute.provider_config [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 28 02:57:26.506299 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Acquiring lock "singleton_lock" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 02:57:26.506299 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Acquired lock "singleton_lock" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 02:57:26.506530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Releasing lock "singleton_lock" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 02:57:26.506748 np0000001589 nova-compute[98297]: WARNING oslo_service.backend._threading.service [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] no_fork=True: running service in main process
May 28 02:57:26.507051 np0000001589 nova-compute[98297]: INFO nova.service [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Starting compute node (version 33.1.0)
May 28 02:57:27.009990 np0000001589 nova-compute[98297]: INFO nova.utils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] The default thread pool MainProcess.default is initialized
May 28 02:57:27.010737 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 02:57:27.010982 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Starting event thread {{(pid=98297) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 28 02:57:27.011348 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Starting connection event dispatch thread {{(pid=98297) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 28 02:57:27.012079 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Connecting to libvirt: qemu:///system {{(pid=98297) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 28 02:57:27.993729 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7e4b83644470> {{(pid=98297) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 28 02:57:27.995108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7e4b83644470> {{(pid=98297) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 28 02:57:27.996015 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Connection event '1' reason 'None'
May 28 02:57:28.501574 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Cannot update service status on host "np0000001589" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001589 could not be found.
May 28 02:57:28.502038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.mount [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Initialising _HostMountState generation 0 {{(pid=98297) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 28 02:57:38.788886 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host capabilities <capabilities>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:   <host>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:     <uuid>21e70235-3bc1-4e72-a52e-e48deb412863</uuid>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:     <cpu>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <arch>x86_64</arch>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <model>EPYC-Milan</model>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <microcode version='16777317'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <signature family='25' model='1' stepping='1'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <maxphysaddr mode='emulate' bits='40'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='x2apic'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='tsc-deadline'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='osxsave'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='hypervisor'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='tsc_adjust'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='ospke'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='vaes'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='vpclmulqdq'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='spec-ctrl'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='stibp'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='arch-capabilities'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='ssbd'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='cmp_legacy'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='topoext'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='stibp-always-on'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='virt-ssbd'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='amd-psfd'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='lbrv'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='tsc-scale'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='vmcb-clean'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='flushbyasid'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='pause-filter'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='pfthreshold'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='v-vmsave-vmload'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='vgif'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='no-nested-data-bp'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='lfence-always-serializing'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='null-sel-clr-base'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='rdctl-no'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='skip-l1dfl-vmentry'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='mds-no'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='pschange-mc-no'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <feature name='gds-no'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <pages unit='KiB' size='4'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <pages unit='KiB' size='2048'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <pages unit='KiB' size='1048576'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:     </cpu>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:     <power_management/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:     <iommu support='no'/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:     <migration_features>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <live/>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       <uri_transports>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:         <uri_transport>tcp</uri_transport>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:         <uri_transport>rdma</uri_transport>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:       </uri_transports>
May 28 02:57:38.788886 np0000001589 nova-compute[98297]:     </migration_features>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:     <topology>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <cells num='1'>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:         <cell id='0'>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           <memory unit='KiB'>24607192</memory>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           <pages unit='KiB' size='4'>6151798</pages>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           <pages unit='KiB' size='2048'>0</pages>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           <pages unit='KiB' size='1048576'>0</pages>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           <distances>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <sibling id='0' value='10'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           </distances>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           <cpus num='12'>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:           </cpus>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:         </cell>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       </cells>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:     </topology>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:     <cache>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 28 02:57:38.790537 np0000001589 nova-compute[98297]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     </cache>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     <secmodel>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <model>apparmor</model>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <doi>0</doi>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     </secmodel>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     <secmodel>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <model>dac</model>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <doi>0</doi>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     </secmodel>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:   </host>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     <arch name='alpha'>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>clipper</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:     <arch name='armv6l'>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>borzoi</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>spitz</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>nuri</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>musca-b1</machine>
May 28 02:57:38.791267 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>versatileab</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>kzm</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>musca-a</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>smdkc210</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sx1</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>z2</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>tosa</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>sabrelite</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>realview-eb</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>n810</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>n800</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 02:57:38.792242 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>versatilepb</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>terrier</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mainstone</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>integratorcp</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>midway</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>musicpal</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>microbit</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='3'>fby35</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>cubieboard</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>verdex</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>bpim2u</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>netduino2</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>raspi2b</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>cheetah</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 02:57:38.793080 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>highbank</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>akita</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>connex</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>collie</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>raspi0</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:     <arch name='armv7l'>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>borzoi</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>spitz</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>nuri</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>musca-b1</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>versatileab</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>kzm</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>musca-a</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 02:57:38.793856 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>smdkc210</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sx1</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>z2</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>tosa</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>sabrelite</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>realview-eb</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>n810</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>n800</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>versatilepb</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>terrier</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mainstone</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>integratorcp</machine>
May 28 02:57:38.794735 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>midway</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>musicpal</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>microbit</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='3'>fby35</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>cubieboard</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>verdex</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>bpim2u</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>netduino2</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>raspi2b</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>cheetah</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>highbank</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>akita</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>connex</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>collie</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>raspi0</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 02:57:38.795436 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:     <arch name='aarch64'>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.2</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mori-bmc</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>ast2600-evb</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>borzoi</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>spitz</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.7</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>nuri</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>romulus-bmc</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-3.0</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.0</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>npcm750-evb</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.10</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>rainier-bmc</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps3-an547</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.8</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>musca-b1</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>versatileab</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>kzm</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>fby35-bmc</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>musca-a</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-3.1</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.1</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>smdkc210</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sx1</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.11</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>imx25-pdk</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.9</machine>
May 28 02:57:38.796266 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>orangepi-pc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>z2</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-5.2</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>tosa</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an500</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.12</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mps2-an521</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>sabrelite</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an511</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>canon-a1100</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>realview-eb</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>sbsa-ref</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.0</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.0</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>raspi1ap</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sx1-v1</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>n810</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>g220a-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>n800</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.1</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.1</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>quanta-gsj</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>versatilepb</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>terrier</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mainstone</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>integratorcp</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-7.2</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-4.2</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 28 02:57:38.797027 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>mps3-an524</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>kudo-bmc</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>vexpress-a9</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>midway</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>musicpal</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>lm3s811evb</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>microbit</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='3'>fby35</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an505</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an385</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.0</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.0</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>raspi3ap</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>cubieboard</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ast1030-evb</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>verdex</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>bpim2u</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>netduino2</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mps2-an386</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.1</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-8.1</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>raspi3b</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>raspi2b</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>vexpress-a15</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='2'>fuji-bmc</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt-6.2</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>cheetah</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>virt-2.6</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ast2500-evb</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>highbank</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>akita</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>connex</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>netduinoplus2</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>collie</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>raspi0</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <acpi default='on' toggle='yes'/>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.797727 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     <arch name='cris'>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>axis-dev88</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:     <arch name='i686'>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 02:57:38.798624 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>x-remote</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 02:57:38.799496 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>isapc</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 02:57:38.800155 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>microvm</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 02:57:38.800813 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <domain type='kvm'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <pae/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <nonpae/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <acpi default='on' toggle='yes'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <apic default='on' toggle='no'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <arch name='m68k'>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mcf5208evb</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-7.0</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>an5206</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-6.0</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>q800</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-8.1</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-7.2</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-6.2</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-8.0</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>next-cube</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-7.1</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-6.1</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virt-8.2</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <arch name='microblaze'>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:     <arch name='microblazeel'>
May 28 02:57:38.801481 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <arch name='mips'>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='16'>malta</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mipssim</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <arch name='mipsel'>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='16'>malta</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mipssim</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <arch name='mips64'>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='16'>malta</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mipssim</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>pica61</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>magnum</machine>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:     <arch name='mips64el'>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 28 02:57:38.802564 np0000001589 nova-compute[98297]:       <machine maxCpus='16'>malta</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='16'>loongson3-virt</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mipssim</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>pica61</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>magnum</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='16'>boston</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>fuloong2e</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     <arch name='ppc'>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>g3beige</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>amigaone</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mac99</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>ppce500</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sam460ex</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>pegasos2</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>bamboo</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>40p</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ref405ep</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:     <arch name='ppc64'>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>amigaone</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='2048'>powernv9</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 02:57:38.803703 np0000001589 nova-compute[98297]:       <machine maxCpus='2048'>powernv10</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>ppce500</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>40p</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>pegasos2</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>bamboo</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>g3beige</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 02:57:38.804787 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mac99</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sam460ex</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ref405ep</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='2048'>powernv8</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:     <arch name='ppc64le'>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-noble</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>amigaone</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='2048'>powernv9</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='15'>mpc8544ds</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='2048'>powernv10</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>ppce500</machine>
May 28 02:57:38.805638 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>40p</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>pegasos2</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>bamboo</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-focal</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>g3beige</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-disco</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>virtex-ml507</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>mac99</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-impish</machine>
May 28 02:57:38.806513 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-artful</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sam460ex</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>ref405ep</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='2048'>powernv8</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <arch name='riscv32'>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='8'>spike</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>opentitan</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='5'>sifive_u</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sifive_e</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <arch name='riscv64'>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='512'>virt</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='8'>spike</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='5'>sifive_u</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>shakti_c</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sifive_e</machine>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:     <arch name='s390x'>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 28 02:57:38.807258 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 28 02:57:38.808537 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <arch name='sh4'>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>shix</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>r2d</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <arch name='sh4eb'>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>shix</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>r2d</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:     <arch name='sparc'>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>SS-5</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>SS-20</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>LX</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>SPARCClassic</machine>
May 28 02:57:38.809386 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>leon3_generic</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>SPARCbook</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>SS-4</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>SS-600MP</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>SS-10</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>Voyager</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     <arch name='sparc64'>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sun4u</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>niagara</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>sun4v</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:     <arch name='x86_64'>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <wordsize>64</wordsize>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 28 02:57:38.810529 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>x-remote</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 28 02:57:38.811586 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='1'>isapc</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 28 02:57:38.812526 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>microvm</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 28 02:57:38.813296 np0000001589 nova-compute[98297]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <domain type='kvm'/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <acpi default='on' toggle='yes'/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <apic default='on' toggle='no'/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     <arch name='xtensa'>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>sim</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>kc705</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>ml605</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>virt</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx200</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx60</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:   <guest>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     <os_type>hvm</os_type>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:     <arch name='xtensaeb'>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <wordsize>32</wordsize>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='4'>sim</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>kc705</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>ml605</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>ml605-nommu</machine>
May 28 02:57:38.813920 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>virt</machine>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx60-nommu</machine>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx200</machine>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx200-nommu</machine>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>lx60</machine>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <machine maxCpus='32'>kc705-nommu</machine>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <domain type='qemu'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     </arch>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <features>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <cpuselection/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <deviceboot/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <disksnapshot default='on' toggle='no'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <externalSnapshot/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     </features>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   </guest>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]: </capabilities>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]: 
May 28 02:57:38.814987 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.814987 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 28 02:57:38.814987 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-alpha</path>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <machine>clipper</machine>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <arch>alpha</arch>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <vcpu max='4'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.814987 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.816086 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.817619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.817619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 28 02:57:38.817619 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-arm</path>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <machine>virt-8.2</machine>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <arch>armv6l</arch>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <vcpu max='512'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.817619 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 02:57:38.818717 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.819423 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <gic supported='yes'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       <enum name='version'>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>2</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:         <value>3</value>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     </gic>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.820593 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.822017 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 28 02:57:38.822017 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-arm</path>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <machine>virt-8.2</machine>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <arch>armv6l</arch>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <vcpu max='512'/>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 02:57:38.822017 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.822904 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.823904 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <gic supported='yes'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <enum name='version'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>2</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>3</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     </gic>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.825554 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.825554 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 28 02:57:38.825554 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-arm</path>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <machine>virt-8.2</machine>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <arch>armv7l</arch>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <vcpu max='512'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <enum name='firmware'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <value>efi</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.825554 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 02:57:38.826593 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.827271 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     <gic supported='yes'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       <enum name='version'>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>2</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:         <value>3</value>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.828285 np0000001589 nova-compute[98297]:     </gic>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.830055 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.830055 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 28 02:57:38.830055 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-aarch64</path>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <machine>virt-8.2</machine>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <arch>aarch64</arch>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <vcpu max='512'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <enum name='firmware'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <value>efi</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 28 02:57:38.830055 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 28 02:57:38.830909 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.831526 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:     <gic supported='yes'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:       <enum name='version'>
May 28 02:57:38.832500 np0000001589 nova-compute[98297]:         <value>2</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>3</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     </gic>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.833851 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.833851 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 28 02:57:38.833851 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-cris</path>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <machine>axis-dev88</machine>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <arch>cris</arch>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.833851 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <redirdev supported='no'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.835036 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.836781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.836781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 28 02:57:38.836781 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-i386</path>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <machine>pc-i440fx-noble</machine>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <arch>i686</arch>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <vcpu max='255'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.836781 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='lm'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 02:57:38.837691 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.838501 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.839073 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.840492 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.842894 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 28 02:57:38.842894 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-i386</path>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <machine>pc-i440fx-noble-v2</machine>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <arch>i686</arch>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <vcpu max='255'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.842894 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='lm'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.844778 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.845977 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.846921 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.848709 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.850723 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 28 02:57:38.850723 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-i386</path>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <machine>pc-q35-noble-v2</machine>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <arch>i686</arch>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <vcpu max='1024'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.850723 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='lm'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.852212 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.853712 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.854696 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.856583 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.859408 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 28 02:57:38.859408 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-i386</path>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <machine>pc-q35-noble</machine>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <arch>i686</arch>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <vcpu max='1024'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.859408 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='lm'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>qemu64</model>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.861081 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='unknown'>kvm64</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>core2duo</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Penryn</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.862637 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Conroe</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.863573 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.865132 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.867284 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.867284 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 28 02:57:38.867284 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <machine>mcf5208evb</machine>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <arch>m68k</arch>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.867284 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.868710 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <redirdev supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.870584 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 28 02:57:38.870584 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-m68k</path>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <machine>virt-8.2</machine>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <arch>m68k</arch>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.870584 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <redirdev supported='no'/>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.871719 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.873590 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.873590 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 28 02:57:38.873590 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-microblaze</path>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <machine>petalogix-s3adsp1800</machine>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <arch>microblaze</arch>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.873590 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <redirdev supported='no'/>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.875248 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.877438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.877438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 28 02:57:38.877438 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <machine>petalogix-s3adsp1800</machine>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <arch>microblazeel</arch>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.877438 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <redirdev supported='no'/>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.879111 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.881408 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.881408 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 28 02:57:38.881408 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-mips</path>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <machine>malta</machine>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <arch>mips</arch>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <vcpu max='16'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.881408 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.883151 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.885291 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.885291 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 28 02:57:38.885291 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-mipsel</path>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <machine>malta</machine>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <arch>mipsel</arch>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <vcpu max='16'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.885291 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.886980 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.889121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.889121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 28 02:57:38.889121 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-mips64</path>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   <machine>malta</machine>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   <arch>mips64</arch>
May 28 02:57:38.889121 np0000001589 nova-compute[98297]:   <vcpu max='16'/>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.890859 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.892965 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.894901 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.894901 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 28 02:57:38.894901 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-mips64el</path>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <machine>malta</machine>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <arch>mips64el</arch>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <vcpu max='16'/>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.894901 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.896763 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.898899 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.898899 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 28 02:57:38.898899 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-ppc</path>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <machine>g3beige</machine>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <arch>ppc</arch>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.898899 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.900696 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.902766 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.902766 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 28 02:57:38.902766 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <machine>pseries-noble</machine>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <arch>ppc64</arch>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <vcpu max='4096'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.902766 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.904479 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>tpm-spapr</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>spapr-tpm-proxy</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.906403 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.908265 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 28 02:57:38.908265 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <machine>pseries-noble</machine>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <arch>ppc64</arch>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <vcpu max='4096'/>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.908265 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>tpm-spapr</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>spapr-tpm-proxy</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.910000 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.912035 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 28 02:57:38.912035 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-ppc64</path>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <machine>powernv9</machine>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <arch>ppc64</arch>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <vcpu max='2048'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.912035 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.913943 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>tpm-spapr</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>spapr-tpm-proxy</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.916198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.916198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 28 02:57:38.916198 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 02:57:38.916198 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <machine>pseries-noble</machine>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <arch>ppc64le</arch>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <vcpu max='4096'/>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.917960 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>tpm-spapr</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>spapr-tpm-proxy</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.920009 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.921983 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 28 02:57:38.921983 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <machine>powernv9</machine>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <arch>ppc64le</arch>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <vcpu max='2048'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.921983 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>tpm-spapr</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:         <value>spapr-tpm-proxy</value>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.923596 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.925508 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.925508 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 28 02:57:38.925508 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-riscv32</path>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <machine>virt</machine>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <arch>riscv32</arch>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <vcpu max='512'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.925508 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.927129 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.928721 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.929865 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.929865 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 28 02:57:38.929865 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-riscv64</path>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <machine>virt</machine>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <arch>riscv64</arch>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <vcpu max='512'/>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>any</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>max</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.929865 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.930641 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.932336 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.932336 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 28 02:57:38.932336 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-s390x</path>
May 28 02:57:38.932336 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:   <machine>s390-ccw-virtio-noble</machine>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:   <arch>s390x</arch>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:   <vcpu max='248'/>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z13</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.3</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z13-base</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.2</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z14</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.4</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z196</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z114-base</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen16b</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen16a</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.5</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z196.2</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>zEC12</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9BC</model>
May 28 02:57:38.933845 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z890</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z13.2</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z14.2</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z196-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z14-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z800</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10EC</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z900</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>max</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen15b</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen15a</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z114</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z13s</model>
May 28 02:57:38.935145 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z890.3</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z890.2</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z890-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z10BC</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9EC</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>zBC12</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z990-base</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.935975 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <s390-pv supported='no'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.937304 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.939294 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.939294 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 28 02:57:38.939294 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-sh4</path>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <machine>shix</machine>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <arch>sh4</arch>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.939294 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.941198 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.943246 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.943246 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 28 02:57:38.943246 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <machine>shix</machine>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <arch>sh4eb</arch>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.943246 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.944886 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.946927 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.946927 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 28 02:57:38.946927 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-sparc</path>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <machine>SS-5</machine>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <arch>sparc</arch>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.946927 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <redirdev supported='no'/>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.948610 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <enum name='model'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.950737 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.950737 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 28 02:57:38.950737 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-sparc64</path>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <machine>sun4u</machine>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <arch>sparc64</arch>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <vcpu max='1'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.950737 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.952424 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.954540 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.954540 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 28 02:57:38.954540 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <machine>pc-i440fx-noble</machine>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <arch>x86_64</arch>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <vcpu max='255'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <enum name='firmware'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <value>efi</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 02:57:38.954540 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.956245 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.957709 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.958737 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.960089 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.962133 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 28 02:57:38.962133 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <machine>pc-i440fx-noble-v2</machine>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <arch>x86_64</arch>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <vcpu max='255'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     <enum name='firmware'>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:       <value>efi</value>
May 28 02:57:38.962133 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.964117 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.965572 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:         <value>ide</value>
May 28 02:57:38.966680 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.968005 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.970195 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 28 02:57:38.970195 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   <machine>pc-q35-noble-v2</machine>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   <arch>x86_64</arch>
May 28 02:57:38.970195 np0000001589 nova-compute[98297]:   <vcpu max='1024'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     <enum name='firmware'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <value>efi</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.972195 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.973870 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.975392 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.976559 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.978723 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.980867 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 28 02:57:38.980867 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-x86_64</path>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <machine>pc-q35-noble</machine>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <arch>x86_64</arch>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <vcpu max='1024'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     <enum name='firmware'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <value>efi</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='yes'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <enum name='maximumMigratable'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>on</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:         <value>off</value>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='yes'>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <model fallback='forbid'>EPYC</model>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <vendor>AMD</vendor>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='acpi'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='ss'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='monitor'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='hypervisor'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='erms'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='mpx'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='pcommit'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='clwb'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='umip'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='pku'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='vaes'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='la57'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='rdpid'/>
May 28 02:57:38.980867 np0000001589 nova-compute[98297]:       <feature policy='require' name='pks'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrm'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='fzrm'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrs'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='fsrc'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnowext'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='3dnow'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='xsaveerptr'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='wbnoinvd'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='npt'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='vgif'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='require' name='svme-addr-chk'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='disable' name='vme'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='disable' name='xsavec'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='disable' name='fxsr_opt'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='disable' name='misalignsse'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='disable' name='osvw'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='disable' name='topoext'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <feature policy='disable' name='nrip-save'/>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:     <mode name='custom' supported='yes'>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>phenom</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>pentium</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>n270</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>athlon</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 28 02:57:38.982493 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Haswell</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='AMD'>EPYC</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 28 02:57:38.983634 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <model usable='yes' vendor='unknown'>486</model>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     </mode>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>vmvga</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>qxl</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>ramfb</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.984599 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <tpm supported='yes'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>tpm-tis</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>tpm-crb</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>passthrough</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>emulator</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>external</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='backendVersion'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>1.2</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>2.0</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     </tpm>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='yes'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <genid supported='yes'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:     <hyperv supported='yes'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:       <enum name='features'>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>relaxed</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>vapic</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>spinlocks</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>vpindex</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>runtime</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>synic</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>stimer</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>reset</value>
May 28 02:57:38.986777 np0000001589 nova-compute[98297]:         <value>vendor_id</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>frequencies</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>reenlightenment</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>tlbflush</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>ipi</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>avic</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     </hyperv>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.988888 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.988888 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 28 02:57:38.988888 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-xtensa</path>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <machine>sim</machine>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <arch>xtensa</arch>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <vcpu max='4'/>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.988888 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.990586 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.991820 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98297) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 28 02:57:38.991820 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 28 02:57:38.991820 np0000001589 nova-compute[98297]: <domainCapabilities>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <domain>qemu</domain>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <machine>sim</machine>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <arch>xtensaeb</arch>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <vcpu max='4'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <iothreads supported='yes'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <os supported='yes'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <enum name='firmware'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <loader supported='yes'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>rom</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>pflash</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <enum name='readonly'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>yes</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       <enum name='secure'>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:         <value>no</value>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     </loader>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   </os>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   <cpu>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <mode name='host-passthrough' supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <mode name='maximum' supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <mode name='host-model' supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:     <mode name='custom' supported='no'/>
May 28 02:57:38.991820 np0000001589 nova-compute[98297]:   </cpu>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:   <memoryBacking supported='yes'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     <enum name='sourceType'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <value>file</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <value>anonymous</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <value>memfd</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:   </memoryBacking>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:   <devices>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     <disk supported='yes'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='diskDevice'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>disk</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>cdrom</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>floppy</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>lun</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>fdc</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>sata</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     </disk>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     <graphics supported='yes'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>sdl</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>vnc</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>spice</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>egl-headless</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>dbus</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     </graphics>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     <video supported='yes'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='modelType'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>vga</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>cirrus</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>none</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>bochs</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     </video>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     <hostdev supported='yes'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='mode'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>subsystem</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='startupPolicy'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>default</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>mandatory</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>requisite</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>optional</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='subsysType'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>pci</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>scsi</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='capsType'/>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='pciBackend'/>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     </hostdev>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     <rng supported='yes'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio-transitional</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>virtio-non-transitional</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>random</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>egd</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     </rng>
May 28 02:57:38.992791 np0000001589 nova-compute[98297]:     <filesystem supported='yes'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       <enum name='driverType'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>path</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>handle</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>virtiofs</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     </filesystem>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <tpm supported='no'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <redirdev supported='yes'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       <enum name='bus'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>usb</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     </redirdev>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <channel supported='yes'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>pty</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>unix</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>spicevmc</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     </channel>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <crypto supported='yes'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       <enum name='model'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>virtio</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       <enum name='type'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>qemu</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       <enum name='backendModel'>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:         <value>builtin</value>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:       </enum>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     </crypto>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:   </devices>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:   <features>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <gic supported='no'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <vmcoreinfo supported='no'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <genid supported='no'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <backingStoreInput supported='yes'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <backup supported='yes'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <async-teardown supported='yes'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <sev supported='no'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:     <sgx supported='no'/>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:   </features>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]: </domainCapabilities>
May 28 02:57:38.993983 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 28 02:57:38.993983 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Checking secure boot support for host arch (x86_64) {{(pid=98297) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 02:57:38.993983 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Checking secure boot support for host arch (x86_64) {{(pid=98297) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 02:57:38.993983 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Checking secure boot support for host arch (x86_64) {{(pid=98297) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 02:57:38.994725 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Checking secure boot support for host arch (x86_64) {{(pid=98297) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 02:57:38.994725 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Checking secure boot support for host arch (x86_64) {{(pid=98297) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 28 02:57:38.994725 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Secure Boot support detected
May 28 02:57:39.399431 np0000001589 nova-compute[98297]: INFO nova.virt.node [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Generated node identity 672703c4-2150-4765-9740-44d3bdb44a8c
May 28 02:57:39.399745 np0000001589 nova-compute[98297]: INFO nova.virt.node [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Wrote node identity 672703c4-2150-4765-9740-44d3bdb44a8c to /opt/stack/data/nova/compute_id
May 28 02:57:39.902502 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Compute nodes ['672703c4-2150-4765-9740-44d3bdb44a8c'] for host np0000001589 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 28 02:57:40.906734 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 28 02:57:41.911514 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] No compute node record found for host np0000001589. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001589 could not be found.
May 28 02:57:41.912092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:57:41.912092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:57:41.912092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:57:41.912092 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:57:41.969020 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:57:41.969782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:57:41.985947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:57:41.986347 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Hypervisor/Node resource view: name=np0000001589 free_ram=16530MB free_disk=75.20817184448242GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:57:41.986487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:57:41.986746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:57:42.489688 np0000001589 nova-compute[98297]: WARNING nova.compute.resource_tracker [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] No compute node record for np0000001589:672703c4-2150-4765-9740-44d3bdb44a8c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 672703c4-2150-4765-9740-44d3bdb44a8c could not be found.
May 28 02:57:42.993824 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Compute node record created for np0000001589:np0000001589 with uuid: 672703c4-2150-4765-9740-44d3bdb44a8c
May 28 02:57:44.501404 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:57:44.501833 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:57:41 up 25 min,  2 users,  load average: 2.88, 1.77, 0.90\n'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:57:44.957262 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] [req-957c6ffb-b1f2-4fec-a8a8-9306614d2f81] Created resource provider record via placement API for resource provider with UUID 672703c4-2150-4765-9740-44d3bdb44a8c and name np0000001589.
May 28 02:57:45.006960 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] /sys/module/kvm_amd/parameters/sev contains [N
May 28 02:57:45.006960 np0000001589 nova-compute[98297]: ] {{(pid=98297) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 28 02:57:45.007099 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.host [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] kernel doesn't support AMD SEV
May 28 02:57:45.007330 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:57:45.007522 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 02:57:45.007799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 02:57:45.011736 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Libvirt baseline CPU <cpu>
May 28 02:57:45.011736 np0000001589 nova-compute[98297]:   <arch>x86_64</arch>
May 28 02:57:45.011736 np0000001589 nova-compute[98297]:   <model>Nehalem</model>
May 28 02:57:45.011736 np0000001589 nova-compute[98297]:   <vendor>AMD</vendor>
May 28 02:57:45.011736 np0000001589 nova-compute[98297]:   <topology sockets="12" cores="1" threads="1"/>
May 28 02:57:45.011736 np0000001589 nova-compute[98297]:   <maxphysaddr mode="emulate" bits="40"/>
May 28 02:57:45.011736 np0000001589 nova-compute[98297]: </cpu>
May 28 02:57:45.011736 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 28 02:57:45.569638 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Updated inventory for provider 672703c4-2150-4765-9740-44d3bdb44a8c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 28 02:57:45.569950 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Updating resource provider 672703c4-2150-4765-9740-44d3bdb44a8c generation from 0 to 1 during operation: update_inventory {{(pid=98297) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 02:57:45.569950 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 02:57:45.703161 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Updating resource provider 672703c4-2150-4765-9740-44d3bdb44a8c generation from 1 to 2 during operation: update_traits {{(pid=98297) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 28 02:57:46.211350 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:57:46.211497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.225s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:57:46.211683 np0000001589 nova-compute[98297]: DEBUG nova.service [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98297) start /opt/stack/nova/nova/service.py:195}}
May 28 02:57:46.224522 np0000001589 nova-compute[98297]: DEBUG nova.service [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98297) start /opt/stack/nova/nova/service.py:211}}
May 28 02:57:46.236466 np0000001589 nova-compute[98297]: DEBUG nova.service [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] Join ServiceGroup membership for this service compute {{(pid=98297) start /opt/stack/nova/nova/service.py:221}}
May 28 02:57:46.236651 np0000001589 nova-compute[98297]: DEBUG nova.servicegroup.drivers.db [None req-8c0fc2d0-3148-4d02-8c39-2354f3d81cbf None None] DB_Driver: join new ServiceGroup member np0000001589 to the compute group, service = <Service: host=np0000001589, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98297) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 28 02:57:51.739846 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:58:25.238572 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.239035 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.239177 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.239398 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.239658 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.239851 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.240095 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.743212 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:25.743449 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:58:25.743715 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:26.247190 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:58:26.247753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:58:26.247753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:58:26.247753 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:58:26.255662 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:58:26.256731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:58:26.274625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:58:26.275326 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=16230MB free_disk=75.07906723022461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:58:26.275623 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:58:26.275942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:58:27.340005 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:58:27.340442 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:58:26 up 26 min,  2 users,  load average: 2.01, 1.69, 0.91\n'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:58:27.381033 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:58:27.381266 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:58:27.884163 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:58:28.394286 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:58:28.394780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.118s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:58:28.394780 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:58:28.395631 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.89 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:59:28.290522 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291005 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291005 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291134 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291315 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291493 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291657 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291820 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.291929 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 02:59:28.292086 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 02:59:28.795737 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:59:28.795958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:59:28.796112 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:59:28.796286 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 02:59:28.806159 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 02:59:28.807313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 02:59:28.825144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.018s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 02:59:28.825542 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=16363MB free_disk=74.87351608276367GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 02:59:28.825686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 02:59:28.825948 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 02:59:29.871851 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 02:59:29.872164 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 02:59:28 up 27 min,  2 users,  load average: 1.38, 1.57, 0.93\n'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 02:59:29.916568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 02:59:29.916865 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 02:59:30.419467 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 02:59:30.927086 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 02:59:30.927616 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.101s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 02:59:30.927616 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 02:59:51.742740 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:00:01.053169 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:01.053169 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:01.555332 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:02.169192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:02.169716 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:02.178554 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:02.178979 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Claim successful on node np0000001589
May 28 03:00:03.305788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:03.306126 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:03.809913 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:04.316652 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.147s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:04.317594 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:04.686368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:04.686368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:04.827163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:04.827163 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:04.830073 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:04.832018 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:05.188570 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:05.334638 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:05.430472 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac0cdcec6a84b5da3545699090a9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c7d1983352f42f79e96d32b0ec160ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:05.730583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:05.730768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:05.763103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:05.763384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:05.766243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:05.766462 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Claim successful on node np0000001589
May 28 03:00:05.837973 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:06.233302 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:06.516125 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Successfully created port: f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:06.799150 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:06.847468 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:06.848788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:06.849044 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Creating image(s)
May 28 03:00:06.853778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "/opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:06.854090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "/opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:06.854965 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "/opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:06.856652 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:06.857578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:07.031203 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:07.031203 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:07.189658 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:07.192318 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:07.192684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:07.260452 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.part --force-share --output=json" returned: 0 in 0.067s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:07.261264 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] f91efa2d-3177-46c9-add1-8d87d786068d was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:00:07.261983 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:00:07.262386 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.part /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:07.402931 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.part /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.converted" returned: 0 in 0.140s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:07.407924 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:07.472156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a.converted --force-share --output=json" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:07.473098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.615s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:07.473774 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:07.477059 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:07.478036 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe0m9610n/privsep.sock']
May 28 03:00:07.481362 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Successfully updated port: f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:07.489964 np0000001589 sudo[109540]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe0m9610n/privsep.sock
May 28 03:00:07.492025 np0000001589 sudo[109540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 03:00:07.534632 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:07.763139 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 03:00:07.763355 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 03:00:07.763355 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 03:00:07.763459 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:07.763459 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 03:00:07.763557 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 03:00:07.763601 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 03:00:07.763677 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:07.766254 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 03:00:07.984524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "refresh_cache-c908f979-83fa-417c-a4eb-0b0de669c37b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:07.984681 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquired lock "refresh_cache-c908f979-83fa-417c-a4eb-0b0de669c37b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:07.985358 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:08.044563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.281s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:08.046482 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:08.050079 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.247s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:08.065172 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:08.065172 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Claim successful on node np0000001589
May 28 03:00:08.166548 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 03:00:08.166653 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 03:00:08.166756 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 03:00:08.166832 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:08.166905 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 03:00:08.166975 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 03:00:08.167044 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 03:00:08.168120 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:08.168120 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 03:00:08.499844 np0000001589 sudo[109540]: pam_unix(sudo:session): session closed for user root
May 28 03:00:08.501541 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Spawned new privsep daemon via rootwrap
May 28 03:00:08.502523 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 03:00:08.502661 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 03:00:08.503004 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 28 03:00:08.503109 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109548
May 28 03:00:08.559211 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:08.560175 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:08.561043 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:08.561444 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:08.573106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:08.593941 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-changed-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:08.594163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Refreshing instance network info cache due to event network-changed-f50a0eda-06a8-4d7b-a23a-a550ba2406a8. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:08.594478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] Acquiring lock "refresh_cache-c908f979-83fa-417c-a4eb-0b0de669c37b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:08.650439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.077s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:08.651016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:08.651399 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:08.651882 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:08.656136 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:08.656447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:08.736032 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.079s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:08.738898 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:08.772017 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk 1073741824" returned: 0 in 0.033s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:08.772621 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.121s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:08.773049 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:08.847545 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.074s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:08.848119 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:08.848666 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:08.924009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:08.924826 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Cannot resize image /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:08.925372 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:08.925604 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Ensure instance console log exists: /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:08.925910 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:08.926317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:08.926404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:08.996937 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:09.064845 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:09.073992 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a458f7278e04c8994d4e5c7e58cb965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d6cce2ab49640c9aefb1dcadf5b564d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:09.313752 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:09.314877 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:09.569510 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:09.817879 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:10.330895 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.285s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:10.330895 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:10.578793 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:10.581367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:10.581367 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Creating image(s)
May 28 03:00:10.583665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "/opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:10.583665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "/opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:10.583665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "/opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:10.584214 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:10.588840 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:10.589251 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:10.664022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.072s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:10.664022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:10.664022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:10.664022 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:10.667457 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:10.667843 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:10.738510 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:10.738987 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:10.771207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk 1073741824" returned: 0 in 0.032s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:10.771718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.109s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:10.772130 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:10.841845 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:10.841845 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:10.842458 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:10.842779 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:10.844494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.072s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:10.845776 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:10.846861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:10.926712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:10.927793 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Cannot resize image /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:10.927793 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:10.927987 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Ensure instance console log exists: /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:10.928215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:10.929140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:10.929140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:11.131042 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Successfully created port: 745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:11.342849 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:11.523338 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2776d33c40e0490eb87787c8dafc8066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2ef1b6a03d428d94b2072c01964b49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:11.846880 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:12.210020 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:12.788423 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Successfully updated port: 745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:12.857722 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:12.858926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:12.859143 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Creating image(s)
May 28 03:00:12.859828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "/opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:12.860040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:12.860485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:12.861512 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:12.864310 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:12.865268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:12.923972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:12.924575 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:12.925055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:12.925434 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:12.929261 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:12.929596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:12.998759 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.069s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:12.999295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:13.033153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk 1073741824" returned: 0 in 0.033s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:13.035488 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.109s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:13.035488 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:13.113915 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.079s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:13.114513 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:13.114852 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:13.187427 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:13.189962 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Cannot resize image /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:13.189962 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:13.189962 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Ensure instance console log exists: /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:13.189962 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:13.189962 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:13.189962 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:13.290878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "refresh_cache-1db1431d-de49-4ad1-ab4a-d05e1e8ed591" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:13.291016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquired lock "refresh_cache-1db1431d-de49-4ad1-ab4a-d05e1e8ed591" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:13.291203 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:13.319373 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Successfully created port: daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:13.349324 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Updating instance_info_cache with network_info: [{"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:13.853182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Releasing lock "refresh_cache-c908f979-83fa-417c-a4eb-0b0de669c37b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:13.853537 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Instance network_info: |[{"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:13.853963 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] Acquired lock "refresh_cache-c908f979-83fa-417c-a4eb-0b0de669c37b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:13.857299 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Start _get_guest_xml network_info=[{"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:13.857299 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Refreshing network info cache for port f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:13.859528 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:13.862099 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-564621560', uuid='c908f979-83fa-417c-a4eb-0b0de669c37b'), owner=OwnerMeta(userid='9ac0cdcec6a84b5da3545699090a9ea0', username='tempest-ServersNegativeTestJSON-612301624-project-member', projectid='2c7d1983352f42f79e96d32b0ec160ce', projectname='tempest-ServersNegativeTestJSON-612301624'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937213.8608148) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:13.864037 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:13.864505 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:13.865195 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:13.865436 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:13.866910 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:13.867314 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:13.867535 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:13.867645 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:13.867850 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:13.867934 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:13.868033 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:13.868238 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:13.868426 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:13.868915 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:13.869029 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:13.869136 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:13.880187 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Successfully updated port: daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:13.887639 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:00:13.889413 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-564621560',display_name='tempest-ServersNegativeTestJSON-server-564621560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serversnegativetestjson-server-564621560',id=1,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7d1983352f42f79e96d32b0ec160ce',ramdisk_id='',reservation_id='r-nauybv2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-612301624',owner_user_name='tempest-ServersNegativeTestJSON-612301624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:06Z,user_data=None,user_id='9ac0cdcec6a84b5da3545699090a9ea0',uuid=c908f979-83fa-417c-a4eb-0b0de669c37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:13.889621 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converting VIF {"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:13.890429 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e9:d2,bridge_name='br-int',has_traffic_filtering=True,id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50a0eda-06') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:13.891936 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lazy-loading 'pci_devices' on Instance uuid c908f979-83fa-417c-a4eb-0b0de669c37b {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:13.952162 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-changed-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:13.952390 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Refreshing instance network info cache due to event network-changed-daff420e-0782-4f0a-8b29-86782a4461e0. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:13.952534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] Acquiring lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:13.952684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] Acquired lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:13.953068 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Refreshing network info cache for port daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:14.229831 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:14.360658 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:14.387236 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:14.396642 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <uuid>c908f979-83fa-417c-a4eb-0b0de669c37b</uuid>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <name>instance-00000001</name>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServersNegativeTestJSON-server-564621560</nova:name>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:13</nova:creationTime>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:user uuid="9ac0cdcec6a84b5da3545699090a9ea0">tempest-ServersNegativeTestJSON-612301624-project-member</nova:user>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:project uuid="2c7d1983352f42f79e96d32b0ec160ce">tempest-ServersNegativeTestJSON-612301624</nova:project>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         <nova:port uuid="f50a0eda-06a8-4d7b-a23a-a550ba2406a8">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <entry name="serial">c908f979-83fa-417c-a4eb-0b0de669c37b</entry>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <entry name="uuid">c908f979-83fa-417c-a4eb-0b0de669c37b</entry>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk.config"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ba:e9:d2"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <target dev="tapf50a0eda-06"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/console.log" append="off"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:14.396642 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:14.399468 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Preparing to wait for external event network-vif-plugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:14.399468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:14.399468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:14.399468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:14.399468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T02:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-564621560',display_name='tempest-ServersNegativeTestJSON-server-564621560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serversnegativetestjson-server-564621560',id=1,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7d1983352f42f79e96d32b0ec160ce',ramdisk_id='',reservation_id='r-nauybv2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-612301624',owner_user_name='tempest-ServersNegativeTestJSON-612301624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:06Z,user_data=None,user_id='9ac0cdcec6a84b5da3545699090a9ea0',uuid=c908f979-83fa-417c-a4eb-0b0de669c37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:14.399773 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converting VIF {"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:14.399773 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e9:d2,bridge_name='br-int',has_traffic_filtering=True,id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50a0eda-06') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:14.399899 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e9:d2,bridge_name='br-int',has_traffic_filtering=True,id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50a0eda-06') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:14.453018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Created schema index Interface.name {{(pid=98297) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 03:00:14.453234 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Created schema index Port.name {{(pid=98297) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 03:00:14.453502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Created schema index Bridge.name {{(pid=98297) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 28 03:00:14.453856 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:00:14.454065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [POLLOUT] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:14.454258 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:00:14.454804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:14.456960 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:14.457505 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:14.480172 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:14.500667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:14.500909 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:14.501132 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:14.501944 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:14.502127 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b904431f-45d5-5535-bb32-36e8f9d799c8', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:14.503509 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:14.505068 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:14.506269 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp7ghslh32/privsep.sock']
May 28 03:00:14.513208 np0000001589 sudo[109640]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp7ghslh32/privsep.sock
May 28 03:00:14.513831 np0000001589 sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 03:00:14.650124 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:14.691956 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-changed-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:14.692666 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Refreshing instance network info cache due to event network-changed-745d2149-bd89-46b7-9242-edd7a9c4c2d8. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:14.692862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] Acquiring lock "refresh_cache-1db1431d-de49-4ad1-ab4a-d05e1e8ed591" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:14.726825 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:14.802238 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 03:00:14.931437 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:14.973776 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Updating instance_info_cache with network_info: [{"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:15.015098 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:15.154993 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 03:00:15.155594 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 03:00:15.155594 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 03:00:15.155594 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:15.155594 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 03:00:15.155757 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 03:00:15.155908 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 03:00:15.156058 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:15.156711 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 03:00:15.170388 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Updated VIF entry in instance network info cache for port f50a0eda-06a8-4d7b-a23a-a550ba2406a8. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:00:15.170667 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Updating instance_info_cache with network_info: [{"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:15.401061 np0000001589 sudo[109640]: pam_unix(sudo:session): session closed for user root
May 28 03:00:15.403840 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Spawned new privsep daemon via rootwrap
May 28 03:00:15.405445 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 28 03:00:15.405445 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 28 03:00:15.405445 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 28 03:00:15.405445 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109657
May 28 03:00:15.433425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b9257bc2-f16e-46ab-882f-8be58d20bab1 req-cbe38a7d-42e8-4f57-9890-7a155aa4021b service nova] Releasing lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:15.433844 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquired lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:15.434019 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:15.476619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Releasing lock "refresh_cache-1db1431d-de49-4ad1-ab4a-d05e1e8ed591" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:15.476619 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Instance network_info: |[{"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:15.476619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] Acquired lock "refresh_cache-1db1431d-de49-4ad1-ab4a-d05e1e8ed591" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:15.476619 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Refreshing network info cache for port 745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:15.477624 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Start _get_guest_xml network_info=[{"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:15.480350 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:15.481625 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1217717904', uuid='1db1431d-de49-4ad1-ab4a-d05e1e8ed591'), owner=OwnerMeta(userid='6a458f7278e04c8994d4e5c7e58cb965', username='tempest-DeleteServersTestJSON-1397080245-project-member', projectid='5d6cce2ab49640c9aefb1dcadf5b564d', projectname='tempest-DeleteServersTestJSON-1397080245'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937215.4812071) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:15.482598 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:15.482973 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:15.487215 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:15.487518 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:15.488567 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:15.488957 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:15.489158 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:15.489309 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:15.489476 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:15.489594 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:15.489713 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:15.489901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:15.490029 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:15.490170 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:15.491092 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:15.491293 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:15.510612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1217717904',display_name='tempest-DeleteServersTestJSON-server-1217717904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-deleteserverstestjson-server-1217717904',id=2,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d6cce2ab49640c9aefb1dcadf5b564d',ramdisk_id='',reservation_id='r-91bdc42h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1397080245',owner_user_name='tempest-DeleteServersTestJSON-1397080245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:10Z,user_data=None,user_id='6a458f7278e04c8994d4e5c7e58cb965',uuid=1db1431d-de49-4ad1-ab4a-d05e1e8ed591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:15.510985 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Converting VIF {"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:15.511397 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:9a,bridge_name='br-int',has_traffic_filtering=True,id=745d2149-bd89-46b7-9242-edd7a9c4c2d8,network=Network(fb71751d-c3b4-4b56-a5f3-5367924eb0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745d2149-bd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:15.511924 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lazy-loading 'pci_devices' on Instance uuid 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:15.527731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:15.527731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:15.672748 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5bb97747-ad3f-4536-8879-0675d5c24fe7 req-0336aee8-aee4-475b-a8c4-42b21485d43c service nova] Releasing lock "refresh_cache-c908f979-83fa-417c-a4eb-0b0de669c37b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:15.708020 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:15.708414 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf50a0eda-06, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:15.708796 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf50a0eda-06, col_values=(('qos', UUID('20778c76-928a-45ba-a675-b198e7250f0b')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:15.710172 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf50a0eda-06, col_values=(('external_ids', {'iface-id': 'f50a0eda-06a8-4d7b-a23a-a550ba2406a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:e9:d2', 'vm-uuid': 'c908f979-83fa-417c-a4eb-0b0de669c37b'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:15.711240 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:15.712123 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:15.722234 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:15.723114 np0000001589 nova-compute[98297]: INFO os_vif [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e9:d2,bridge_name='br-int',has_traffic_filtering=True,id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50a0eda-06')
May 28 03:00:15.984258 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:16.015485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <uuid>1db1431d-de49-4ad1-ab4a-d05e1e8ed591</uuid>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <name>instance-00000002</name>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:name>tempest-DeleteServersTestJSON-server-1217717904</nova:name>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:15</nova:creationTime>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:user uuid="6a458f7278e04c8994d4e5c7e58cb965">tempest-DeleteServersTestJSON-1397080245-project-member</nova:user>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:project uuid="5d6cce2ab49640c9aefb1dcadf5b564d">tempest-DeleteServersTestJSON-1397080245</nova:project>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         <nova:port uuid="745d2149-bd89-46b7-9242-edd7a9c4c2d8">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <entry name="serial">1db1431d-de49-4ad1-ab4a-d05e1e8ed591</entry>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <entry name="uuid">1db1431d-de49-4ad1-ab4a-d05e1e8ed591</entry>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk.config"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:9c:8a:9a"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <target dev="tap745d2149-bd"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/console.log" append="off"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:16.015485 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:16.018630 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Preparing to wait for external event network-vif-plugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:16.018630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:16.018630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:16.018630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:16.018630 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1217717904',display_name='tempest-DeleteServersTestJSON-server-1217717904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-deleteserverstestjson-server-1217717904',id=2,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5d6cce2ab49640c9aefb1dcadf5b564d',ramdisk_id='',reservation_id='r-91bdc42h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1397080245',owner_user_name='tempest-DeleteServersTestJSON-1397080245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:10Z,user_data=None,user_id='6a458f7278e04c8994d4e5c7e58cb965',uuid=1db1431d-de49-4ad1-ab4a-d05e1e8ed591,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:16.019077 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Converting VIF {"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:16.019077 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:9a,bridge_name='br-int',has_traffic_filtering=True,id=745d2149-bd89-46b7-9242-edd7a9c4c2d8,network=Network(fb71751d-c3b4-4b56-a5f3-5367924eb0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745d2149-bd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:16.019077 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:9a,bridge_name='br-int',has_traffic_filtering=True,id=745d2149-bd89-46b7-9242-edd7a9c4c2d8,network=Network(fb71751d-c3b4-4b56-a5f3-5367924eb0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745d2149-bd') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:16.020096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:16.020096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:16.020330 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:16.023605 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:16.025973 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:16.026197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9df2d2a1-b350-5d01-9092-500a8663af28', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:16.028524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:16.030421 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:16.035061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:16.037055 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:16.037332 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap745d2149-bd, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:16.037789 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap745d2149-bd, col_values=(('qos', UUID('ce5bdf86-56bf-4c88-a6da-93eb70b14548')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:16.037972 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap745d2149-bd, col_values=(('external_ids', {'iface-id': '745d2149-bd89-46b7-9242-edd7a9c4c2d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:8a:9a', 'vm-uuid': '1db1431d-de49-4ad1-ab4a-d05e1e8ed591'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:16.039496 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:16.041185 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:16.050665 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:16.052378 np0000001589 nova-compute[98297]: INFO os_vif [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:9a,bridge_name='br-int',has_traffic_filtering=True,id=745d2149-bd89-46b7-9242-edd7a9c4c2d8,network=Network(fb71751d-c3b4-4b56-a5f3-5367924eb0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745d2149-bd')
May 28 03:00:16.404972 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:16.611416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:16.611598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:16.614652 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:16.614839 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Claim successful on node np0000001589
May 28 03:00:16.666925 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:16.871633 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Updating instance_info_cache with network_info: [{"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:16.895322 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:17.242636 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:17.243810 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:17.243810 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] No VIF found with MAC fa:16:3e:ba:e9:d2, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:17.243810 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Using config drive
May 28 03:00:17.357050 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Updated VIF entry in instance network info cache for port 745d2149-bd89-46b7-9242-edd7a9c4c2d8. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:00:17.357390 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Updating instance_info_cache with network_info: [{"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:17.375009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Releasing lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:17.375373 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Instance network_info: |[{"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:17.378640 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Start _get_guest_xml network_info=[{"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:17.381377 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:17.382516 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1204278745', uuid='c20b05b1-2a9f-4e55-9f36-6b5e472e11e4'), owner=OwnerMeta(userid='2776d33c40e0490eb87787c8dafc8066', username='tempest-ServerActionsTestOtherA-1968473744-project-member', projectid='4d2ef1b6a03d428d94b2072c01964b49', projectname='tempest-ServerActionsTestOtherA-1968473744'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937217.382074) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:17.384826 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:17.386363 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:17.386601 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.390944 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:17.391307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:17.392219 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:17.392631 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:17.392787 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:17.392858 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:17.392967 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:17.393071 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:17.393214 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:17.393477 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:17.393568 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:17.393696 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:17.393818 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:17.393944 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:17.409497 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1204278745',display_name='tempest-ServerActionsTestOtherA-server-1204278745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-1204278745',id=3,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-i0stx5mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=c20b05b1-2a9f-4e55-9f36-6b5e472e11e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:17.410433 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:17.410433 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=daff420e-0782-4f0a-8b29-86782a4461e0,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaff420e-07') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:17.410754 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'pci_devices' on Instance uuid c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:17.456321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:17.456572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:17.490052 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:17.490218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:17.575290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:17.575290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:17.575290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] No VIF found with MAC fa:16:3e:9c:8a:9a, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:17.575290 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Using config drive
May 28 03:00:17.748585 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:17.859701 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a074c913-e921-4304-8dc0-4bd639d0437e req-7ff826f1-2704-4c7d-860c-713a43ee3a45 service nova] Releasing lock "refresh_cache-1db1431d-de49-4ad1-ab4a-d05e1e8ed591" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:17.916205 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <uuid>c20b05b1-2a9f-4e55-9f36-6b5e472e11e4</uuid>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <name>instance-00000003</name>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsTestOtherA-server-1204278745</nova:name>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:17</nova:creationTime>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:user uuid="2776d33c40e0490eb87787c8dafc8066">tempest-ServerActionsTestOtherA-1968473744-project-member</nova:user>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:project uuid="4d2ef1b6a03d428d94b2072c01964b49">tempest-ServerActionsTestOtherA-1968473744</nova:project>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         <nova:port uuid="daff420e-0782-4f0a-8b29-86782a4461e0">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <entry name="serial">c20b05b1-2a9f-4e55-9f36-6b5e472e11e4</entry>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <entry name="uuid">c20b05b1-2a9f-4e55-9f36-6b5e472e11e4</entry>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk.config"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d6:5b:eb"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <target dev="tapdaff420e-07"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/console.log" append="off"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:17.916205 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:17.922245 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Preparing to wait for external event network-vif-plugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:17.922245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:17.922245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:17.922245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:17.922245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1204278745',display_name='tempest-ServerActionsTestOtherA-server-1204278745',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-1204278745',id=3,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-i0stx5mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=c20b05b1-2a9f-4e55-9f36-6b5e472e11e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:17.923044 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:17.923044 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=daff420e-0782-4f0a-8b29-86782a4461e0,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaff420e-07') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:17.923044 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=daff420e-0782-4f0a-8b29-86782a4461e0,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaff420e-07') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:17.923417 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.923567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:17.923795 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:17.924334 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.924506 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f518b1f-7553-542c-ac19-d8df476ea903', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:17.925271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.925816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:17.938712 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.942194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.942194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaff420e-07, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:17.950889 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaff420e-07, col_values=(('qos', UUID('dfc1bd08-6dad-4626-813c-5b368de74940')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:17.950889 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaff420e-07, col_values=(('external_ids', {'iface-id': 'daff420e-0782-4f0a-8b29-86782a4461e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:5b:eb', 'vm-uuid': 'c20b05b1-2a9f-4e55-9f36-6b5e472e11e4'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:17.952029 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.952623 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:17.961537 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:17.971060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:17.973273 np0000001589 nova-compute[98297]: INFO os_vif [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=daff420e-0782-4f0a-8b29-86782a4461e0,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaff420e-07')
May 28 03:00:17.998336 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:18.067764 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:18.068280 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:18.084132 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:18.239095 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Creating config drive at /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk.config
May 28 03:00:18.242397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmznpd2nr {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:18.273998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmznpd2nr" returned: 0 in 0.031s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:18.359296 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Creating config drive at /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk.config
May 28 03:00:18.363548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0qj440eb {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:18.400456 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0qj440eb" returned: 0 in 0.036s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:18.529127 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:18.572307 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:18.585255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:19.072311 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.084986 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.473s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:19.085401 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:19.089651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.561s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:19.097988 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:19.098162 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Claim successful on node np0000001589
May 28 03:00:19.106545 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.180392 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.202014 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.202937 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.288378 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.305032 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.403188 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:19.515259 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:19.515468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:19.516247 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No VIF found with MAC fa:16:3e:d6:5b:eb, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:19.516247 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Using config drive
May 28 03:00:19.600461 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:19.600461 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:19.600651 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:19.601064 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:19.706280 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b62e58f5c1f0472482d97879c3ed3e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eb9f22f72444f96b930593adc10e114', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:20.012858 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:20.012858 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:20.027621 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:20.104152 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 28 03:00:20.263486 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Creating config drive at /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk.config
May 28 03:00:20.272128 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwrtvs5id {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:20.309868 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwrtvs5id" returned: 0 in 0.038s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:20.406313 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779937220.405942, c908f979-83fa-417c-a4eb-0b0de669c37b => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:20.407585 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] VM Started (Lifecycle Event)
May 28 03:00:20.468659 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Successfully created port: 7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:20.521719 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:20.612154 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:20.643267 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:20.643267 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:20.907942 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:20.913464 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:20.929459 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937220.925314, c908f979-83fa-417c-a4eb-0b0de669c37b => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:20.929760 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] VM Paused (Lifecycle Event)
May 28 03:00:20.932154 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:20.933797 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:21.065804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:21.109500 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:21.145832 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:21.189726 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:21.258709 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aa95edc7-bad8-4bfd-b6ff-ca3b9de7af5c req-e256027d-7617-481e-acac-1ad2ad234dad service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:21.259656 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa95edc7-bad8-4bfd-b6ff-ca3b9de7af5c req-e256027d-7617-481e-acac-1ad2ad234dad service nova] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:21.260759 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa95edc7-bad8-4bfd-b6ff-ca3b9de7af5c req-e256027d-7617-481e-acac-1ad2ad234dad service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:21.260759 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa95edc7-bad8-4bfd-b6ff-ca3b9de7af5c req-e256027d-7617-481e-acac-1ad2ad234dad service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:21.260759 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aa95edc7-bad8-4bfd-b6ff-ca3b9de7af5c req-e256027d-7617-481e-acac-1ad2ad234dad service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] No event matching network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 in dict_keys([('network-vif-plugged', 'daff420e-0782-4f0a-8b29-86782a4461e0')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:00:21.260759 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-aa95edc7-bad8-4bfd-b6ff-ca3b9de7af5c req-e256027d-7617-481e-acac-1ad2ad234dad service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received unexpected event network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 for instance with vm_state building and task_state spawning.
May 28 03:00:21.300715 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Successfully updated port: 7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:21.432646 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-changed-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:21.432646 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Refreshing instance network info cache due to event network-changed-7d93c2de-527d-4133-aa4c-fa154c3f3460. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:21.434017 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:21.434195 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] Acquiring lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:21.434349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] Acquired lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:21.434526 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Refreshing network info cache for port 7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:21.437995 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:21.620441 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:21.622274 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:21.622274 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Creating image(s)
May 28 03:00:21.622779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "/opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:21.624154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "/opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:21.624154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "/opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:21.624154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "9b16be1e2c9bbb18c6d28340b604630e386e9e5a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:21.624402 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "9b16be1e2c9bbb18c6d28340b604630e386e9e5a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:21.663245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.574s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:21.663717 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:21.666297 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.084s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:21.672069 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:21.672259 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Claim successful on node np0000001589
May 28 03:00:21.803557 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:21.942106 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:21.942674 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:21.942674 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937221.9423115, 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:21.942766 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] VM Started (Lifecycle Event)
May 28 03:00:22.020615 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c775700e4f5c458caf730a3cce6e108f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581abd74f02944689b3b2c06a6702a09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937222.4494534, 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] VM Paused (Lifecycle Event)
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:22.584932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:22.643740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.part --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:22.644903 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] 69466b9b-b0ce-4ba1-b448-468fe36816a2 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:00:22.645711 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:00:22.646127 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.part /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:22.678154 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:22.722272 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b0478c7-d0a4-492e-920a-4f5c7f2021bf req-f99600c4-5775-4f12-8d96-75f4317bb433 service nova] Releasing lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:22.722999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquired lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:22.723384 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:22.817110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.part /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.converted" returned: 0 in 0.171s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:22.822683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:22.894629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a.converted --force-share --output=json" returned: 0 in 0.072s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:22.896404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "9b16be1e2c9bbb18c6d28340b604630e386e9e5a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.271s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:22.896404 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:22.898628 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:22.900326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:22.943806 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:22.954980 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:22.960703 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:22.978097 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a --force-share --output=json" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:22.978597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "9b16be1e2c9bbb18c6d28340b604630e386e9e5a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:22.979406 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "9b16be1e2c9bbb18c6d28340b604630e386e9e5a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:22.979893 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:22.984012 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:22.984465 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:23.055453 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a --force-share --output=json" returned: 0 in 0.071s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:23.056046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a,backing_fmt=raw /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:23.093793 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a,backing_fmt=raw /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk 1073741824" returned: 0 in 0.038s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:23.096254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "9b16be1e2c9bbb18c6d28340b604630e386e9e5a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.115s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:23.096254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:23.156106 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:23.156106 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:23.161343 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Successfully created port: 040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:23.178172 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b16be1e2c9bbb18c6d28340b604630e386e9e5a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:23.178641 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:23.178897 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:23.201556 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:23.207691 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:23.224071 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:23.264596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:23.264974 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Cannot resize image /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:23.265346 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:23.265602 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Ensure instance console log exists: /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:23.265913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:23.266218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:23.266436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:23.352514 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-plugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:23.352750 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:23.352949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:23.353126 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:23.353402 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Processing event network-vif-plugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:23.353584 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-plugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:23.353736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:23.353952 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:23.354144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:23.354323 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] No waiting events found dispatching network-vif-plugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:23.354497 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-19c7d2b1-e0d4-41ca-92ca-2e124666e701 req-71f67526-c9a5-4e01-bf0f-644e0e327215 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received unexpected event network-vif-plugged-daff420e-0782-4f0a-8b29-86782a4461e0 for instance with vm_state building and task_state spawning.
May 28 03:00:23.355499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:23.359480 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:23.360990 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Instance spawned successfully.
May 28 03:00:23.361998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:23.466579 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:23.466921 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937223.4667208, c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:23.467128 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] VM Started (Lifecycle Event)
May 28 03:00:23.652244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:23.657650 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:23.660243 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:23.671837 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:23.706360 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:23.791238 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Successfully updated port: 040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:23.872175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:23.872507 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:23.872711 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:23.873452 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:23.873452 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:23.873657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:23.874003 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:23.973747 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:23.976509 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:24.027789 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-changed-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:24.028144 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Refreshing instance network info cache due to event network-changed-040ef189-c7e3-4481-bc02-9489f226ede8. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:24.028322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] Acquiring lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:24.028447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] Acquired lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:24.028581 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Refreshing network info cache for port 040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:24.059941 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:24.169594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.503s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:24.170159 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:24.173813 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.066s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:24.177717 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:24.177881 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Claim successful on node np0000001589
May 28 03:00:24.219566 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:24.220459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:24.220833 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Creating image(s)
May 28 03:00:24.221301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:24.221512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "/opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:24.221959 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "/opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:24.222475 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:24.225456 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:24.227343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:24.245504 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Updating instance_info_cache with network_info: [{"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:24.297713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:24.318770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:24.319194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:24.319516 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:24.321527 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:24.324125 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:24.324415 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:24.384575 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Took 11.53 seconds to spawn the instance on the hypervisor.
May 28 03:00:24.385041 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:24.394932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:24.395367 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:24.432926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk 1073741824" returned: 0 in 0.036s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:24.433543 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.114s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:24.433960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:24.481126 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:24.481126 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937224.4807365, c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:24.481126 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] VM Paused (Lifecycle Event)
May 28 03:00:24.516166 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:24.517861 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:24.517861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:24.536096 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:24.599615 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:24.600170 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Cannot resize image /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:24.600714 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:24.600714 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Ensure instance console log exists: /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:24.601461 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:24.601461 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:24.601648 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:24.616384 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:24.683270 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:24.683682 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:24.684483 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:24.684717 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:24.750128 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Releasing lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:24.751605 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Instance network_info: |[{"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:24.753511 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Start _get_guest_xml network_info=[{"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T03:00:06Z,direct_url=<?>,disk_format='qcow2',id=69466b9b-b0ce-4ba1-b448-468fe36816a2,min_disk=0,min_ram=0,name='',owner='2eefaac4d2aa4458a3979e7ae46bbf31',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T03:00:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': '69466b9b-b0ce-4ba1-b448-468fe36816a2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:24.756250 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:24.756993 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='69466b9b-b0ce-4ba1-b448-468fe36816a2', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-2114424032', uuid='88beccbb-1cf9-4e42-a123-c82ef83bb03d'), owner=OwnerMeta(userid='b62e58f5c1f0472482d97879c3ed3e71', username='tempest-AttachSCSIVolumeTestJSON-798296180-project-member', projectid='4eb9f22f72444f96b930593adc10e114', projectname='tempest-AttachSCSIVolumeTestJSON-798296180'), image=ImageMeta(id='69466b9b-b0ce-4ba1-b448-468fe36816a2', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937224.7565932) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:24.757989 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:24.758466 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:24.759984 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:24.760159 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:24.761394 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:24.761709 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T03:00:06Z,direct_url=<?>,disk_format='qcow2',id=69466b9b-b0ce-4ba1-b448-468fe36816a2,min_disk=0,min_ram=0,name='',owner='2eefaac4d2aa4458a3979e7ae46bbf31',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T03:00:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:24.761832 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:24.761918 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:24.762033 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:24.762110 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:24.762196 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:24.762388 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:24.762506 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:24.762606 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:24.762703 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:24.762846 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:24.775509 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c775700e4f5c458caf730a3cce6e108f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '581abd74f02944689b3b2c06a6702a09', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:24.780207 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2114424032',display_name='tempest-AttachSCSIVolumeTestJSON-server-2114424032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachscsivolumetestjson-server-2114424032',id=4,image_ref='69466b9b-b0ce-4ba1-b448-468fe36816a2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC30/p54zZEFMHPxz4uNmqN7D63Iq7s94ZWcwJCXrbq2JQg84yrXpZ/jTKZxoL9nwEdZrDGRVewaiVy37/KQbs1FAWtZPhAjpqK+SBRycW4D4pJiz6e/JNUyvuG0wmLPpg==',key_name='tempest-keypair-517161197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4eb9f22f72444f96b930593adc10e114',ramdisk_id='',reservation_id='r-x70kydwz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69466b9b-b0ce-4ba1-b448-468fe36816a2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-798296180',owner_user_name='tempest-AttachSCSIVolumeTestJSON-798296180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b62e58f5c1f0472482d97879c3ed3e71',uuid=88beccbb-1cf9-4e42-a123-c82ef83bb03d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:24.780615 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Converting VIF {"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:24.781283 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a9:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d93c2de-527d-4133-aa4c-fa154c3f3460,network=Network(ea06da8a-e957-431b-8bb1-a6dcb2d0ba04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d93c2de-52') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:24.781953 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lazy-loading 'pci_devices' on Instance uuid 88beccbb-1cf9-4e42-a123-c82ef83bb03d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:24.909052 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Took 18.16 seconds to build instance.
May 28 03:00:24.987103 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:24.988925 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937224.98864, c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:24.989303 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] VM Resumed (Lifecycle Event)
May 28 03:00:25.191202 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:25.255831 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Successfully created port: 1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:25.286250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <uuid>88beccbb-1cf9-4e42-a123-c82ef83bb03d</uuid>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <name>instance-00000004</name>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2114424032</nova:name>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:24</nova:creationTime>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:image uuid="69466b9b-b0ce-4ba1-b448-468fe36816a2">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:user uuid="b62e58f5c1f0472482d97879c3ed3e71">tempest-AttachSCSIVolumeTestJSON-798296180-project-member</nova:user>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:project uuid="4eb9f22f72444f96b930593adc10e114">tempest-AttachSCSIVolumeTestJSON-798296180</nova:project>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="69466b9b-b0ce-4ba1-b448-468fe36816a2"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         <nova:port uuid="7d93c2de-527d-4133-aa4c-fa154c3f3460">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <entry name="serial">88beccbb-1cf9-4e42-a123-c82ef83bb03d</entry>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <entry name="uuid">88beccbb-1cf9-4e42-a123-c82ef83bb03d</entry>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <target dev="sda" bus="scsi"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <address type="drive" controller="0" unit="0"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk.config"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <target dev="sdb" bus="scsi"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <address type="drive" controller="0" unit="1"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d6:a9:dd"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <target dev="tap7d93c2de-52"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/console.log" append="off"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:25.286250 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:25.288749 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Preparing to wait for external event network-vif-plugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:25.288749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:25.288749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:25.288749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:25.288749 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2114424032',display_name='tempest-AttachSCSIVolumeTestJSON-server-2114424032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachscsivolumetestjson-server-2114424032',id=4,image_ref='69466b9b-b0ce-4ba1-b448-468fe36816a2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC30/p54zZEFMHPxz4uNmqN7D63Iq7s94ZWcwJCXrbq2JQg84yrXpZ/jTKZxoL9nwEdZrDGRVewaiVy37/KQbs1FAWtZPhAjpqK+SBRycW4D4pJiz6e/JNUyvuG0wmLPpg==',key_name='tempest-keypair-517161197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4eb9f22f72444f96b930593adc10e114',ramdisk_id='',reservation_id='r-x70kydwz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69466b9b-b0ce-4ba1-b448-468fe36816a2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-798296180',owner_user_name='tempest-AttachSCSIVolumeTestJSON-798296180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b62e58f5c1f0472482d97879c3ed3e71',uuid=88beccbb-1cf9-4e42-a123-c82ef83bb03d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:25.288985 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Converting VIF {"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:25.288985 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a9:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d93c2de-527d-4133-aa4c-fa154c3f3460,network=Network(ea06da8a-e957-431b-8bb1-a6dcb2d0ba04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d93c2de-52') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:25.288985 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a9:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d93c2de-527d-4133-aa4c-fa154c3f3460,network=Network(ea06da8a-e957-431b-8bb1-a6dcb2d0ba04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d93c2de-52') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:25.290700 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:25.290700 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:25.290700 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:25.291878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:25.291878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0696e66a-fdd8-5695-8fa0-dd2c070366b5', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:25.293273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:25.294717 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:25.299928 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:25.299928 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d93c2de-52, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:25.301336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d93c2de-52, col_values=(('qos', UUID('b91df1d9-4d08-4ec7-8da1-892938b4b663')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:25.301517 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d93c2de-52, col_values=(('external_ids', {'iface-id': '7d93c2de-527d-4133-aa4c-fa154c3f3460', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:a9:dd', 'vm-uuid': '88beccbb-1cf9-4e42-a123-c82ef83bb03d'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:25.302436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:25.304548 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:25.313121 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:25.314282 np0000001589 nova-compute[98297]: INFO os_vif [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:a9:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d93c2de-527d-4133-aa4c-fa154c3f3460,network=Network(ea06da8a-e957-431b-8bb1-a6dcb2d0ba04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d93c2de-52')
May 28 03:00:25.360835 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:25.410786 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7bb53544-9386-4c0d-b0bf-53faa4fe0041 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.680s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:25.497435 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:25.502036 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:25.668439 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:25.670057 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:25.696876 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:25.862735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0fc7cf8b-046c-43ae-b7d0-b98916cdb05c req-65d57b21-f0d2-405e-b6ed-4087e2363f57 service nova] Releasing lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:25.863743 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquired lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:25.864275 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:25.878274 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Successfully updated port: 1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:25.935738 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-changed-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:25.935738 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Refreshing instance network info cache due to event network-changed-1710bdaa-b010-4021-80b2-f0e46e701bc6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:25.935738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] Acquiring lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:25.935738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] Acquired lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:25.935738 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Refreshing network info cache for port 1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:26.172046 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:26.380055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:26.438551 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:26.479446 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:26.527980 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:26.653854 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:26.675574 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:26.683032 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.509s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:26.683796 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:26.708674 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:26.714252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:26.714252 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Creating image(s)
May 28 03:00:26.714252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "/opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:26.714252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "/opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:26.714252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "/opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:26.715423 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:26.718486 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:26.719655 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:26.784418 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:26.788246 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:26.788246 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:26.788246 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:26.790141 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:26.791060 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:26.819727 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Updating instance_info_cache with network_info: [{"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:26.843437 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] No BDM found with device name sda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:26.843437 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:26.843437 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] No VIF found with MAC fa:16:3e:d6:a9:dd, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:26.843437 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Using config drive
May 28 03:00:26.865725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.075s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:26.868719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:26.917030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk 1073741824" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:26.917580 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.132s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:26.917992 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:26.993001 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.075s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:26.993557 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:26.993807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:27.078609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:27.079176 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Cannot resize image /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:27.080087 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:27.082120 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Ensure instance console log exists: /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:27.082120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:27.082120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:27.082120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:27.177546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ffc22f8b-6cf5-4c7e-aabc-b605c6d95878 req-6744b552-87dd-4f11-b271-7b5d072e8730 service nova] Releasing lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:27.178029 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquired lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:27.178183 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:27.192139 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:27.192494 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:27.192894 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:27.193238 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:27.217255 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-changed-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:27.217255 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Refreshing instance network info cache due to event network-changed-daff420e-0782-4f0a-8b29-86782a4461e0. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:27.217435 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] Acquiring lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:27.217530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] Acquired lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:27.217673 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Refreshing network info cache for port daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:27.264533 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '425bf68a4c264949818f73750cdddd32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68855494a334878b47ca71a36ff2254', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:27.323238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Releasing lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:27.323552 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Instance network_info: |[{"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:27.325461 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Start _get_guest_xml network_info=[{"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:27.334275 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:27.335344 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-2058676602-1', uuid='ecd114ae-b8cc-4ea8-be10-0c43b8298e85'), owner=OwnerMeta(userid='c775700e4f5c458caf730a3cce6e108f', username='tempest-TestMultiAttachVolumeSwap-715973546-project-member', projectid='581abd74f02944689b3b2c06a6702a09', projectname='tempest-TestMultiAttachVolumeSwap-715973546'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937227.335003) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:27.336486 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:27.336778 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:27.340192 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:27.340398 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:27.341271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:27.341575 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:27.341702 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:27.341790 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:27.341896 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:27.341973 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:27.342079 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:27.342217 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:27.342382 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:27.342554 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:27.342709 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:27.342876 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:27.352931 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:27.367310 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2058676602-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testmultiattachvolumeswap-server-2058676602-1',id=5,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpksUJlAoqEzyHXN1KYsw4hczm/hfmB4B6LUCtzCn66ZIRVNdkLUHZF1RcxgNSE/ExjgEWUWknUj98DmX+4k7p4+koEL4E5Btl8D0eg7WPn1tbDz0bGz1WOd/OOmK6b7Q==',key_name='tempest-keypair-52110820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='581abd74f02944689b3b2c06a6702a09',ramdisk_id='',reservation_id='r-0oc501hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-715973546',owner_user_name='tempest-TestMultiAttachVolumeSwap-715973546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c775700e4f5c458caf730a3cce6e108f',uuid=ecd114ae-b8cc-4ea8-be10-0c43b8298e85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:27.367555 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converting VIF {"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:27.368069 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:20,bridge_name='br-int',has_traffic_filtering=True,id=040ef189-c7e3-4481-bc02-9489f226ede8,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040ef189-c7') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:27.368592 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'pci_devices' on Instance uuid ecd114ae-b8cc-4ea8-be10-0c43b8298e85 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:27.389872 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.502849 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Creating config drive at /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk.config
May 28 03:00:27.506911 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34hf1jq8 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:27.534759 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp34hf1jq8" returned: 0 in 0.028s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:27.699734 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:27.724284 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:27.736070 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Successfully created port: 8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:27.753661 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:27.874191 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <uuid>ecd114ae-b8cc-4ea8-be10-0c43b8298e85</uuid>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <name>instance-00000005</name>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-2058676602-1</nova:name>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:27</nova:creationTime>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:user uuid="c775700e4f5c458caf730a3cce6e108f">tempest-TestMultiAttachVolumeSwap-715973546-project-member</nova:user>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:project uuid="581abd74f02944689b3b2c06a6702a09">tempest-TestMultiAttachVolumeSwap-715973546</nova:project>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         <nova:port uuid="040ef189-c7e3-4481-bc02-9489f226ede8">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <entry name="serial">ecd114ae-b8cc-4ea8-be10-0c43b8298e85</entry>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <entry name="uuid">ecd114ae-b8cc-4ea8-be10-0c43b8298e85</entry>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk.config"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:b9:da:20"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <target dev="tap040ef189-c7"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/console.log" append="off"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:27.874191 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:27.879422 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Preparing to wait for external event network-vif-plugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:27.879422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:27.879422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:27.879422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:27.879422 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2058676602-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testmultiattachvolumeswap-server-2058676602-1',id=5,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpksUJlAoqEzyHXN1KYsw4hczm/hfmB4B6LUCtzCn66ZIRVNdkLUHZF1RcxgNSE/ExjgEWUWknUj98DmX+4k7p4+koEL4E5Btl8D0eg7WPn1tbDz0bGz1WOd/OOmK6b7Q==',key_name='tempest-keypair-52110820',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='581abd74f02944689b3b2c06a6702a09',ramdisk_id='',reservation_id='r-0oc501hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-715973546',owner_user_name='tempest-TestMultiAttachVolumeSwap-715973546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c775700e4f5c458caf730a3cce6e108f',uuid=ecd114ae-b8cc-4ea8-be10-0c43b8298e85,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:27.879742 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converting VIF {"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:27.879742 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:20,bridge_name='br-int',has_traffic_filtering=True,id=040ef189-c7e3-4481-bc02-9489f226ede8,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040ef189-c7') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:27.879742 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:20,bridge_name='br-int',has_traffic_filtering=True,id=040ef189-c7e3-4481-bc02-9489f226ede8,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040ef189-c7') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:27.879742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.879742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:27.879742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:27.882355 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.882580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a2329df-c3f4-5417-b6f6-4e7f45274241', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:27.883840 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.885315 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:27.893152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.897438 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.897557 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap040ef189-c7, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:27.897897 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap040ef189-c7, col_values=(('qos', UUID('49fb84cb-60f6-4c0f-b8dd-9d9defbc79e0')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:27.898932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap040ef189-c7, col_values=(('external_ids', {'iface-id': '040ef189-c7e3-4481-bc02-9489f226ede8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:da:20', 'vm-uuid': 'ecd114ae-b8cc-4ea8-be10-0c43b8298e85'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:27.899196 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.900767 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:27.912474 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:27.912902 np0000001589 nova-compute[98297]: INFO os_vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:da:20,bridge_name='br-int',has_traffic_filtering=True,id=040ef189-c7e3-4481-bc02-9489f226ede8,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040ef189-c7')
May 28 03:00:28.015813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:28.037211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:28.057496 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:28.110740 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:28.192301 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:28.205663 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:28.289328 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Successfully updated port: 8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:28.333683 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updating instance_info_cache with network_info: [{"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:28.346789 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-changed-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:28.348576 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Refreshing instance network info cache due to event network-changed-8c397d0a-9097-46e9-991c-7d50e8ddd286. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:28.348780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] Acquiring lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:28.348899 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] Acquired lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:28.349036 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Refreshing network info cache for port 8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:28.383395 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:28.390988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:28.408579 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:28.416293 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:28.440621 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Updated VIF entry in instance network info cache for port daff420e-0782-4f0a-8b29-86782a4461e0. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:00:28.441472 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Updating instance_info_cache with network_info: [{"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:28.794998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:28.837615 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Releasing lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:28.837955 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Instance network_info: |[{"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:28.840319 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Start _get_guest_xml network_info=[{"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:28.844492 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:28.845970 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-2058676602-2', uuid='1268bec3-55ce-4900-b24f-1cf398ea3b91'), owner=OwnerMeta(userid='c775700e4f5c458caf730a3cce6e108f', username='tempest-TestMultiAttachVolumeSwap-715973546-project-member', projectid='581abd74f02944689b3b2c06a6702a09', projectname='tempest-TestMultiAttachVolumeSwap-715973546'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937228.8455718) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:28.847086 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:28.847497 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:28.848310 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:28.848496 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:28.849507 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:28.849870 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:28.850053 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:28.850158 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:28.850341 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:28.850464 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:28.850583 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:28.850760 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:28.850890 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:28.851025 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:28.851158 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:28.851436 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:28.859424 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:28.868032 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2058676602-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testmultiattachvolumeswap-server-2058676602-2',id=6,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpksUJlAoqEzyHXN1KYsw4hczm/hfmB4B6LUCtzCn66ZIRVNdkLUHZF1RcxgNSE/ExjgEWUWknUj98DmX+4k7p4+koEL4E5Btl8D0eg7WPn1tbDz0bGz1WOd/OOmK6b7Q==',key_name='tempest-keypair-52110820',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='581abd74f02944689b3b2c06a6702a09',ramdisk_id='',reservation_id='r-0oc501hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-715973546',owner_user_name='tempest-TestMultiAttachVolumeSwap-715973546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c775700e4f5c458caf730a3cce6e108f',uuid=1268bec3-55ce-4900-b24f-1cf398ea3b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:28.868305 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converting VIF {"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:28.868869 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=1710bdaa-b010-4021-80b2-f0e46e701bc6,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1710bdaa-b0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:28.869731 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'pci_devices' on Instance uuid 1268bec3-55ce-4900-b24f-1cf398ea3b91 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:28.917581 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937228.9171617, 88beccbb-1cf9-4e42-a123-c82ef83bb03d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:28.917777 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] VM Started (Lifecycle Event)
May 28 03:00:28.943871 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:28.945634 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-74ca8940-2c17-4e02-9875-3a5c58389a1c req-0453e641-a236-48f7-bbdb-b71098a03729 service nova] Releasing lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:29.080963 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:29.218704 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:29.218704 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:29.218704 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Creating image(s)
May 28 03:00:29.218704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "/opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:29.218704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "/opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:29.219243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "/opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:29.219879 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:29.223420 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:29.228419 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:29.285873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.061s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:29.288965 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:29.288965 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:29.288965 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:29.290449 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:29.290849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:29.350191 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:29.354242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:29.374245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <uuid>1268bec3-55ce-4900-b24f-1cf398ea3b91</uuid>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <name>instance-00000006</name>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-2058676602-2</nova:name>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:28</nova:creationTime>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:user uuid="c775700e4f5c458caf730a3cce6e108f">tempest-TestMultiAttachVolumeSwap-715973546-project-member</nova:user>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:project uuid="581abd74f02944689b3b2c06a6702a09">tempest-TestMultiAttachVolumeSwap-715973546</nova:project>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         <nova:port uuid="1710bdaa-b010-4021-80b2-f0e46e701bc6">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <entry name="serial">1268bec3-55ce-4900-b24f-1cf398ea3b91</entry>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <entry name="uuid">1268bec3-55ce-4900-b24f-1cf398ea3b91</entry>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk.config"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:9e:5c:17"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <target dev="tap1710bdaa-b0"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/console.log" append="off"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:29.374245 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:29.378822 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Preparing to wait for external event network-vif-plugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:29.378822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:29.378822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:29.378822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:29.378822 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2058676602-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testmultiattachvolumeswap-server-2058676602-2',id=6,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpksUJlAoqEzyHXN1KYsw4hczm/hfmB4B6LUCtzCn66ZIRVNdkLUHZF1RcxgNSE/ExjgEWUWknUj98DmX+4k7p4+koEL4E5Btl8D0eg7WPn1tbDz0bGz1WOd/OOmK6b7Q==',key_name='tempest-keypair-52110820',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='581abd74f02944689b3b2c06a6702a09',ramdisk_id='',reservation_id='r-0oc501hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-715973546',owner_user_name='tempest-TestMultiAttachVolumeSwap-715973546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c775700e4f5c458caf730a3cce6e108f',uuid=1268bec3-55ce-4900-b24f-1cf398ea3b91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:29.379769 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converting VIF {"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:29.379769 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=1710bdaa-b010-4021-80b2-f0e46e701bc6,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1710bdaa-b0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:29.379769 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=1710bdaa-b010-4021-80b2-f0e46e701bc6,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1710bdaa-b0') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:29.379769 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:29.379769 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:29.379769 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:29.379769 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk 1073741824" returned: 0 in 0.028s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:29.381118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.093s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:29.381118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:29.381479 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:29.381693 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37516e84-2414-5dbc-8eb6-0492e16bba38', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:29.391567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:29.394910 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:29.395195 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1710bdaa-b0, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:29.395741 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1710bdaa-b0, col_values=(('qos', UUID('d05942f9-43c1-404e-bcad-4c7778969317')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:29.395990 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1710bdaa-b0, col_values=(('external_ids', {'iface-id': '1710bdaa-b010-4021-80b2-f0e46e701bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:5c:17', 'vm-uuid': '1268bec3-55ce-4900-b24f-1cf398ea3b91'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:29.396807 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:29.397907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:29.406324 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:29.407525 np0000001589 nova-compute[98297]: INFO os_vif [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=1710bdaa-b010-4021-80b2-f0e46e701bc6,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1710bdaa-b0')
May 28 03:00:29.421095 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:29.422321 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937229.422066, 88beccbb-1cf9-4e42-a123-c82ef83bb03d => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:29.422476 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] VM Paused (Lifecycle Event)
May 28 03:00:29.433173 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:29.433346 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:29.433468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No VIF found with MAC fa:16:3e:b9:da:20, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:29.433919 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Using config drive
May 28 03:00:29.467639 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:29.470026 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:29.470026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:29.538501 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk --force-share --output=json" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:29.538975 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Cannot resize image /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:29.539449 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:29.539680 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Ensure instance console log exists: /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:29.540042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:29.540280 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:29.540475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:29.583013 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3f691478-7d21-4ba1-af2e-97cebf8d4af9 req-a595e84d-9ecc-4043-b038-140015ceb9dd service nova] Releasing lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:29.583581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquired lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:29.583748 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:29.925365 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:29.926570 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:29.939089 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:30.093086 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Creating config drive at /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk.config
May 28 03:00:30.098219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf4e_8vnz {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:30.130304 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf4e_8vnz" returned: 0 in 0.032s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:30.194651 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:30.371113 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:30.429571 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:30.498166 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.604504 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.632753 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.670339 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Updating instance_info_cache with network_info: [{"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:30.739159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.928297 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.929495 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.930775 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.932007 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.932186 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.933061 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:30.933521 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.933691 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:30.934988 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.935307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No VIF found with MAC fa:16:3e:9e:5c:17, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:30.935508 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:00:30.936852 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Using config drive
May 28 03:00:30.938396 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:00:30.958834 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.965062 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.969075 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.989735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:30.999899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.174946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Releasing lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:31.175295 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Instance network_info: |[{"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:31.177098 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Start _get_guest_xml network_info=[{"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:31.179242 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:31.180440 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-397309063', uuid='a20162bb-2296-4592-bd08-ecebb8896d46'), owner=OwnerMeta(userid='425bf68a4c264949818f73750cdddd32', username='tempest-VolumesAssistedSnapshotsTest-1746170207-project-member', projectid='f68855494a334878b47ca71a36ff2254', projectname='tempest-VolumesAssistedSnapshotsTest-1746170207'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937231.1800716) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:31.181663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:31.182116 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:31.183050 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:31.183290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:31.184576 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:31.185055 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:31.185266 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:31.185522 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:31.185587 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:31.185733 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:31.185884 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:31.186128 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:31.186280 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:31.186474 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:31.186898 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:31.186898 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:31.197612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-397309063',display_name='tempest-VolumesAssistedSnapshotsTest-server-397309063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesassistedsnapshotstest-server-397309063',id=7,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj5nPv1+gWsrE2ZvZCI368B/oK0g4L3pmVAxy1jH5YkwYPYv0KtWpkeo+8Ryi9ibR0x9jRZPe+3Plck4ZouCMqEralU3R5+zV6ogL7zSUY5luQ7CHjrjlfQSflvvflnIA==',key_name='tempest-keypair-162895959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f68855494a334878b47ca71a36ff2254',ramdisk_id='',reservation_id='r-v17w4uce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1746170207',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1746170207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='425bf68a4c264949818f73750cdddd32',uuid=a20162bb-2296-4592-bd08-ecebb8896d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:31.197849 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Converting VIF {"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:31.198529 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ea:c3,bridge_name='br-int',has_traffic_filtering=True,id=8c397d0a-9097-46e9-991c-7d50e8ddd286,network=Network(f484a765-5e31-4b76-ad9b-77f04158ed0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c397d0a-90') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:31.199083 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lazy-loading 'pci_devices' on Instance uuid a20162bb-2296-4592-bd08-ecebb8896d46 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:31.442091 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:31.447168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:31.447449 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:31.447620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:31.447832 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:00:31.514034 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937231.5135727, ecd114ae-b8cc-4ea8-be10-0c43b8298e85 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:31.514328 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] VM Started (Lifecycle Event)
May 28 03:00:31.605348 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Creating config drive at /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk.config
May 28 03:00:31.608755 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgetrsr0x {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:31.648406 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgetrsr0x" returned: 0 in 0.039s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:31.704103 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <uuid>a20162bb-2296-4592-bd08-ecebb8896d46</uuid>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <name>instance-00000007</name>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-397309063</nova:name>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:31</nova:creationTime>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:user uuid="425bf68a4c264949818f73750cdddd32">tempest-VolumesAssistedSnapshotsTest-1746170207-project-member</nova:user>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:project uuid="f68855494a334878b47ca71a36ff2254">tempest-VolumesAssistedSnapshotsTest-1746170207</nova:project>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         <nova:port uuid="8c397d0a-9097-46e9-991c-7d50e8ddd286">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <entry name="serial">a20162bb-2296-4592-bd08-ecebb8896d46</entry>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <entry name="uuid">a20162bb-2296-4592-bd08-ecebb8896d46</entry>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk.config"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:5c:ea:c3"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <target dev="tap8c397d0a-90"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/console.log" append="off"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:31.704103 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:31.705752 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Preparing to wait for external event network-vif-plugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:31.705752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:31.705752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:31.705752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:31.707059 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-397309063',display_name='tempest-VolumesAssistedSnapshotsTest-server-397309063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesassistedsnapshotstest-server-397309063',id=7,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj5nPv1+gWsrE2ZvZCI368B/oK0g4L3pmVAxy1jH5YkwYPYv0KtWpkeo+8Ryi9ibR0x9jRZPe+3Plck4ZouCMqEralU3R5+zV6ogL7zSUY5luQ7CHjrjlfQSflvvflnIA==',key_name='tempest-keypair-162895959',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f68855494a334878b47ca71a36ff2254',ramdisk_id='',reservation_id='r-v17w4uce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1746170207',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1746170207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='425bf68a4c264949818f73750cdddd32',uuid=a20162bb-2296-4592-bd08-ecebb8896d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:31.707334 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Converting VIF {"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:31.708338 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ea:c3,bridge_name='br-int',has_traffic_filtering=True,id=8c397d0a-9097-46e9-991c-7d50e8ddd286,network=Network(f484a765-5e31-4b76-ad9b-77f04158ed0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c397d0a-90') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:31.708741 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ea:c3,bridge_name='br-int',has_traffic_filtering=True,id=8c397d0a-9097-46e9-991c-7d50e8ddd286,network=Network(f484a765-5e31-4b76-ad9b-77f04158ed0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c397d0a-90') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:31.709631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.709933 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:31.710268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:31.711030 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.711185 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90ce5243-e960-5f69-a020-c7f288688302', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:31.712686 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.713934 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:31.720898 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.723567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.723764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c397d0a-90, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:31.724138 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c397d0a-90, col_values=(('qos', UUID('b048b89c-117a-49b0-96ee-dab1be338335')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:31.724410 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c397d0a-90, col_values=(('external_ids', {'iface-id': '8c397d0a-9097-46e9-991c-7d50e8ddd286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:ea:c3', 'vm-uuid': 'a20162bb-2296-4592-bd08-ecebb8896d46'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:31.725525 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.728036 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:31.738737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:31.741773 np0000001589 nova-compute[98297]: INFO os_vif [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:ea:c3,bridge_name='br-int',has_traffic_filtering=True,id=8c397d0a-9097-46e9-991c-7d50e8ddd286,network=Network(f484a765-5e31-4b76-ad9b-77f04158ed0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c397d0a-90')
May 28 03:00:31.875523 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-32a57d93-8e0f-40b1-82fc-8869e6653b61 req-5437bd81-bd68-402f-b43d-85a2c29b799c service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:31.875821 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-32a57d93-8e0f-40b1-82fc-8869e6653b61 req-5437bd81-bd68-402f-b43d-85a2c29b799c service nova] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:31.876017 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-32a57d93-8e0f-40b1-82fc-8869e6653b61 req-5437bd81-bd68-402f-b43d-85a2c29b799c service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:31.876097 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-32a57d93-8e0f-40b1-82fc-8869e6653b61 req-5437bd81-bd68-402f-b43d-85a2c29b799c service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:31.876240 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-32a57d93-8e0f-40b1-82fc-8869e6653b61 req-5437bd81-bd68-402f-b43d-85a2c29b799c service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] No event matching network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 in dict_keys([('network-vif-plugged', '7d93c2de-527d-4133-aa4c-fa154c3f3460')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:00:31.876458 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-32a57d93-8e0f-40b1-82fc-8869e6653b61 req-5437bd81-bd68-402f-b43d-85a2c29b799c service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received unexpected event network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 for instance with vm_state building and task_state spawning.
May 28 03:00:32.017165 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:32.023703 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937232.0220654, ecd114ae-b8cc-4ea8-be10-0c43b8298e85 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:32.023703 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] VM Paused (Lifecycle Event)
May 28 03:00:32.132110 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:32.160351 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:32.258203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:32.351839 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:32.370350 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:32.391608 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:32.482859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:32.528471 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:32.531041 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:32.584502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:32.591842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:32.594906 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:32.689470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d1e366ec-b56f-4e1c-b933-1c13ddde2a70 req-c28176d6-bdfe-4f44-bec1-461c99aae1ed service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:32.689470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d1e366ec-b56f-4e1c-b933-1c13ddde2a70 req-c28176d6-bdfe-4f44-bec1-461c99aae1ed service nova] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:32.689470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d1e366ec-b56f-4e1c-b933-1c13ddde2a70 req-c28176d6-bdfe-4f44-bec1-461c99aae1ed service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:32.689470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d1e366ec-b56f-4e1c-b933-1c13ddde2a70 req-c28176d6-bdfe-4f44-bec1-461c99aae1ed service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:32.689470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d1e366ec-b56f-4e1c-b933-1c13ddde2a70 req-c28176d6-bdfe-4f44-bec1-461c99aae1ed service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] No event matching network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 in dict_keys([('network-vif-plugged', 'f50a0eda-06a8-4d7b-a23a-a550ba2406a8')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:00:32.689470 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d1e366ec-b56f-4e1c-b933-1c13ddde2a70 req-c28176d6-bdfe-4f44-bec1-461c99aae1ed service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received unexpected event network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 for instance with vm_state building and task_state spawning.
May 28 03:00:32.697152 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:32.700108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:32.784517 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:32.784604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:32.883681 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:32.888253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:32.931137 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-255fa6d9-01ae-4aa4-8b15-19fbe1210cf0 req-26cb3ac7-0e27-4c44-be6d-e22b0aef801d service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-vif-plugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:32.931872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-255fa6d9-01ae-4aa4-8b15-19fbe1210cf0 req-26cb3ac7-0e27-4c44-be6d-e22b0aef801d service nova] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:32.932568 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-255fa6d9-01ae-4aa4-8b15-19fbe1210cf0 req-26cb3ac7-0e27-4c44-be6d-e22b0aef801d service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:32.932568 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-255fa6d9-01ae-4aa4-8b15-19fbe1210cf0 req-26cb3ac7-0e27-4c44-be6d-e22b0aef801d service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:32.932749 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-255fa6d9-01ae-4aa4-8b15-19fbe1210cf0 req-26cb3ac7-0e27-4c44-be6d-e22b0aef801d service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Processing event network-vif-plugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:32.933281 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:32.938271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:32.939398 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Instance spawned successfully.
May 28 03:00:32.940179 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:32.975785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:32.976638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.038122 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:33.038122 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937233.0367956, ecd114ae-b8cc-4ea8-be10-0c43b8298e85 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:33.038122 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] VM Resumed (Lifecycle Event)
May 28 03:00:33.083533 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.088624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.173938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.175035 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.254161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.256584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.272008 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:33.272569 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:33.273165 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] No VIF found with MAC fa:16:3e:5c:ea:c3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:33.274464 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Using config drive
May 28 03:00:33.334650 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.337597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.406084 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.411335 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.451323 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:33.451938 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:33.453000 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:33.455293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:33.455293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:33.455293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:33.507957 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.509850 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.543499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:33.548592 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:33.603953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.606619 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:33.607461 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.633439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.026s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.633976 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=14494MB free_disk=74.7531623840332GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:00:33.634123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:33.634477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:33.785418 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:33.927078 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Creating config drive at /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk.config
May 28 03:00:33.933435 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8yzcfger {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:33.964886 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Took 9.74 seconds to spawn the instance on the hypervisor.
May 28 03:00:33.965090 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:33.966587 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8yzcfger" returned: 0 in 0.033s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:33.969786 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:33.970157 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:33.970309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:33.970491 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:33.970622 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] No event matching network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 in dict_keys([('network-vif-plugged', '1710bdaa-b010-4021-80b2-f0e46e701bc6')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:00:33.970807 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received unexpected event network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 for instance with vm_state building and task_state spawning.
May 28 03:00:33.971270 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-plugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:33.971490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:33.971829 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:33.972201 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:33.972201 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Processing event network-vif-plugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:33.972201 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-plugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:33.972479 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:33.972504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:33.972605 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:33.972711 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] No waiting events found dispatching network-vif-plugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:33.972821 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received unexpected event network-vif-plugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 for instance with vm_state building and task_state spawning.
May 28 03:00:33.972903 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-plugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:33.978019 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:33.979546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:33.979773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:33.979907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:33.980039 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Processing event network-vif-plugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:33.980189 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-plugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:33.980335 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:33.980633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:33.982073 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:33.982239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:33.982601 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] No waiting events found dispatching network-vif-plugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:33.982732 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8b3fe4bd-05b3-4174-bc79-27b70d6295e1 req-097e4a4f-d278-4dce-bba0-c6b1e64333af service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received unexpected event network-vif-plugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 for instance with vm_state building and task_state spawning.
May 28 03:00:33.988374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:33.989011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:33.994646 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Instance spawned successfully.
May 28 03:00:33.994646 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:33.996362 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Instance spawned successfully.
May 28 03:00:33.996362 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:34.001950 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.002311 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.002747 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.003063 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.056610 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:34.056610 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937234.0548882, 1268bec3-55ce-4900-b24f-1cf398ea3b91 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:34.056610 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] VM Started (Lifecycle Event)
May 28 03:00:34.455809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:34.482087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:34.486997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:34.488309 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Took 16.02 seconds to build instance.
May 28 03:00:34.507540 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.510053 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Took 12.89 seconds to spawn the instance on the hypervisor.
May 28 03:00:34.510386 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.511805 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:34.512536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.513341 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.514781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.520572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:34.563957 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:34.566662 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:34.623662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:34.751264 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c908f979-83fa-417c-a4eb-0b0de669c37b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:00:34.751496 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:00:34.751876 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:00:34.751876 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:00:34.751876 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:00:34.751876 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:00:34.751993 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance a20162bb-2296-4592-bd08-ecebb8896d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:00:34.752146 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:00:34.752310 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:00:33 up 28 min,  2 users,  load average: 5.94, 2.76, 1.37\n', 'num_instances': '7', 'num_vm_building': '6', 'num_task_spawning': '6', 'num_os_type_None': '7', 'num_proj_2c7d1983352f42f79e96d32b0ec160ce': '1', 'io_workload': '6', 'num_proj_5d6cce2ab49640c9aefb1dcadf5b564d': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_proj_4d2ef1b6a03d428d94b2072c01964b49': '1', 'num_proj_4eb9f22f72444f96b930593adc10e114': '1', 'num_proj_581abd74f02944689b3b2c06a6702a09': '2', 'num_proj_f68855494a334878b47ca71a36ff2254': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:00:34.781900 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:34.781900 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:34.782320 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:34.782320 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:34.782320 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] No event matching network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 in dict_keys([('network-vif-plugged', '745d2149-bd89-46b7-9242-edd7a9c4c2d8')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:00:34.782837 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received unexpected event network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 for instance with vm_state building and task_state spawning.
May 28 03:00:34.782837 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-plugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:34.782837 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:34.782837 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:34.782967 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:34.783065 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Processing event network-vif-plugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:34.783170 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-plugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:34.787521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:34.787765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:34.787904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:34.788206 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] No waiting events found dispatching network-vif-plugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:34.788711 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received unexpected event network-vif-plugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 for instance with vm_state building and task_state spawning.
May 28 03:00:34.788861 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-plugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:34.789937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:34.790946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:34.792905 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:34.792905 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Processing event network-vif-plugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:34.793034 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-plugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:34.793190 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:34.793779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:34.793779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:34.793779 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] No waiting events found dispatching network-vif-plugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:34.793779 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d7aca540-9744-4d72-865f-92be5deb6bce req-1c7f47b9-98d7-4d9d-8203-1e7dcecd5252 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received unexpected event network-vif-plugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 for instance with vm_state building and task_state spawning.
May 28 03:00:34.796301 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:34.796301 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Instance event wait completed in 14 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:34.808118 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:34.810806 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:34.818770 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Instance spawned successfully.
May 28 03:00:34.818770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:34.820695 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Instance spawned successfully.
May 28 03:00:34.820695 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:34.997078 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.539s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:34.999248 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:35.002390 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:35.008564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:35.030044 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Took 8.32 seconds to spawn the instance on the hypervisor.
May 28 03:00:35.034971 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:35.036483 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:35.041426 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Took 18.51 seconds to build instance.
May 28 03:00:35.072891 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:35.073295 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937235.0729609, 1268bec3-55ce-4900-b24f-1cf398ea3b91 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:35.073295 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] VM Paused (Lifecycle Event)
May 28 03:00:35.110580 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-61e6f8e9-d4f7-4ffe-aff8-d2262ea889cc req-b6b383af-ff94-4c6c-8bd0-ac8cf96bbb82 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-vif-plugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:35.111414 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-61e6f8e9-d4f7-4ffe-aff8-d2262ea889cc req-b6b383af-ff94-4c6c-8bd0-ac8cf96bbb82 service nova] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:35.111414 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-61e6f8e9-d4f7-4ffe-aff8-d2262ea889cc req-b6b383af-ff94-4c6c-8bd0-ac8cf96bbb82 service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:35.111521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-61e6f8e9-d4f7-4ffe-aff8-d2262ea889cc req-b6b383af-ff94-4c6c-8bd0-ac8cf96bbb82 service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:35.111671 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-61e6f8e9-d4f7-4ffe-aff8-d2262ea889cc req-b6b383af-ff94-4c6c-8bd0-ac8cf96bbb82 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] No waiting events found dispatching network-vif-plugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:35.112279 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-61e6f8e9-d4f7-4ffe-aff8-d2262ea889cc req-b6b383af-ff94-4c6c-8bd0-ac8cf96bbb82 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received unexpected event network-vif-plugged-040ef189-c7e3-4481-bc02-9489f226ede8 for instance with vm_state active and task_state None.
May 28 03:00:35.335710 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.336648 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.337205 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.338035 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.338428 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.338778 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.339151 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.339536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.339969 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.340321 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.344933 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.345113 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:35.349663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:35.349996 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:35.543261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83ccb2bf-9561-46be-8de7-bc03cfbf379b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.016s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:35.556147 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Took 17.04 seconds to build instance.
May 28 03:00:35.584536 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:35.588195 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937235.5870945, 88beccbb-1cf9-4e42-a123-c82ef83bb03d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:35.588507 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] VM Resumed (Lifecycle Event)
May 28 03:00:35.848875 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Took 25.27 seconds to spawn the instance on the hypervisor.
May 28 03:00:35.848996 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:35.850050 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Took 29.00 seconds to spawn the instance on the hypervisor.
May 28 03:00:35.850163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:35.855241 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:36.057489 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.567s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:36.092936 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:36.094173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:36.367157 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:00:36.367157 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.732s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:36.367686 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 58.20 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:00:36.368236 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Took 30.67 seconds to build instance.
May 28 03:00:36.375155 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Took 34.31 seconds to build instance.
May 28 03:00:36.598262 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937236.5978854, 1268bec3-55ce-4900-b24f-1cf398ea3b91 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:36.598531 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] VM Resumed (Lifecycle Event)
May 28 03:00:36.728379 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:36.874361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e7d0dbdd-3bea-46df-983c-63c00660ef60 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.188s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:36.877724 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec3b3eef-aada-422c-aa0a-2b4d9b41bc19 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.825s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:36.921986 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-changed-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:36.922187 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Refreshing instance network info cache due to event network-changed-7d93c2de-527d-4133-aa4c-fa154c3f3460. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:36.922451 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] Acquiring lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:36.922556 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] Acquired lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:36.922778 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Refreshing network info cache for port 7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:36.990202 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:37.101985 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:37.106249 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:37.394532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:37.431874 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:37.611614 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937237.6105788, c908f979-83fa-417c-a4eb-0b0de669c37b => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:37.611614 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] VM Resumed (Lifecycle Event)
May 28 03:00:37.993263 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:38.114251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:38.116559 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:38.216843 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Updated VIF entry in instance network info cache for port 7d93c2de-527d-4133-aa4c-fa154c3f3460. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:00:38.217128 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Updating instance_info_cache with network_info: [{"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:38.311737 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:38.311985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:38.619551 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937238.6191905, 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:38.619712 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] VM Resumed (Lifecycle Event)
May 28 03:00:38.654707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:38.655430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:38.718977 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-675383bd-5035-4770-9a88-8f0c6531a612 req-f38884be-1425-4c5e-bb95-de82e9f10a23 service nova] Releasing lock "refresh_cache-88beccbb-1cf9-4e42-a123-c82ef83bb03d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:38.818169 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:39.045484 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-changed-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:39.046009 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Refreshing instance network info cache due to event network-changed-1710bdaa-b010-4021-80b2-f0e46e701bc6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:39.046195 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] Acquiring lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:39.046334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] Acquired lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:39.046489 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Refreshing network info cache for port 1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:39.122455 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:39.127262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:39.160108 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lazy-loading 'flavor' on Instance uuid 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:39.250603 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:39.396194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:39.396463 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:39.402887 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:39.403051 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Claim successful on node np0000001589
May 28 03:00:39.550892 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:39.630347 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937239.6299684, a20162bb-2296-4592-bd08-ecebb8896d46 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:39.630668 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] VM Started (Lifecycle Event)
May 28 03:00:39.974289 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fdf3756f-31be-493a-b7da-85743db57bf9 req-dfbbf67f-fc77-4b25-a25b-b97b410f234d service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-vif-plugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:39.974583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fdf3756f-31be-493a-b7da-85743db57bf9 req-dfbbf67f-fc77-4b25-a25b-b97b410f234d service nova] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:39.974779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fdf3756f-31be-493a-b7da-85743db57bf9 req-dfbbf67f-fc77-4b25-a25b-b97b410f234d service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:39.974779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fdf3756f-31be-493a-b7da-85743db57bf9 req-dfbbf67f-fc77-4b25-a25b-b97b410f234d service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:39.974896 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fdf3756f-31be-493a-b7da-85743db57bf9 req-dfbbf67f-fc77-4b25-a25b-b97b410f234d service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Processing event network-vif-plugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:39.975334 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:39.982495 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:39.988665 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Instance spawned successfully.
May 28 03:00:39.989039 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:40.133923 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:40.136067 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:40.169911 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:40.292663 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:40.459457 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updated VIF entry in instance network info cache for port 1710bdaa-b010-4021-80b2-f0e46e701bc6. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:00:40.461618 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updating instance_info_cache with network_info: [{"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:40.499082 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:40.499238 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:40.499535 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:40.499775 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:40.499985 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:40.500199 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:40.640058 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:40.640432 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937240.6401365, a20162bb-2296-4592-bd08-ecebb8896d46 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:40.640704 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] VM Paused (Lifecycle Event)
May 28 03:00:40.966793 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9850dd69-c0f2-45d8-8a4e-d5f857876f05 req-643778d3-4d0b-47fc-a659-61598047d6a8 service nova] Releasing lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:41.007064 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Took 11.79 seconds to spawn the instance on the hypervisor.
May 28 03:00:41.007156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:41.059358 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:41.059786 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:41.145630 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:41.148193 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937241.1479182, a20162bb-2296-4592-bd08-ecebb8896d46 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:41.148742 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] VM Resumed (Lifecycle Event)
May 28 03:00:41.522779 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Took 20.50 seconds to build instance.
May 28 03:00:41.564999 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:41.652282 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:41.654674 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:41.727876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:41.849340 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:41.849520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:41.850083 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Attaching volume 6d64995a-1760-48b9-b4e2-a04833bfc863 to /dev/vdb
May 28 03:00:41.909016 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:00:41.910066 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpvk57oq6j/privsep.sock']
May 28 03:00:41.920562 np0000001589 sudo[110722]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpvk57oq6j/privsep.sock
May 28 03:00:41.921448 np0000001589 sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 28 03:00:42.025458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.013s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:42.041220 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c384c65-010d-474e-b75b-233ee24388ec req-1dd1f0f1-4fe9-458a-b00a-82e5852313cb service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-vif-plugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:42.041812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c384c65-010d-474e-b75b-233ee24388ec req-1dd1f0f1-4fe9-458a-b00a-82e5852313cb service nova] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:42.041812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c384c65-010d-474e-b75b-233ee24388ec req-1dd1f0f1-4fe9-458a-b00a-82e5852313cb service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:42.043601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c384c65-010d-474e-b75b-233ee24388ec req-1dd1f0f1-4fe9-458a-b00a-82e5852313cb service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:42.043758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c384c65-010d-474e-b75b-233ee24388ec req-1dd1f0f1-4fe9-458a-b00a-82e5852313cb service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] No waiting events found dispatching network-vif-plugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:42.043909 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-3c384c65-010d-474e-b75b-233ee24388ec req-1dd1f0f1-4fe9-458a-b00a-82e5852313cb service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received unexpected event network-vif-plugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 for instance with vm_state active and task_state None.
May 28 03:00:42.075055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.678s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:42.075543 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:42.252317 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:42.252800 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 28 03:00:42.398891 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:42.578571 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 28 03:00:42.578571 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 28 03:00:42.580343 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 28 03:00:42.580343 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:42.580343 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 28 03:00:42.580343 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 28 03:00:42.580343 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 28 03:00:42.580343 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log: 
May 28 03:00:42.580505 np0000001589 nova-compute[98297]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 28 03:00:42.583195 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:42.583195 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:42.583553 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:42.583865 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:42.726069 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac0cdcec6a84b5da3545699090a9ea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c7d1983352f42f79e96d32b0ec160ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:42.870433 np0000001589 sudo[110722]: pam_unix(sudo:session): session closed for user root
May 28 03:00:42.872102 np0000001589 nova-compute[98297]: INFO oslo.privsep.daemon [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Spawned new privsep daemon via rootwrap
May 28 03:00:43.029214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:00:43.032823 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.nvmeof [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 28 03:00:43.049985 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:43.070601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:43.096563 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:43.106135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:00:43.107589 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:00:43.124988 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:00:43.128772 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feba:e9d2', 'fe80::fc16:3eff:fe9c:8a9a', 'fe80::fc16:3eff:fed6:5beb', 'fe80::ea:5ff:fee4:7af1', 'fe80::240f:80ff:fe0f:54c', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fed6:a9dd', 'fe80::8ca6:c7ff:fe8d:24c8', 'fe80::fc16:3eff:feb9:da20', 'fe80::14c4:11ff:fe78:2b43', 'fe80::fc16:3eff:fe9e:5c17', 'fe80::fc16:3eff:fe5c:eac3', 'fe80::f80d:d1ff:fe06:d44d'] 
May 28 03:00:43.128967 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:00:43.130346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:00:43.130685 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] <== get_connector_properties: return (1221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:00:43.130910 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Updating existing volume attachment record: 1254a19c-7249-420c-801f-cec409dd5a59 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:00:43.382784 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Successfully created port: 3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:43.395168 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-changed-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:43.397558 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Refreshing instance network info cache due to event network-changed-8c397d0a-9097-46e9-991c-7d50e8ddd286. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:43.397807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] Acquiring lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:43.397916 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] Acquired lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:43.400404 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Refreshing network info cache for port 8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:43.609852 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:43.776165 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:43.777121 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:43.779608 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connector [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Factory for ISCSI on None {{(pid=98297) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 28 03:00:43.781770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:43.781770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:00:43.781770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d64995a-1760-48b9-b4e2-a04833bfc863', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:00:43.781770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:00:43.781770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:00:43.782493 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d64995a-1760-48b9-b4e2-a04833bfc863', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:00:43.801141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:00:43.802557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:00:43.803036 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:00:43.803352 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:00:43.803814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:00:43.804280 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:00:43.822903 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:00:43.822903 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:43.824319 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:00:43.824319 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:43.846809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863] added
May 28 03:00:43.846809 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:00:43.846809 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:00:43.846809 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:00:43.846809 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:00:43.846809 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:00:43.846809 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:43.847519 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:00:43.847861 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0437(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:00:43.848143 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:00:43.849004 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863] added
May 28 03:00:43.849004 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:00:43.849004 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:00:43.849004 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:00:43.849004 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:00:43.849004 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:00:43.849004 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:43.849555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:00:43.850065 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0465(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:00:43.850343 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:00:43.902990 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:43.999939 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Successfully updated port: 3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:44.165470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-changed-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:44.165948 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Refreshing instance network info cache due to event network-changed-3547c69d-3837-4afd-b1d2-032071a97842. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:44.166809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] Acquiring lock "refresh_cache-1adb131e-325c-471f-ba43-9647f6a306e5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:44.166809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] Acquired lock "refresh_cache-1adb131e-325c-471f-ba43-9647f6a306e5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:44.167464 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Refreshing network info cache for port 3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:44.429737 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:44.504401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "refresh_cache-1adb131e-325c-471f-ba43-9647f6a306e5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:44.619994 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Updated VIF entry in instance network info cache for port 8c397d0a-9097-46e9-991c-7d50e8ddd286. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:00:44.621860 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Updating instance_info_cache with network_info: [{"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:44.623209 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:44.624393 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:44.624603 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Creating image(s)
May 28 03:00:44.625030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "/opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:44.625158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "/opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:44.625629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "/opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:44.626999 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:44.630371 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:44.631650 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:44.672332 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:44.749083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.117s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:44.749638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:44.750389 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:44.752293 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:44.755525 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:44.756612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:44.817793 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:44.848705 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:00:44.850710 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:00:44.861529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:44.861972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:00:44.879968 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:00:44.879968 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:00:44.883534 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:00:44.883534 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:44.899185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:44.904628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:44.908470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk 1073741824" returned: 0 in 0.046s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:44.909416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:44.909416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:44.923117 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:00:44.923117 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:00:44.923636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:00:44.923636 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:00:44.923718 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:00:44.923718 np0000001589 nova-compute[98297]: 
May 28 03:00:44.926132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:00:44.926132 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:00:44.929124 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:00:44.929124 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:00:44.929399 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:00:44.929399 np0000001589 nova-compute[98297]: 
May 28 03:00:44.998387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:44.998817 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:44.999096 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:45.086488 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:45.088998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:45.089776 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Cannot resize image /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:45.090242 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:45.090497 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Ensure instance console log exists: /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:45.090847 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:45.091145 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:45.091376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:45.126602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4282971e-f181-4b93-9467-4fe75251d9c0 req-3139c1de-d37a-4240-8359-9039c215b412 service nova] Releasing lock "refresh_cache-a20162bb-2296-4592-bd08-ecebb8896d46" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:45.590158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc0168e2-781d-4c98-8687-53d2dc145efd req-de9af266-e9dc-4584-b5d1-3fbb0b0f9f16 service nova] Releasing lock "refresh_cache-1adb131e-325c-471f-ba43-9647f6a306e5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:45.590665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquired lock "refresh_cache-1adb131e-325c-471f-ba43-9647f6a306e5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:45.590665 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:45.988634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.50.100,3260]
May 28 03:00:45.988634 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.50.100,3260] successful.
May 28 03:00:45.988634 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:45.989761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.40.100,3260]
May 28 03:00:45.989761 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.40.100,3260] successful.
May 28 03:00:45.989761 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:46.000829 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:46.012897 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:46.020461 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.020461 np0000001589 nova-compute[98297]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.020461 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:00:46.020461 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.020461 np0000001589 nova-compute[98297]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.020461 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:00:46.021196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.217s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:00:46.022317 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:00:46.022716 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] HCTL ('7', '-', '-', 0) found on session 1 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:00:46.022913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:00:46.027754 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.027754 np0000001589 nova-compute[98297]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.027754 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:00:46.027880 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.027880 np0000001589 nova-compute[98297]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:46.027880 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:00:46.028152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.225s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:00:46.028306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:00:46.028786 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] HCTL ('8', '-', '-', 0) found on session 2 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:00:46.028912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:00:46.053216 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Searching for a device in session 1 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:00:46.053216 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6d64995a-1760-48b9-b4e2-a04833bfc863', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:00:46.056804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Searching for a device in session 2 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:00:46.056995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d64995a-1760-48b9-b4e2-a04833bfc863', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:00:46.128726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:46.128980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:46.189564 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:46.440816 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:46.632645 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:00:46.641168 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Updating instance_info_cache with network_info: [{"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:46.730256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:46.805317 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:00:47.146896 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Releasing lock "refresh_cache-1adb131e-325c-471f-ba43-9647f6a306e5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:47.147131 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Instance network_info: |[{"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:47.148742 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Start _get_guest_xml network_info=[{"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:47.151220 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:47.152868 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-12572953', uuid='1adb131e-325c-471f-ba43-9647f6a306e5'), owner=OwnerMeta(userid='9ac0cdcec6a84b5da3545699090a9ea0', username='tempest-ServersNegativeTestJSON-612301624-project-member', projectid='2c7d1983352f42f79e96d32b0ec160ce', projectname='tempest-ServersNegativeTestJSON-612301624'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937247.1523805) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:47.154293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:47.155380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:47.156628 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:47.156628 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:47.157878 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:47.158830 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:47.159111 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:47.159548 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:47.159548 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:47.159548 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:47.159689 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:47.159971 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:47.160333 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:47.160886 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:47.161409 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:47.161872 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:47.181743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-12572953',display_name='tempest-ServersNegativeTestJSON-server-12572953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serversnegativetestjson-server-12572953',id=8,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7d1983352f42f79e96d32b0ec160ce',ramdisk_id='',reservation_id='r-0vhpv3mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-612301624',owner_user_name='tempest-ServersNegativeTestJSON-612301624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:44Z,user_data=None,user_id='9ac0cdcec6a84b5da3545699090a9ea0',uuid=1adb131e-325c-471f-ba43-9647f6a306e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:47.182056 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converting VIF {"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:47.182999 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=3547c69d-3837-4afd-b1d2-032071a97842,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547c69d-38') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:47.183807 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lazy-loading 'pci_devices' on Instance uuid 1adb131e-325c-471f-ba43-9647f6a306e5 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:47.222744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:47.223046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:47.228118 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:00:47.228398 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Claim successful on node np0000001589
May 28 03:00:47.404445 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.689620 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <uuid>1adb131e-325c-471f-ba43-9647f6a306e5</uuid>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <name>instance-00000008</name>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServersNegativeTestJSON-server-12572953</nova:name>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:47</nova:creationTime>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:user uuid="9ac0cdcec6a84b5da3545699090a9ea0">tempest-ServersNegativeTestJSON-612301624-project-member</nova:user>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:project uuid="2c7d1983352f42f79e96d32b0ec160ce">tempest-ServersNegativeTestJSON-612301624</nova:project>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         <nova:port uuid="3547c69d-3837-4afd-b1d2-032071a97842">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <entry name="serial">1adb131e-325c-471f-ba43-9647f6a306e5</entry>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <entry name="uuid">1adb131e-325c-471f-ba43-9647f6a306e5</entry>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk.config"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:97:f8:40"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <target dev="tap3547c69d-38"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/console.log" append="off"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:47.689620 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:47.691864 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Preparing to wait for external event network-vif-plugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:47.691864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:47.691864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:47.691864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:47.692712 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-12572953',display_name='tempest-ServersNegativeTestJSON-server-12572953',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serversnegativetestjson-server-12572953',id=8,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c7d1983352f42f79e96d32b0ec160ce',ramdisk_id='',reservation_id='r-0vhpv3mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-612301624',owner_user_name='tempest-ServersNegativeTestJSON-612301624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:44Z,user_data=None,user_id='9ac0cdcec6a84b5da3545699090a9ea0',uuid=1adb131e-325c-471f-ba43-9647f6a306e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:47.693053 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converting VIF {"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:47.693766 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=3547c69d-3837-4afd-b1d2-032071a97842,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547c69d-38') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:47.694687 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=3547c69d-3837-4afd-b1d2-032071a97842,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547c69d-38') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:47.695447 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.695735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:47.696030 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:47.697605 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.697605 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1917c4e-f1a8-5c6d-bc62-d07273a60211', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:47.699459 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.700426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:47.701732 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.706123 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.709478 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3547c69d-38, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:47.709959 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3547c69d-38, col_values=(('qos', UUID('80a8e1c6-161f-428d-b273-5dc74acfd232')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:47.710194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3547c69d-38, col_values=(('external_ids', {'iface-id': '3547c69d-3837-4afd-b1d2-032071a97842', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:f8:40', 'vm-uuid': '1adb131e-325c-471f-ba43-9647f6a306e5'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:47.711285 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.712937 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:47.719871 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:47.720501 np0000001589 nova-compute[98297]: INFO os_vif [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=3547c69d-3837-4afd-b1d2-032071a97842,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547c69d-38')
May 28 03:00:47.823936 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Found WWN 330000000071be818 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:00:47.824233 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.043s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:00:47.824420 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] <== connect_volume: return (4043ms) {'type': 'block', 'scsi_wwn': '330000000071be818', 'path': '/dev/dm-0', 'multipath_id': '330000000071be818'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:00:47.824535 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000071be818', 'path': '/dev/dm-0', 'multipath_id': '330000000071be818'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:00:47.826512 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lazy-loading 'flavor' on Instance uuid 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:48.329080 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Attempting to attach volume 6d64995a-1760-48b9-b4e2-a04833bfc863 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:00:48.329997 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:00:48.329997 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:00:48.329997 np0000001589 nova-compute[98297]:   <alias name="ua-6d64995a-1760-48b9-b4e2-a04833bfc863"/>
May 28 03:00:48.329997 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:00:48.329997 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:00:48.329997 np0000001589 nova-compute[98297]:   <serial>6d64995a-1760-48b9-b4e2-a04833bfc863</serial>
May 28 03:00:48.329997 np0000001589 nova-compute[98297]: </disk>
May 28 03:00:48.329997 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:00:48.804805 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:48.805537 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:49.248929 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:49.248929 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:49.248929 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] No VIF found with MAC fa:16:3e:97:f8:40, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:49.248929 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Using config drive
May 28 03:00:49.308288 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:49.754406 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:49.818323 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.595s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:49.818768 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:00:49.889874 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Creating config drive at /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk.config
May 28 03:00:49.893609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9r8m82d9 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:49.938066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9r8m82d9" returned: 0 in 0.043s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:50.012543 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:50.012679 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:50.012754 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:50.012985 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] No VIF found with MAC fa:16:3e:9c:8a:9a, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:50.327287 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:00:50.327287 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:00:50.330041 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:50.330041 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:50.423558 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:50.456525 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0546cf4892194fb0b81f60e06176325e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c603cee4ca4e5e8665159f4cd59021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:00:50.459606 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:50.585068 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:50.698212 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:50.798528 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-40116caf-906c-4bc6-b114-a8faeb5ed29c req-73d6eba5-da63-4eaa-a2b2-0df871f71c41 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-vif-plugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:50.802175 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-40116caf-906c-4bc6-b114-a8faeb5ed29c req-73d6eba5-da63-4eaa-a2b2-0df871f71c41 service nova] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:50.802175 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-40116caf-906c-4bc6-b114-a8faeb5ed29c req-73d6eba5-da63-4eaa-a2b2-0df871f71c41 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:50.802175 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-40116caf-906c-4bc6-b114-a8faeb5ed29c req-73d6eba5-da63-4eaa-a2b2-0df871f71c41 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:50.802536 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-40116caf-906c-4bc6-b114-a8faeb5ed29c req-73d6eba5-da63-4eaa-a2b2-0df871f71c41 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Processing event network-vif-plugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:50.833263 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:00:51.336966 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:00:51.525336 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Successfully created port: aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:00:51.614684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dc40483-3fe5-42ba-ba50-ff33579b0432 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.765s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:51.618304 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937251.6178815, 1adb131e-325c-471f-ba43-9647f6a306e5 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:51.618501 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] VM Started (Lifecycle Event)
May 28 03:00:51.620174 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:51.625123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:51.627424 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Instance spawned successfully.
May 28 03:00:51.628831 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:51.927133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:51.927133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:51.927133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:51.927133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:51.927133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:51.934344 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Terminating instance
May 28 03:00:52.124092 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:52.133264 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:52.144871 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:52.144871 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:52.144871 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:52.144982 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:52.147296 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:52.147296 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:52.218378 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Successfully updated port: aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:00:52.309363 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-changed-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:52.309363 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Refreshing instance network info cache due to event network-changed-aefcb3f3-4513-4238-8126-bff01f489cf6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:00:52.309363 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] Acquiring lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:52.309363 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] Acquired lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:52.309363 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Refreshing network info cache for port aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:00:52.355204 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:00:52.356797 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:00:52.358532 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Creating image(s)
May 28 03:00:52.358998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:52.359184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:52.362424 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:52.367413 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:52.371101 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:52.373188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:52.408915 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:52.440963 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:00:52.450454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.077s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:52.450454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:52.450739 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:52.451041 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:52.454442 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:00:52.457193 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:52.481713 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:52.500913 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:52.534518 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:52.561979 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:52.569798 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.115s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:52.572311 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:52.633365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk 1073741824" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:52.633365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:52.633365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:52.650066 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:00:52.650066 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937252.6487055, 1adb131e-325c-471f-ba43-9647f6a306e5 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:52.650066 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] VM Paused (Lifecycle Event)
May 28 03:00:52.656616 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Took 8.03 seconds to spawn the instance on the hypervisor.
May 28 03:00:52.657638 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:52.713148 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:52.722215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:00:52.743688 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.112s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:52.744093 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:00:52.745263 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:52.817787 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:52.834887 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Instance destroyed successfully.
May 28 03:00:52.835977 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lazy-loading 'resources' on Instance uuid 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:52.857495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:52.857865 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Cannot resize image /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:00:52.858592 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:00:52.859438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Ensure instance console log exists: /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:00:52.860415 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:52.860556 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:52.860690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:52.933590 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-105189be-c032-4be8-9db1-fd51bae27441 req-2f325fa9-bd2b-449b-a6be-9d300362c969 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-vif-plugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:52.934082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-105189be-c032-4be8-9db1-fd51bae27441 req-2f325fa9-bd2b-449b-a6be-9d300362c969 service nova] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:52.934433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-105189be-c032-4be8-9db1-fd51bae27441 req-2f325fa9-bd2b-449b-a6be-9d300362c969 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:52.934433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-105189be-c032-4be8-9db1-fd51bae27441 req-2f325fa9-bd2b-449b-a6be-9d300362c969 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:52.934777 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-105189be-c032-4be8-9db1-fd51bae27441 req-2f325fa9-bd2b-449b-a6be-9d300362c969 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] No waiting events found dispatching network-vif-plugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:52.934777 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-105189be-c032-4be8-9db1-fd51bae27441 req-2f325fa9-bd2b-449b-a6be-9d300362c969 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received unexpected event network-vif-plugged-3547c69d-3837-4afd-b1d2-032071a97842 for instance with vm_state active and task_state None.
May 28 03:00:52.990211 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:53.159094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:53.164524 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937253.1626315, 1adb131e-325c-471f-ba43-9647f6a306e5 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:53.164524 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] VM Resumed (Lifecycle Event)
May 28 03:00:53.171309 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Took 13.84 seconds to build instance.
May 28 03:00:53.176460 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:53.342628 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1217717904',display_name='tempest-DeleteServersTestJSON-server-1217717904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-deleteserverstestjson-server-1217717904',id=2,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:00:35Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5d6cce2ab49640c9aefb1dcadf5b564d',ramdisk_id='',reservation_id='r-91bdc42h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1397080245',owner_user_name='tempest-DeleteServersTestJSON-1397080245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:36Z,user_data=None,user_id='6a458f7278e04c8994d4e5c7e58cb965',uuid=1db1431d-de49-4ad1-ab4a-d05e1e8ed591,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:00:53.342938 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Converting VIF {"id": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "address": "fa:16:3e:9c:8a:9a", "network": {"id": "fb71751d-c3b4-4b56-a5f3-5367924eb0a4", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1429319268-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "5d6cce2ab49640c9aefb1dcadf5b564d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap745d2149-bd", "ovs_interfaceid": "745d2149-bd89-46b7-9242-edd7a9c4c2d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:53.345356 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:9a,bridge_name='br-int',has_traffic_filtering=True,id=745d2149-bd89-46b7-9242-edd7a9c4c2d8,network=Network(fb71751d-c3b4-4b56-a5f3-5367924eb0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745d2149-bd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:53.345356 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:9a,bridge_name='br-int',has_traffic_filtering=True,id=745d2149-bd89-46b7-9242-edd7a9c4c2d8,network=Network(fb71751d-c3b4-4b56-a5f3-5367924eb0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745d2149-bd') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:00:53.346839 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:53.347214 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap745d2149-bd, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:53.351211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:53.352204 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:53.352490 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce5bdf86-56bf-4c88-a6da-93eb70b14548) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:53.354187 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:53.356332 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:53.357700 np0000001589 nova-compute[98297]: INFO os_vif [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:8a:9a,bridge_name='br-int',has_traffic_filtering=True,id=745d2149-bd89-46b7-9242-edd7a9c4c2d8,network=Network(fb71751d-c3b4-4b56-a5f3-5367924eb0a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap745d2149-bd')
May 28 03:00:53.358806 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:00:53.359189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d64995a-1760-48b9-b4e2-a04833bfc863', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:00:53.359387 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:00:53.359810 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:00:53.360150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6d64995a-1760-48b9-b4e2-a04833bfc863', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:00:53.360350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:00:53.390848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:53.390848 np0000001589 nova-compute[98297]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:53.390848 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:00:53.391041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsi session list stdout=tcp: [1] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:53.391041 np0000001589 nova-compute[98297]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863 (non-flash)
May 28 03:00:53.391041 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:00:53.391141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', '1'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', '2')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:00:53.391325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', '2')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:00:53.392630 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863', '1')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:00:53.393409 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646d2a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:00:53.393635 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:00:53.393881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Flush multipath device 330000000071be818 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:00:53.423463 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:00:53.464816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:00:53.505338 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:00:53.505498 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:00:53.507127 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:00:53.520269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:00:53.520269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:00:53.533752 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:53.564907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.40.100,3260]
May 28 03:00:53.564907 np0000001589 nova-compute[98297]: Logout of [sid: 2, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.40.100,3260] successful.
May 28 03:00:53.564907 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:53.582717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:53.594692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:53.622840 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.50.100,3260]
May 28 03:00:53.622840 np0000001589 nova-compute[98297]: Logout of [sid: 1, target: iqn.2023-03.storpool.com:os--volume-6d64995a-1760-48b9-b4e2-a04833bfc863, portal: 192.168.50.100,3260] successful.
May 28 03:00:53.622840 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:53.635591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:00:53.635868 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:00:53.635985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] <== disconnect_volume: return (276ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:00:53.636323 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:00:53.636617 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Deleting instance files /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591_del
May 28 03:00:53.637278 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Deletion of /opt/stack/data/nova/instances/1db1431d-de49-4ad1-ab4a-d05e1e8ed591_del complete
May 28 03:00:53.666451 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:53.669601 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:53.672337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ddfdb084-f112-4d04-b951-48191cffafa7 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.360s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:53.682529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ca00d2d-3313-4f4e-94c6-3c8456202b7b req-e29fea9f-d520-4722-9e08-61e829bc1ded service nova] Releasing lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:53.682529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquired lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:00:53.682529 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:00:53.933317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:53.933317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:53.933537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:53.933657 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:53.934208 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:53.937434 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Terminating instance
May 28 03:00:54.149810 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Took 1.71 seconds to destroy the instance on the hypervisor.
May 28 03:00:54.151017 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:00:54.152831 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:00:54.152831 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:00:54.153585 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:54.174755 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 03:00:54.176435 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999588967000136 future=<Future at 0x7e4b7815bce0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:00:54.176435 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999157016000026 future=<Future at 0x7e4b7815bce0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:00:54.176435 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998949832000108 future=<Future at 0x7e4b7815bce0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:00:54.296406 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:54.311262 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:00:54.391964 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:54.394901 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:54.394901 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:54.395082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:54.395082 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] No waiting events found dispatching network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:54.395254 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:00:54.395254 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:54.395392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] Acquiring lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:54.395509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:54.395597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:54.395709 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] No waiting events found dispatching network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:54.395808 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1cba15bf-d614-4865-9901-d7b69d30de13 req-d9a91952-e827-4598-a2a3-664f333055f3 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-unplugged-745d2149-bd89-46b7-9242-edd7a9c4c2d8 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:00:54.441128 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:00:54.465712 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:54.469939 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:54.491420 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:54.519212 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:54.671270 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:54.677970 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:54.778695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:54.788892 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:54.795428 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:54.811907 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99972750400002 future=<Future at 0x7e4b64484530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:00:54.814835 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Instance destroyed successfully.
May 28 03:00:54.815336 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lazy-loading 'resources' on Instance uuid 1adb131e-325c-471f-ba43-9647f6a306e5 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:55.013178 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-vif-unplugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:55.013544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:55.013710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:55.013710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:55.013846 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] No waiting events found dispatching network-vif-unplugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:55.013977 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-vif-unplugged-3547c69d-3837-4afd-b1d2-032071a97842 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:00:55.015396 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-vif-unplugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:55.015396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] Acquiring lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:55.015396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:55.015396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] Lock "1adb131e-325c-471f-ba43-9647f6a306e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:55.015396 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] No waiting events found dispatching network-vif-unplugged-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:55.015396 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8fe24f9-42ee-4cfc-8d46-fdbe0a9876f6 req-2ba822cd-e631-4066-9878-5c7b34a11d49 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-vif-unplugged-3547c69d-3837-4afd-b1d2-032071a97842 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:00:55.094484 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-573cdce8-8b1e-4446-b9db-1c6e59261eed req-b1f6a52e-b24d-49da-a49e-31492c255795 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Received event network-vif-deleted-745d2149-bd89-46b7-9242-edd7a9c4c2d8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:55.094484 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-573cdce8-8b1e-4446-b9db-1c6e59261eed req-b1f6a52e-b24d-49da-a49e-31492c255795 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Neutron deleted interface 745d2149-bd89-46b7-9242-edd7a9c4c2d8; detaching it from the instance and deleting it from the info cache
May 28 03:00:55.096075 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-573cdce8-8b1e-4446-b9db-1c6e59261eed req-b1f6a52e-b24d-49da-a49e-31492c255795 service nova] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Detach interface failed, port_id=745d2149-bd89-46b7-9242-edd7a9c4c2d8, reason: Instance 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:00:55.292211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Releasing lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:00:55.292211 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Instance network_info: |[{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:00:55.293811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Start _get_guest_xml network_info=[{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:00:55.295624 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:00:55.296783 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2072436584', uuid='f4651248-73c3-435e-842a-3858d6eb74ae'), owner=OwnerMeta(userid='0546cf4892194fb0b81f60e06176325e', username='tempest-TaggedAttachmentsTest-1991660198-project-member', projectid='55c603cee4ca4e5e8665159f4cd59021', projectname='tempest-TaggedAttachmentsTest-1991660198'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937255.2964742) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:00:55.297943 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:00:55.298590 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:00:55.299456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:00:55.299683 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:00:55.300738 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:00:55.301062 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:00:55.301160 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:00:55.301337 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:00:55.301458 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:00:55.301537 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:00:55.301625 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:00:55.301761 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:00:55.301885 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:00:55.302023 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:00:55.302145 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:00:55.302322 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:00:55.312931 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:00:55.313251 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converting VIF {"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:55.313595 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ed:c3,bridge_name='br-int',has_traffic_filtering=True,id=aefcb3f3-4513-4238-8126-bff01f489cf6,network=Network(2ba295a3-f501-4809-b860-6b6cb475472f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefcb3f3-45') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:55.314132 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'pci_devices' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:00:55.318159 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-12572953',display_name='tempest-ServersNegativeTestJSON-server-12572953',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serversnegativetestjson-server-12572953',id=8,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:00:52Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7d1983352f42f79e96d32b0ec160ce',ramdisk_id='',reservation_id='r-0vhpv3mj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-612301624',owner_user_name='tempest-ServersNegativeTestJSON-612301624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:53Z,user_data=None,user_id='9ac0cdcec6a84b5da3545699090a9ea0',uuid=1adb131e-325c-471f-ba43-9647f6a306e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:00:55.320831 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converting VIF {"id": "3547c69d-3837-4afd-b1d2-032071a97842", "address": "fa:16:3e:97:f8:40", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3547c69d-38", "ovs_interfaceid": "3547c69d-3837-4afd-b1d2-032071a97842", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:55.320831 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=3547c69d-3837-4afd-b1d2-032071a97842,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547c69d-38') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:55.320831 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=3547c69d-3837-4afd-b1d2-032071a97842,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547c69d-38') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:00:55.321670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.321670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3547c69d-38, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:55.322863 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.325097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:55.328738 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.328948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80a8e1c6-161f-428d-b273-5dc74acfd232) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:55.331718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.331718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:55.332309 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.334385 np0000001589 nova-compute[98297]: INFO os_vif [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=3547c69d-3837-4afd-b1d2-032071a97842,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3547c69d-38')
May 28 03:00:55.334685 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Deleting instance files /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5_del
May 28 03:00:55.335307 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Deletion of /opt/stack/data/nova/instances/1adb131e-325c-471f-ba43-9647f6a306e5_del complete
May 28 03:00:55.531482 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:55.824489 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] End _get_guest_xml xml=<domain type="qemu">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <uuid>f4651248-73c3-435e-842a-3858d6eb74ae</uuid>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <name>instance-00000009</name>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:00:55</nova:creationTime>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <system>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <entry name="serial">f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <entry name="uuid">f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </system>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <os>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   </os>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <features>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   </features>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   <devices>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </disk>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:5a:ed:c3"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <target dev="tapaefcb3f3-45"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </interface>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log" append="off"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </serial>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <video>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </video>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </rng>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:   </devices>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]: </domain>
May 28 03:00:55.824489 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:00:55.824489 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Preparing to wait for external event network-vif-plugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:00:55.828015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:55.828015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:55.828015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:55.828015 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:00:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:00:55.828329 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converting VIF {"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:00:55.828329 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ed:c3,bridge_name='br-int',has_traffic_filtering=True,id=aefcb3f3-4513-4238-8126-bff01f489cf6,network=Network(2ba295a3-f501-4809-b860-6b6cb475472f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefcb3f3-45') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:00:55.828329 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ed:c3,bridge_name='br-int',has_traffic_filtering=True,id=aefcb3f3-4513-4238-8126-bff01f489cf6,network=Network(2ba295a3-f501-4809-b860-6b6cb475472f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefcb3f3-45') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:00:55.828329 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.828329 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:55.828329 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:00:55.828822 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.828981 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cabb4c27-1e11-59d1-8a32-d34cda6a37ab', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:55.831293 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.831293 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:55.832778 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.833979 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.834306 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaefcb3f3-45, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:55.834772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaefcb3f3-45, col_values=(('qos', UUID('a5e06804-259e-4f30-bfcc-1a78ccb90b53')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:55.834938 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaefcb3f3-45, col_values=(('external_ids', {'iface-id': 'aefcb3f3-4513-4238-8126-bff01f489cf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:ed:c3', 'vm-uuid': 'f4651248-73c3-435e-842a-3858d6eb74ae'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:00:55.836686 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.837870 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:00:55.840560 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 03:00:55.841104 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:00:55.843195 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:00:55.843195 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:00:55.843195 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:55.844128 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:55.844914 np0000001589 nova-compute[98297]: INFO os_vif [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:ed:c3,bridge_name='br-int',has_traffic_filtering=True,id=aefcb3f3-4513-4238-8126-bff01f489cf6,network=Network(2ba295a3-f501-4809-b860-6b6cb475472f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefcb3f3-45')
May 28 03:00:55.921016 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:56.034485 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Took 1.88 seconds to deallocate network for instance.
May 28 03:00:56.642565 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Took 0.61 seconds to detach 1 volumes for instance.
May 28 03:00:56.862618 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:00:57.075930 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ec3a1527-29f8-422a-97c8-bc96d657806a req-76d04c55-1352-4a9e-aedc-37dbe46fde05 service nova] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Received event network-vif-deleted-3547c69d-3837-4afd-b1d2-032071a97842 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:57.156199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:57.156397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:57.360952 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:57.361106 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:00:57.361246 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No VIF found with MAC fa:16:3e:5a:ed:c3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:00:57.361721 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Using config drive
May 28 03:00:57.366137 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Took 1.52 seconds to deallocate network for instance.
May 28 03:00:57.409018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:57.693822 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:57.694051 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:57.869562 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:00:57.872975 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:58.007117 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Creating config drive at /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config
May 28 03:00:58.015660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp37d0zjvw {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:00:58.046138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp37d0zjvw" returned: 0 in 0.030s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:00:58.197133 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:58.466477 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:58.500035 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:58.586489 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:58.708609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.549s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:58.714751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.833s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:58.795121 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Deleted allocations for instance 1db1431d-de49-4ad1-ab4a-d05e1e8ed591
May 28 03:00:58.839783 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:58.843318 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:58.851671 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:58.868551 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:00:59.144027 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-plugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:59.144446 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:59.144594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:59.144704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:59.144812 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Processing event network-vif-plugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:00:59.144933 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-plugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:00:59.145073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:00:59.145198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:00:59.145354 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:59.145454 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] No waiting events found dispatching network-vif-plugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:00:59.145557 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-0219cbc9-4a6e-4317-8433-74ae45fbdbf9 req-db581e50-cb0a-4790-a122-1445749d031e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received unexpected event network-vif-plugged-aefcb3f3-4513-4238-8126-bff01f489cf6 for instance with vm_state building and task_state spawning.
May 28 03:00:59.237684 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:00:59.238149 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:00:59.322873 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:00:59.323444 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937259.3228722, f4651248-73c3-435e-842a-3858d6eb74ae => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:00:59.323604 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] VM Started (Lifecycle Event)
May 28 03:00:59.329038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:00:59.331771 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Instance spawned successfully.
May 28 03:00:59.332171 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:00:59.740895 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:00:59.803871 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3fc1a8eb-58b2-4ef3-9713-3c224221f013 tempest-DeleteServersTestJSON-1397080245 tempest-DeleteServersTestJSON-1397080245-project-member] Lock "1db1431d-de49-4ad1-ab4a-d05e1e8ed591" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.878s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:00:59.832621 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:00:59.834588 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:00:59.842175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:59.842175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:59.842175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:59.842175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:59.842175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:00:59.842175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:00.249147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.543s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:00.314340 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Deleted allocations for instance 1adb131e-325c-471f-ba43-9647f6a306e5
May 28 03:01:00.338657 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:01:00.338878 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937260.3387225, f4651248-73c3-435e-842a-3858d6eb74ae => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:00.338975 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] VM Paused (Lifecycle Event)
May 28 03:01:00.348964 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Took 7.99 seconds to spawn the instance on the hypervisor.
May 28 03:01:00.349427 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:00.840259 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:00.841425 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:00.846273 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937260.8460212, f4651248-73c3-435e-842a-3858d6eb74ae => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:00.847727 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] VM Resumed (Lifecycle Event)
May 28 03:01:00.862255 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Took 13.72 seconds to build instance.
May 28 03:01:01.324026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bcd58118-a71f-4002-9552-6cd3d4edc040 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "1adb131e-325c-471f-ba43-9647f6a306e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.391s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:01.348720 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:01.350624 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:01:01.366350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.237s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:02.414877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:02.666213 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-changed-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:02.666643 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Refreshing instance network info cache due to event network-changed-aefcb3f3-4513-4238-8126-bff01f489cf6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:02.666806 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] Acquiring lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:02.666897 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] Acquired lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:02.667030 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Refreshing network info cache for port aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:03.072017 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:03.169111 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:04.001426 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:04.153909 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updated VIF entry in instance network info cache for port aefcb3f3-4513-4238-8126-bff01f489cf6. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:01:04.154161 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:04.656497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0bd83970-f6df-4d82-8ae2-546f5975e5e0 req-be8ac29e-d19a-41fa-9147-e71bb5188bdf service nova] Releasing lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:05.841610 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:06.779188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:06.779528 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:07.281666 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:01:07.418025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:07.868892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:07.869877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:07.881414 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:01:07.881414 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Claim successful on node np0000001589
May 28 03:01:09.145594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:09.145973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:09.145973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:09.145973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:09.146158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:09.150642 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Terminating instance
May 28 03:01:09.175553 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0007276530000126513 future=<Future at 0x7e4b7815bce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:09.176084 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779937254.1747203, 1db1431d-de49-4ad1-ab4a-d05e1e8ed591 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:09.176247 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] VM Stopped (Lifecycle Event)
May 28 03:01:09.176633 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:09.177444 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.6343269910000799 future=<Future at 0x7e4b64484530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:09.177444 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.6342438560000119 future=<Future at 0x7e4b64484530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:09.307082 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:09.307315 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:09.654535 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:01:09.673826 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:09.677171 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:09.681324 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dbc88a5b-4390-492b-a3a3-0be35bf8110d None None] [instance: 1db1431d-de49-4ad1-ab4a-d05e1e8ed591] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:09.696275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:09.700474 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:09.718508 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:09.719309 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:09.809594 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:09.814552 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0028973920000225917 future=<Future at 0x7e4b64484530 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:09.815101 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Emitting event <LifecycleEvent: 1779937254.8115451, 1adb131e-325c-471f-ba43-9647f6a306e5 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:09.815234 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] VM Stopped (Lifecycle Event)
May 28 03:01:09.815998 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:09.837167 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7c404b9f-1573-497e-afef-6e5a91079833 req-5281cb36-6ab4-430c-a733-981886a0c750 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:09.837357 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7c404b9f-1573-497e-afef-6e5a91079833 req-5281cb36-6ab4-430c-a733-981886a0c750 service nova] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:09.837517 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7c404b9f-1573-497e-afef-6e5a91079833 req-5281cb36-6ab4-430c-a733-981886a0c750 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:09.837740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7c404b9f-1573-497e-afef-6e5a91079833 req-5281cb36-6ab4-430c-a733-981886a0c750 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:09.837740 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7c404b9f-1573-497e-afef-6e5a91079833 req-5281cb36-6ab4-430c-a733-981886a0c750 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] No waiting events found dispatching network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:09.837868 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7c404b9f-1573-497e-afef-6e5a91079833 req-5281cb36-6ab4-430c-a733-981886a0c750 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:09.981306 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:09.990567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:10.013636 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999763069999972 future=<Future at 0x7e4b645f4710 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:10.014215 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999211736999996 future=<Future at 0x7e4b645f4710 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:10.014482 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998885793 future=<Future at 0x7e4b645f4710 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:10.015178 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Instance destroyed successfully.
May 28 03:01:10.015676 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lazy-loading 'resources' on Instance uuid c908f979-83fa-417c-a4eb-0b0de669c37b {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:10.316309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.447s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:10.316834 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:01:10.320982 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf18441d-24fa-44fc-be16-9a2380a916f1 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1adb131e-325c-471f-ba43-9647f6a306e5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:10.518473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T02:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-564621560',display_name='tempest-ServersNegativeTestJSON-server-564621560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serversnegativetestjson-server-564621560',id=1,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:00:35Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c7d1983352f42f79e96d32b0ec160ce',ramdisk_id='',reservation_id='r-nauybv2i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-612301624',owner_user_name='tempest-ServersNegativeTestJSON-612301624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:36Z,user_data=None,user_id='9ac0cdcec6a84b5da3545699090a9ea0',uuid=c908f979-83fa-417c-a4eb-0b0de669c37b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:01:10.518718 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converting VIF {"id": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "address": "fa:16:3e:ba:e9:d2", "network": {"id": "27e7d5aa-f2aa-402d-919c-65e84300f7a1", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1319429074-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2c7d1983352f42f79e96d32b0ec160ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf50a0eda-06", "ovs_interfaceid": "f50a0eda-06a8-4d7b-a23a-a550ba2406a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:10.519457 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e9:d2,bridge_name='br-int',has_traffic_filtering=True,id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50a0eda-06') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:10.519769 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e9:d2,bridge_name='br-int',has_traffic_filtering=True,id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50a0eda-06') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:01:10.521678 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:10.521929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf50a0eda-06, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:10.524923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:10.524923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:10.525136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:10.525184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20778c76-928a-45ba-a675-b198e7250f0b) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:10.527081 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:10.527081 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:10.527081 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:10.528734 np0000001589 nova-compute[98297]: INFO os_vif [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:e9:d2,bridge_name='br-int',has_traffic_filtering=True,id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8,network=Network(27e7d5aa-f2aa-402d-919c-65e84300f7a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf50a0eda-06')
May 28 03:01:10.529082 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Deleting instance files /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b_del
May 28 03:01:10.529967 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Deletion of /opt/stack/data/nova/instances/c908f979-83fa-417c-a4eb-0b0de669c37b_del complete
May 28 03:01:10.826368 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:01:10.826592 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:01:10.826895 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:10.827184 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:10.916275 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2776d33c40e0490eb87787c8dafc8066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2ef1b6a03d428d94b2072c01964b49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:01:11.036284 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 03:01:11.037650 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:01:11.037650 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:01:11.037650 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:01:11.037803 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:11.113385 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:11.330310 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:01:11.388730 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Successfully created port: 82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:01:11.519402 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d45791e3-34a6-4449-8372-ec876436828a req-b32513fc-3f6b-41fb-93c7-69e40cfe6fbd service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-deleted-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:11.519402 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-d45791e3-34a6-4449-8372-ec876436828a req-b32513fc-3f6b-41fb-93c7-69e40cfe6fbd service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Neutron deleted interface f50a0eda-06a8-4d7b-a23a-a550ba2406a8; detaching it from the instance and deleting it from the info cache
May 28 03:01:11.522553 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d45791e3-34a6-4449-8372-ec876436828a req-b32513fc-3f6b-41fb-93c7-69e40cfe6fbd service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Detach interface failed, port_id=f50a0eda-06a8-4d7b-a23a-a550ba2406a8, reason: Instance c908f979-83fa-417c-a4eb-0b0de669c37b could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:01:11.834294 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:01:11.889703 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Successfully updated port: 82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:01:11.904389 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6f803d95-b195-46de-ac64-ff1319e1350c req-2fb1d7e4-1e02-4dee-a629-dcea797e5126 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:11.904798 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6f803d95-b195-46de-ac64-ff1319e1350c req-2fb1d7e4-1e02-4dee-a629-dcea797e5126 service nova] Acquiring lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:11.905237 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6f803d95-b195-46de-ac64-ff1319e1350c req-2fb1d7e4-1e02-4dee-a629-dcea797e5126 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:11.905456 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6f803d95-b195-46de-ac64-ff1319e1350c req-2fb1d7e4-1e02-4dee-a629-dcea797e5126 service nova] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:11.905615 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6f803d95-b195-46de-ac64-ff1319e1350c req-2fb1d7e4-1e02-4dee-a629-dcea797e5126 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] No waiting events found dispatching network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:11.905758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6f803d95-b195-46de-ac64-ff1319e1350c req-2fb1d7e4-1e02-4dee-a629-dcea797e5126 service nova] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Received event network-vif-unplugged-f50a0eda-06a8-4d7b-a23a-a550ba2406a8 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:11.969031 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:12.392882 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:12.392882 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquired lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:12.392882 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:01:12.429649 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:12.471139 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Took 1.43 seconds to deallocate network for instance.
May 28 03:01:12.842403 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:01:12.843649 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:01:12.843984 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Creating image(s)
May 28 03:01:12.844583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:12.844781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:12.845396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:12.846011 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:12.849975 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:12.851193 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:12.921118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:12.921673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:12.922286 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:12.922831 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:12.928721 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:12.929052 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:12.977814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:12.978047 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:12.985041 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:01:12.997475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.068s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:12.997868 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:13.032350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk 1073741824" returned: 0 in 0.034s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:13.032781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.111s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:13.033066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:13.103590 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:13.103984 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:01:13.104355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:13.173347 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:13.177909 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Cannot resize image /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:01:13.182241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:01:13.182241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Ensure instance console log exists: /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:01:13.182241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:13.182241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:13.182241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:13.232954 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:13.385282 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updating instance_info_cache with network_info: [{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:13.564299 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:13.564716 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:13.887742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Releasing lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:13.887988 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance network_info: |[{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:01:13.889452 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Start _get_guest_xml network_info=[{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:01:13.891106 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:01:13.892201 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-1347059805', uuid='a6d1b015-c35f-4563-be6b-754693ecbe8d'), owner=OwnerMeta(userid='2776d33c40e0490eb87787c8dafc8066', username='tempest-ServerActionsTestOtherA-1968473744-project-member', projectid='4d2ef1b6a03d428d94b2072c01964b49', projectname='tempest-ServerActionsTestOtherA-1968473744'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937273.8919172) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:01:13.892869 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:01:13.893281 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:01:13.893994 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:01:13.894199 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:01:13.895051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:01:13.895475 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:01:13.895649 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:01:13.895777 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:01:13.895927 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:01:13.896047 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:01:13.896180 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:01:13.896377 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:01:13.896508 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:01:13.896647 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:01:13.896782 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:01:13.896952 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:01:13.906540 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1347059805',display_name='tempest-tempest.common.compute-instance-1347059805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-tempest-common-compute-instance-1347059805',id=10,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3H3xbkuEJFp5BVC9tKLUKzuY22S28zMPGvGibNwb7aG9A8j7iR2rOpJXsWGV+ZFxoYlaqtGtx5+IK7e6ZVXbzZE2A6Oh/00/TmK0lxprE9tXtzjPsvTuUyPdpOpxd10A==',key_name='tempest-keypair-1895656678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-7xlcz90c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=a6d1b015-c35f-4563-be6b-754693ecbe8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:01:13.906742 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:13.907339 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:13.907835 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'pci_devices' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:13.958961 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-changed-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:13.959355 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Refreshing instance network info cache due to event network-changed-82527285-9862-47e9-92e1-5f234948dddd. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:13.959493 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] Acquiring lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:13.959579 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] Acquired lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:13.959682 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Refreshing network info cache for port 82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:14.067712 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:14.410923 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] End _get_guest_xml xml=<domain type="qemu">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <uuid>a6d1b015-c35f-4563-be6b-754693ecbe8d</uuid>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <name>instance-0000000a</name>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:name>tempest-tempest.common.compute-instance-1347059805</nova:name>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:01:13</nova:creationTime>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:user uuid="2776d33c40e0490eb87787c8dafc8066">tempest-ServerActionsTestOtherA-1968473744-project-member</nova:user>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:project uuid="4d2ef1b6a03d428d94b2072c01964b49">tempest-ServerActionsTestOtherA-1968473744</nova:project>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         <nova:port uuid="82527285-9862-47e9-92e1-5f234948dddd">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <system>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <entry name="serial">a6d1b015-c35f-4563-be6b-754693ecbe8d</entry>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <entry name="uuid">a6d1b015-c35f-4563-be6b-754693ecbe8d</entry>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </system>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <os>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   </os>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <features>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   </features>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   <devices>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </disk>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </disk>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:49:ab:d3"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <target dev="tap82527285-98"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </interface>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/console.log" append="off"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </serial>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <video>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </video>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </rng>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:   </devices>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]: </domain>
May 28 03:01:14.410923 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:01:14.412583 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Preparing to wait for external event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:01:14.412583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:14.412583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:14.412583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:14.418438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1347059805',display_name='tempest-tempest.common.compute-instance-1347059805',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-tempest-common-compute-instance-1347059805',id=10,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3H3xbkuEJFp5BVC9tKLUKzuY22S28zMPGvGibNwb7aG9A8j7iR2rOpJXsWGV+ZFxoYlaqtGtx5+IK7e6ZVXbzZE2A6Oh/00/TmK0lxprE9tXtzjPsvTuUyPdpOpxd10A==',key_name='tempest-keypair-1895656678',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-7xlcz90c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:01:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=a6d1b015-c35f-4563-be6b-754693ecbe8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:01:14.418751 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:14.419942 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:14.420644 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:01:14.420977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:14.421340 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:14.421893 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:01:14.422950 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:14.422950 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30184f66-40a9-52a2-b320-da167b064be7', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:14.423751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:14.427700 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:14.427700 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:14.433275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:14.433275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82527285-98, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:14.433275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82527285-98, col_values=(('qos', UUID('e69828ac-a727-4627-86e9-7703cf0a123d')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:14.433275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82527285-98, col_values=(('external_ids', {'iface-id': '82527285-9862-47e9-92e1-5f234948dddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:ab:d3', 'vm-uuid': 'a6d1b015-c35f-4563-be6b-754693ecbe8d'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:14.435278 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:14.441524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:14.442304 np0000001589 nova-compute[98297]: INFO os_vif [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98')
May 28 03:01:14.461400 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:14.573990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.596s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:14.643458 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Deleted allocations for instance c908f979-83fa-417c-a4eb-0b0de669c37b
May 28 03:01:14.794287 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:14.946751 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updated VIF entry in instance network info cache for port 82527285-9862-47e9-92e1-5f234948dddd. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:01:14.946973 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updating instance_info_cache with network_info: [{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:15.401913 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-changed-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:15.402117 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Refreshing instance network info cache due to event network-changed-1710bdaa-b010-4021-80b2-f0e46e701bc6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:15.402372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] Acquiring lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:15.402685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] Acquired lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:15.402899 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Refreshing network info cache for port 1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:15.448893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-384d34b0-5087-4a29-921d-44b1a73ec7d4 req-589fa68f-5103-46dc-bbe4-1f8c26c17115 service nova] Releasing lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:15.654668 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9ce6ec12-6da6-474d-9c8a-cdcf5fdf6c33 tempest-ServersNegativeTestJSON-612301624 tempest-ServersNegativeTestJSON-612301624-project-member] Lock "c908f979-83fa-417c-a4eb-0b0de669c37b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:15.905437 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:15.963179 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:15.963362 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:15.963471 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No VIF found with MAC fa:16:3e:49:ab:d3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:15.964200 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Using config drive
May 28 03:01:16.202768 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:16.305582 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:16.305997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:16.355910 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updated VIF entry in instance network info cache for port 1710bdaa-b010-4021-80b2-f0e46e701bc6. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:01:16.356149 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updating instance_info_cache with network_info: [{"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:16.370438 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:16.370438 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:16.527917 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:16.673470 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Creating config drive at /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config
May 28 03:01:16.678709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjdf7iy39 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:16.711760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjdf7iy39" returned: 0 in 0.033s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:16.810362 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'flavor' on Instance uuid 1268bec3-55ce-4900-b24f-1cf398ea3b91 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:16.859276 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c9e9de95-4338-41ee-ac28-120a755fe1d4 req-cb7331e8-c285-4168-b011-6166f00f0629 service nova] Releasing lock "refresh_cache-1268bec3-55ce-4900-b24f-1cf398ea3b91" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:17.031815 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lazy-loading 'flavor' on Instance uuid 88beccbb-1cf9-4e42-a123-c82ef83bb03d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:17.175476 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:17.205058 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:17.302000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:17.343031 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:17.434540 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:17.472697 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-changed-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:17.472844 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Refreshing instance network info cache due to event network-changed-040ef189-c7e3-4481-bc02-9489f226ede8. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:17.473006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] Acquiring lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:17.473103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] Acquired lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:17.473212 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Refreshing network info cache for port 040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:17.536986 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fd2bf3dd-d588-42df-8206-59dda229b276 req-27bccab4-82fb-46f4-a8f7-29c878923ade service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:17.544425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd2bf3dd-d588-42df-8206-59dda229b276 req-27bccab4-82fb-46f4-a8f7-29c878923ade service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:17.544594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd2bf3dd-d588-42df-8206-59dda229b276 req-27bccab4-82fb-46f4-a8f7-29c878923ade service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:17.544720 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd2bf3dd-d588-42df-8206-59dda229b276 req-27bccab4-82fb-46f4-a8f7-29c878923ade service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:17.544877 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fd2bf3dd-d588-42df-8206-59dda229b276 req-27bccab4-82fb-46f4-a8f7-29c878923ade service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Processing event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:01:17.638869 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:17.823591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:17.964667 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:01:17.965402 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937277.9651113, a6d1b015-c35f-4563-be6b-754693ecbe8d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:17.967048 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] VM Started (Lifecycle Event)
May 28 03:01:17.968703 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:01:17.970484 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance spawned successfully.
May 28 03:01:17.970877 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:01:17.976471 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:18.036510 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.670s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:18.280131 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:18.444521 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Updated VIF entry in instance network info cache for port 040ef189-c7e3-4481-bc02-9489f226ede8. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:01:18.444782 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Updating instance_info_cache with network_info: [{"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:18.468669 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:18.470203 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:01:18.477817 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:18.478010 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:18.478398 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:18.478965 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:18.479121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:18.479635 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:18.906062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:18.906452 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:18.906452 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Attaching volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 to /dev/vdb
May 28 03:01:18.943660 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:18.946573 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0a9fd404-77eb-4f63-a9d4-4b49b9edc939 req-fdfb6e53-a56c-4556-9ca0-a95b8c82b751 service nova] Releasing lock "refresh_cache-ecd114ae-b8cc-4ea8-be10-0c43b8298e85" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:18.954271 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:01:18.971930 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:18.990332 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:01:18.996922 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Took 6.15 seconds to spawn the instance on the hypervisor.
May 28 03:01:18.997429 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:18.997683 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937278.9973052, a6d1b015-c35f-4563-be6b-754693ecbe8d => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:18.997872 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] VM Paused (Lifecycle Event)
May 28 03:01:19.000854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:01:19.006681 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:01:19.016331 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:01:19.017477 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fed6:a9dd', 'fe80::8ca6:c7ff:fe8d:24c8', 'fe80::fc16:3eff:feb9:da20', 'fe80::14c4:11ff:fe78:2b43', 'fe80::fc16:3eff:fe9e:5c17', 'fe80::fc16:3eff:fe5c:eac3', 'fe80::f80d:d1ff:fe06:d44d', 'fe80::fc16:3eff:fe5a:edc3', 'fe80::6494:58ff:fee5:6a95', 'fe80::fc16:3eff:fe49:abd3'] 
May 28 03:01:19.017602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:01:19.017697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:01:19.017912 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] <== get_connector_properties: return (74ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:19.018106 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updating existing volume attachment record: ba8d216e-aea3-464f-8778-2ba30c6a81fb {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:01:19.345686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:19.345874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:19.346088 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Attaching volume 27c36d67-91d2-4972-b429-3878a8176d9d to /dev/sdc
May 28 03:01:19.393524 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:19.403310 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:01:19.423115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:19.437288 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:19.456370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:01:19.456641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:01:19.464850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:01:19.466124 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fed6:a9dd', 'fe80::8ca6:c7ff:fe8d:24c8', 'fe80::fc16:3eff:feb9:da20', 'fe80::14c4:11ff:fe78:2b43', 'fe80::fc16:3eff:fe9e:5c17', 'fe80::fc16:3eff:fe5c:eac3', 'fe80::f80d:d1ff:fe06:d44d', 'fe80::fc16:3eff:fe5a:edc3', 'fe80::6494:58ff:fee5:6a95', 'fe80::fc16:3eff:fe49:abd3'] 
May 28 03:01:19.466283 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:01:19.466351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:01:19.466540 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] <== get_connector_properties: return (72ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:19.466780 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Updating existing volume attachment record: c09092db-e80c-45a2-a4a4-b860e2ee1842 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:01:19.501704 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:19.503309 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937279.5030296, a6d1b015-c35f-4563-be6b-754693ecbe8d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:19.503760 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] VM Resumed (Lifecycle Event)
May 28 03:01:19.515425 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Took 11.73 seconds to build instance.
May 28 03:01:19.585103 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:01:19.585480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:19.585645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:19.586028 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:19.586915 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:01:19.593182 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3eb131e-b1f5-44e5-befa-5d86209100ad req-0465e50e-0cb0-4afb-8cdc-af4f4913513b service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:19.593392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3eb131e-b1f5-44e5-befa-5d86209100ad req-0465e50e-0cb0-4afb-8cdc-af4f4913513b service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:19.593530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3eb131e-b1f5-44e5-befa-5d86209100ad req-0465e50e-0cb0-4afb-8cdc-af4f4913513b service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:19.593642 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3eb131e-b1f5-44e5-befa-5d86209100ad req-0465e50e-0cb0-4afb-8cdc-af4f4913513b service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:19.593743 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3eb131e-b1f5-44e5-befa-5d86209100ad req-0465e50e-0cb0-4afb-8cdc-af4f4913513b service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] No waiting events found dispatching network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:19.593873 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c3eb131e-b1f5-44e5-befa-5d86209100ad req-0465e50e-0cb0-4afb-8cdc-af4f4913513b service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received unexpected event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd for instance with vm_state active and task_state None.
May 28 03:01:19.598890 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:19.599323 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:19.599672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:19.599885 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:19.600176 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:19.600356 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:19.609526 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:19.609526 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:19.615097 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:19.615097 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:19.620434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6] added
May 28 03:01:19.620434 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:19.620434 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:19.620434 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:19.620434 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:19.620434 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:19.620434 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:19.620619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:19.620803 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0209(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:19.620977 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:19.627804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6] added
May 28 03:01:19.627804 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:19.627804 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:19.627804 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:19.627804 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:19.627804 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:19.627804 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:19.627951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:19.628100 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:19.628260 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:19.742640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:19.742795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:20.005969 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:20.008109 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:01:20.017460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7774a3f7-f5f6-4c4e-8822-e1bd9a9eb258 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.238s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:20.018147 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:01:20.018415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27c36d67-91d2-4972-b429-3878a8176d9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:20.018531 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:20.246372 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lazy-loading 'flavor' on Instance uuid a20162bb-2296-4592-bd08-ecebb8896d46 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:20.621504 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:20.628823 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:20.638310 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:20.638310 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:20.646517 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:20.646517 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:20.653316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:20.659545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:20.667011 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:20.667011 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:20.667180 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:20.667180 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:20.667293 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:01:20.667293 np0000001589 nova-compute[98297]: 
May 28 03:01:20.673253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:20.673253 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:20.673253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:20.673253 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:20.673253 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:01:20.673253 np0000001589 nova-compute[98297]: 
May 28 03:01:20.706142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.50.100,3260]
May 28 03:01:20.706142 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.50.100,3260] successful.
May 28 03:01:20.706142 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:20.719372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:20.734248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:20.734248 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:20.734248 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:20.734446 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:20.734446 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:20.734446 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:20.734741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:20.734879 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:20.735650 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:20.735800 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:20.752569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:20.752758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:21.239126 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-changed-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:21.239560 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Refreshing instance network info cache due to event network-changed-82527285-9862-47e9-92e1-5f234948dddd. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:21.239560 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] Acquiring lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:21.239734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] Acquired lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:21.239947 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Refreshing network info cache for port 82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:21.253631 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:21.695951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.40.100,3260]
May 28 03:01:21.695951 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.40.100,3260] successful.
May 28 03:01:21.695951 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:21.705833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:21.717881 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:21.717881 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.118s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:21.717881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:21.731591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:21.731591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:21.744460 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:22.187924 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:22.362837 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updated VIF entry in instance network info cache for port 82527285-9862-47e9-92e1-5f234948dddd. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:01:22.363252 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updating instance_info_cache with network_info: [{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:22.436324 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:22.624485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:01:22.836863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:22.837012 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:22.837169 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Attaching volume 477f6467-42d2-4b3c-a9a0-3936eba9dc99 to /dev/vdb
May 28 03:01:22.866637 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81ac3ca2-2fa4-4e52-a935-32edf342312d req-777b4e5f-68d5-401f-9bb7-262b66400108 service nova] Releasing lock "refresh_cache-a6d1b015-c35f-4563-be6b-754693ecbe8d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:22.895529 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:22.907548 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:01:22.929286 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:22.958584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:01:22.959074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:01:22.968743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:01:22.970211 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fed6:a9dd', 'fe80::8ca6:c7ff:fe8d:24c8', 'fe80::fc16:3eff:feb9:da20', 'fe80::14c4:11ff:fe78:2b43', 'fe80::fc16:3eff:fe9e:5c17', 'fe80::fc16:3eff:fe5c:eac3', 'fe80::f80d:d1ff:fe06:d44d', 'fe80::fc16:3eff:fe5a:edc3', 'fe80::6494:58ff:fee5:6a95', 'fe80::fc16:3eff:fe49:abd3'] 
May 28 03:01:22.970425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:01:22.970555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:01:22.970834 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:22.971124 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Updating existing volume attachment record: 383dfde1-33c5-46f5-a01f-2dbdb0248c84 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:01:23.251780 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:23.545537 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:01:23.545994 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:23.546357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:23.647457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798923 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:01:23.647892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.062s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:23.648090 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] <== connect_volume: return (4062ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798923', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798923'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:23.648264 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798923', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798923'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:01:23.648990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.630s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:23.649664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27c36d67-91d2-4972-b429-3878a8176d9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:01:23.653023 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'flavor' on Instance uuid 1268bec3-55ce-4900-b24f-1cf398ea3b91 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:23.664635 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:23.665346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:23.666364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:23.666552 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:23.667323 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:23.667564 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:23.681650 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:23.681650 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:23.687953 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:23.687953 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:23.700006 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d] added
May 28 03:01:23.700006 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:23.700006 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:23.700006 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:23.700006 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:23.700006 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:23.700006 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:23.700387 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:23.700428 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:23.700624 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:23.704726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d] added
May 28 03:01:23.704726 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:23.704726 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:23.704726 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:23.704726 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:23.704726 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:23.704726 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:23.705029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:23.705140 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:23.705322 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:24.157754 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Attempting to attach volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:01:24.158924 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:01:24.158924 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:24.158924 np0000001589 nova-compute[98297]:   <alias name="ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6"/>
May 28 03:01:24.158924 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:01:24.158924 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:24.158924 np0000001589 nova-compute[98297]:   <serial>25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6</serial>
May 28 03:01:24.158924 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:01:24.158924 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:24.158924 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:01:24.439751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:24.701234 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:24.705762 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:24.722920 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:24.722920 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:24.725404 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:24.725404 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.743376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.747269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.756757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.756757 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.756757 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:24.756944 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.756944 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.756944 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:24.762634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.762634 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.762634 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:24.762634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.762634 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.762634 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:24.791116 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.40.100,3260]
May 28 03:01:24.791116 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.40.100,3260] successful.
May 28 03:01:24.791116 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.804136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.814878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.50.100,3260]
May 28 03:01:24.814878 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.50.100,3260] successful.
May 28 03:01:24.814878 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.822642 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] HCTL ('9', '-', '-', 0) found on session 7 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:24.822642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:24.833975 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:24.845197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Searching for a device in session 7 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:24.845197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27c36d67-91d2-4972-b429-3878a8176d9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:24.851809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.851809 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.851809 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.851809 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.851809 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:24.852042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.852042 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:24.852042 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.852042 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:24.852042 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:24.852333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:24.852812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:24.853470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] HCTL ('10', '-', '-', 0) found on session 8 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:24.853604 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:24.875368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Searching for a device in session 8 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:24.876063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27c36d67-91d2-4972-b429-3878a8176d9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:25.014045 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004260379998868302 future=<Future at 0x7e4b645f4710 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:25.014595 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Emitting event <LifecycleEvent: 1779937270.0132914, c908f979-83fa-417c-a4eb-0b0de669c37b => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:25.014949 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:25.016525 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] VM Stopped (Lifecycle Event)
May 28 03:01:25.331042 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:25.518935 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: c908f979-83fa-417c-a4eb-0b0de669c37b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:25.666581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:01:25.838633 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:25.839108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:25.839108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:25.839108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No VIF found with MAC fa:16:3e:9e:5c:17, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:26.685860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Found WWN 330000000a92e0a6d for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:01:26.686198 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:26.686493 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] <== connect_volume: return (6667ms) {'type': 'block', 'scsi_wwn': '330000000a92e0a6d', 'path': '/dev/dm-1', 'multipath_id': '330000000a92e0a6d'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:26.686725 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a92e0a6d', 'path': '/dev/dm-1', 'multipath_id': '330000000a92e0a6d'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:01:26.687125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.141s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:26.687429 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:01:26.691389 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lazy-loading 'flavor' on Instance uuid 88beccbb-1cf9-4e42-a123-c82ef83bb03d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:26.705068 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:26.705686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:26.705784 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:26.707127 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:26.707481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:26.707758 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:26.719912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:26.719912 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:26.725547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:26.725547 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:26.734638 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99] added
May 28 03:01:26.734638 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:26.734638 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:26.734638 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:26.734638 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:26.734638 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:26.734638 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:26.734958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:26.735678 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:26.735678 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99] added
May 28 03:01:26.741742 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:26.741742 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:26.741742 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:27.207537 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:01:27.207537 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:27.207537 np0000001589 nova-compute[98297]:   <alias name="ua-27c36d67-91d2-4972-b429-3878a8176d9d"/>
May 28 03:01:27.207537 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:01:27.207537 np0000001589 nova-compute[98297]:   <target dev="sdc" bus="scsi"/>
May 28 03:01:27.207537 np0000001589 nova-compute[98297]:   <serial>27c36d67-91d2-4972-b429-3878a8176d9d</serial>
May 28 03:01:27.207537 np0000001589 nova-compute[98297]:   <address type="drive" controller="0" unit="2"/>
May 28 03:01:27.207537 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:27.207537 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:01:27.389487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:27.389666 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:27.396926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbf54a63-5670-4cb4-bc33-88fd52f70575 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.491s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:27.439912 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:27.735816 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:27.740031 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:27.747851 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:27.747851 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:27.753831 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:27.753831 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.762349 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.768612 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.775352 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:27.781916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.781916 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.781916 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.781916 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.781916 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:27.782202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.782202 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.782202 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.782202 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.782202 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:27.812184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.40.100,3260]
May 28 03:01:27.812184 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.40.100,3260] successful.
May 28 03:01:27.812184 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.819945 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.50.100,3260]
May 28 03:01:27.819945 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.50.100,3260] successful.
May 28 03:01:27.819945 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.828584 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.833808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.849797 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:27.849797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:27.853979 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:27.853979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:27.871501 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:27.871598 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:27.878486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:27.878593 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:27.895604 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'flavor' on Instance uuid ecd114ae-b8cc-4ea8-be10-0c43b8298e85 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:28.707956 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:01:28.902619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:28.910648 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:28.910839 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:28.924627 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] No BDM found with device name sda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:28.924751 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:28.924849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:28.924994 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] No VIF found with MAC fa:16:3e:d6:a9:dd, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:29.412938 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:01:29.443720 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:29.722141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Found WWN 330000000e8c7683b for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:01:29.722141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:29.722141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] <== connect_volume: return (6175ms) {'type': 'block', 'scsi_wwn': '330000000e8c7683b', 'path': '/dev/dm-2', 'multipath_id': '330000000e8c7683b'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:29.722141 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e8c7683b', 'path': '/dev/dm-2', 'multipath_id': '330000000e8c7683b'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:01:29.723938 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lazy-loading 'flavor' on Instance uuid a20162bb-2296-4592-bd08-ecebb8896d46 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:29.965942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:29.966189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:29.969485 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:01:29.969712 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Claim successful on node np0000001589
May 28 03:01:29.986855 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:29.987046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:29.987270 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Attaching volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 to /dev/vdb
May 28 03:01:30.026137 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:30.034843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:01:30.051808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:30.075040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:01:30.075345 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:01:30.083372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:01:30.084579 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fed6:a9dd', 'fe80::8ca6:c7ff:fe8d:24c8', 'fe80::fc16:3eff:feb9:da20', 'fe80::14c4:11ff:fe78:2b43', 'fe80::fc16:3eff:fe9e:5c17', 'fe80::fc16:3eff:fe5c:eac3', 'fe80::f80d:d1ff:fe06:d44d', 'fe80::fc16:3eff:fe5a:edc3', 'fe80::6494:58ff:fee5:6a95', 'fe80::fc16:3eff:fe49:abd3'] 
May 28 03:01:30.084692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:01:30.084771 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:01:30.085014 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] <== get_connector_properties: return (58ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:30.085298 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Updating existing volume attachment record: 99a7d79d-7e71-4b02-8ba4-0c2a0cc373d1 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:01:30.228770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Attempting to attach volume 477f6467-42d2-4b3c-a9a0-3936eba9dc99 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:01:30.231075 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] attach device xml: <disk type="block" device="disk">
May 28 03:01:30.231075 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:30.231075 np0000001589 nova-compute[98297]:   <alias name="ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99"/>
May 28 03:01:30.231075 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:01:30.231075 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:30.231075 np0000001589 nova-compute[98297]:   <serial>477f6467-42d2-4b3c-a9a0-3936eba9dc99</serial>
May 28 03:01:30.231075 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:30.231075 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:01:30.483742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2caf4ea6-64cc-4008-a96f-295c6bc7973b tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:30.647256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:01:30.647256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:30.647256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:31.173244 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:31.173244 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:31.339474 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:31.339668 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:31.676090 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Detaching volume 27c36d67-91d2-4972-b429-3878a8176d9d
May 28 03:01:31.721765 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Attempting to driver detach volume 27c36d67-91d2-4972-b429-3878a8176d9d from mountpoint /dev/sdc
May 28 03:01:31.733393 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Found disk sdc by alias ua-27c36d67-91d2-4972-b429-3878a8176d9d {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:31.737864 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Found disk sdc by alias ua-27c36d67-91d2-4972-b429-3878a8176d9d {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:31.737993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Attempting to detach device sdc from instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:01:31.738163 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:01:31.738163 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:31.738163 np0000001589 nova-compute[98297]:   <alias name="ua-27c36d67-91d2-4972-b429-3878a8176d9d"/>
May 28 03:01:31.738163 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:01:31.738163 np0000001589 nova-compute[98297]:   <target dev="sdc" bus="scsi"/>
May 28 03:01:31.738163 np0000001589 nova-compute[98297]:   <serial>27c36d67-91d2-4972-b429-3878a8176d9d</serial>
May 28 03:01:31.738163 np0000001589 nova-compute[98297]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 03:01:31.738163 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:31.738163 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:31.747856 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Successfully detached device sdc from instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d from the persistent domain config.
May 28 03:01:31.748124 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] (1/8): Attempting to detach device sdc with device alias ua-27c36d67-91d2-4972-b429-3878a8176d9d from instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:01:31.748908 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:01:31.748908 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:31.748908 np0000001589 nova-compute[98297]:   <alias name="ua-27c36d67-91d2-4972-b429-3878a8176d9d"/>
May 28 03:01:31.748908 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:01:31.748908 np0000001589 nova-compute[98297]:   <target dev="sdc" bus="scsi"/>
May 28 03:01:31.748908 np0000001589 nova-compute[98297]:   <serial>27c36d67-91d2-4972-b429-3878a8176d9d</serial>
May 28 03:01:31.748908 np0000001589 nova-compute[98297]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 28 03:01:31.748908 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:31.748908 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:31.842548 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:31.882363 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:31.882514 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:31.882627 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:31.882751 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] No VIF found with MAC fa:16:3e:5c:ea:c3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:31.921171 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937291.9198034, 88beccbb-1cf9-4e42-a123-c82ef83bb03d => ua-27c36d67-91d2-4972-b429-3878a8176d9d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:01:31.922040 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-27c36d67-91d2-4972-b429-3878a8176d9d for instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:01:31.923626 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Successfully detached device sdc from instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d from the live domain config.
May 28 03:01:31.924428 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:01:31.924712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27c36d67-91d2-4972-b429-3878a8176d9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:31.924837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:32.005267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.357s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:32.005267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:01:32.012785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:32.013478 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:32.013708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:32.013969 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:32.014470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:32.014610 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:32.027588 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:32.027588 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:32.033726 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:32.033726 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:32.040967 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:32.049699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:32.058937 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.058937 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:32.058937 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.058937 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.058937 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.058937 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.058937 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.058937 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:32.059175 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.059175 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:32.059175 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.059175 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.059175 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.059175 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.059175 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.059175 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:32.059603 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.046s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:32.059766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:32.060554 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] HCTL ('7', '0', '0', 0) found on session 5 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:32.060725 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:32.068479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.068479 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:32.068479 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.068479 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.068479 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.068479 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.068479 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.068479 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:32.068682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.068682 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:32.068682 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.068682 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:32.068682 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.068682 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:32.068682 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:32.068682 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:32.068893 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:32.069107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:32.069614 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching for a device in session 5 and hctl ('7', '0', '0', 0) yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:32.069803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:32.070434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] HCTL ('8', '0', '0', 0) found on session 6 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:32.070569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:32.077871 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Searching for a device in session 6 and hctl ('8', '0', '0', 0) yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:32.078034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:32.350165 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.384s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:32.350560 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:01:32.439665 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:32.858413 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:01:32.858641 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:01:32.858952 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:32.859236 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:32.951356 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41af6183ea4b4a668518493baf359999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989151e14dc44db3b75763b654bb2199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:01:33.014209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:01:33.364645 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:01:33.446096 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Successfully created port: a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:01:33.447758 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3451c0f6-e8c1-4e4e-832d-85da2293106b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.610s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:33.588121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] volume_snapshot_create: create_info: {'snapshot_id': '8378898a-f9d9-4242-99cb-5d12b67b7da4', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98297) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 28 03:01:33.591116 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] snap xml: <domainsnapshot>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:   <disks>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:     <disk name="/dev/dm-2" snapshot="external" type="file">
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:       <source file="/dev/new_file"/>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:     </disk>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:     <disk name="vda" snapshot="no"/>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:     <disk name="hda" snapshot="no"/>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:   </disks>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]: </domainsnapshot>
May 28 03:01:33.591116 np0000001589 nova-compute[98297]:  {{(pid=98297) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 28 03:01:33.591116 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] Lazy-loading 'system_metadata' on Instance uuid a20162bb-2296-4592-bd08-ecebb8896d46 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:33.654128 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a811e4ac-9a88-474d-9f46-a33131c04a19 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] volume_snapshot_delete: delete_info: {'volume_id': '477f6467-42d2-4b3c-a9a0-3936eba9dc99'} {{(pid=98297) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [None req-a811e4ac-9a88-474d-9f46-a33131c04a19 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Traceback (most recent call last):
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     self._volume_snapshot_delete(context, instance, volume_id,
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     if delete_info['type'] != 'qcow2':
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]        ~~~~~~~~~~~^^^^^^^^
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] KeyError: 'type'
May 28 03:01:33.661256 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] 
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [None req-a811e4ac-9a88-474d-9f46-a33131c04a19 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f3afd660-b308-473d-9578-ab27694c27c2)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 03:01:33.679287 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 28 03:01:33.680934 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server [None req-a811e4ac-9a88-474d-9f46-a33131c04a19 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] Exception during message handling: KeyError: 'type'
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 28 03:01:33.691987 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server 
May 28 03:01:33.873242 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:01:34.005484 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Successfully updated port: a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:01:34.029015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Found WWN 33000000086fa23e6 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:01:34.029322 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.027s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:34.029498 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] <== connect_volume: return (3383ms) {'type': 'block', 'scsi_wwn': '33000000086fa23e6', 'path': '/dev/dm-0', 'multipath_id': '33000000086fa23e6'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:34.029649 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000086fa23e6', 'path': '/dev/dm-0', 'multipath_id': '33000000086fa23e6'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:01:34.030425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.105s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:34.030743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27c36d67-91d2-4972-b429-3878a8176d9d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:01:34.030867 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:01:34.032850 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'flavor' on Instance uuid ecd114ae-b8cc-4ea8-be10-0c43b8298e85 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:34.054381 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-changed-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:34.054505 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Refreshing instance network info cache due to event network-changed-a451f1e5-e9e1-4ab0-a842-5a7e598465b1. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:34.054703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] Acquiring lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:34.054834 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] Acquired lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:34.056627 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Refreshing network info cache for port a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:34.061542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:34.061542 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:34.061542 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:34.061542 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:34.061542 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:34.061542 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:34.061542 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:34.061542 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:34.061724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:34.061724 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:34.061724 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:34.061724 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:34.061724 np0000001589 nova-compute[98297]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:34.061724 np0000001589 nova-compute[98297]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d (non-flash)
May 28 03:01:34.061724 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:34.061724 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:34.061954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', '7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', '8'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', '9')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:01:34.062087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', '7')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:01:34.063335 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d', '8')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:01:34.064097 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b645849a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:01:34.064304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:01:34.064571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Flush multipath device 330000000a92e0a6d {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:01:34.094591 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 03:01:34.095726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Traceback (most recent call last):
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 03:01:34.103491 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] 
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Traceback (most recent call last):
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     self._volume_snapshot_create(context, instance, guest,
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 03:01:34.105895 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [instance: a20162bb-2296-4592-bd08-ecebb8896d46] 
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8378898a-f9d9-4242-99cb-5d12b67b7da4 could not be found.
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8378898a-f9d9-4242-99cb-5d12b67b7da4 could not be found. (HTTP 404) (Request-ID: req-bf0c6687-2d2b-4a33-815b-272f558b3ab9)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 28 03:01:34.133289 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8378898a-f9d9-4242-99cb-5d12b67b7da4 could not be found.
May 28 03:01:34.134599 np0000001589 nova-compute[98297]: ERROR nova.virt.libvirt.driver 
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server [None req-1d468a72-2dac-442c-9fe0-bc725ab30d96 tempest-VolumesAssistedSnapshotsTest-1100437662 tempest-VolumesAssistedSnapshotsTest-1100437662-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     raise self.value
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 28 03:01:34.137003 np0000001589 nova-compute[98297]: ERROR oslo_messaging.rpc.server 
May 28 03:01:34.138966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:01:34.186864 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:01:34.187333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:01:34.188262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:01:34.204971 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:01:34.205145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:01:34.217431 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:34.254144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.40.100,3260]
May 28 03:01:34.254144 np0000001589 nova-compute[98297]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.40.100,3260] successful.
May 28 03:01:34.254144 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:34.273504 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:34.286328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:34.317245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.50.100,3260]
May 28 03:01:34.317245 np0000001589 nova-compute[98297]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-27c36d67-91d2-4972-b429-3878a8176d9d, portal: 192.168.50.100,3260] successful.
May 28 03:01:34.317245 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:34.332876 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:34.333067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:34.333204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] <== disconnect_volume: return (2408ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:34.333366 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:01:34.444179 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:34.452774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:34.452774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:34.507487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:34.537476 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Attempting to attach volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:01:34.539670 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:01:34.539670 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:34.539670 np0000001589 nova-compute[98297]:   <alias name="ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6"/>
May 28 03:01:34.539670 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:01:34.539670 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:34.539670 np0000001589 nova-compute[98297]:   <serial>25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6</serial>
May 28 03:01:34.539670 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:01:34.539670 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:34.539670 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:01:34.562498 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:34.574758 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.574997 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.575119 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.575338 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.575512 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.575671 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.575828 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.576008 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.576109 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:01:34.576275 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:01:34.632702 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:01:34.771070 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:34.883577 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:01:34.884615 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:01:34.884803 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Creating image(s)
May 28 03:01:34.885926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:34.885926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:34.885926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:34.886396 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:34.889705 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:34.892689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:34.909045 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lazy-loading 'flavor' on Instance uuid 88beccbb-1cf9-4e42-a123-c82ef83bb03d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:34.957437 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Detaching volume 477f6467-42d2-4b3c-a9a0-3936eba9dc99
May 28 03:01:34.975826 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:34.975959 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:34.976411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:34.976983 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:34.980640 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:01:34.981399 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:35.017615 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Attempting to driver detach volume 477f6467-42d2-4b3c-a9a0-3936eba9dc99 from mountpoint /dev/vdb
May 28 03:01:35.031293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Found disk vdb by alias ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:35.033735 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Found disk vdb by alias ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:35.034307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Attempting to detach device vdb from instance a20162bb-2296-4592-bd08-ecebb8896d46 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:01:35.034382 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] detach device xml: <disk type="block" device="disk">
May 28 03:01:35.034382 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:35.034382 np0000001589 nova-compute[98297]:   <alias name="ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99"/>
May 28 03:01:35.034382 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:01:35.034382 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:35.034382 np0000001589 nova-compute[98297]:   <serial>477f6467-42d2-4b3c-a9a0-3936eba9dc99</serial>
May 28 03:01:35.034382 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:01:35.034382 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:35.034382 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:35.043211 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Successfully detached device vdb from instance a20162bb-2296-4592-bd08-ecebb8896d46 from the persistent domain config.
May 28 03:01:35.043465 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] (1/8): Attempting to detach device vdb with device alias ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99 from instance a20162bb-2296-4592-bd08-ecebb8896d46 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:01:35.043861 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] detach device xml: <disk type="block" device="disk">
May 28 03:01:35.043861 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:35.043861 np0000001589 nova-compute[98297]:   <alias name="ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99"/>
May 28 03:01:35.043861 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:01:35.043861 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:35.043861 np0000001589 nova-compute[98297]:   <serial>477f6467-42d2-4b3c-a9a0-3936eba9dc99</serial>
May 28 03:01:35.043861 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:01:35.043861 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:35.043861 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:35.070372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:35.071334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:35.087193 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:35.088426 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:35.088703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:35.088971 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:01:35.114669 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk 1073741824" returned: 0 in 0.044s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:35.114841 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:35.115321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:35.189328 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.074s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:35.189816 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:01:35.190136 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:35.273168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7e2f29b-2096-4938-9d40-967ef97110f7 req-4ac86953-66d4-480f-bebd-e3dcc56f8d0e service nova] Releasing lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:35.273830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquired lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:35.274116 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:01:35.282422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:35.283644 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Cannot resize image /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:01:35.283965 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:01:35.284125 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Ensure instance console log exists: /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:01:35.284401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:35.284588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:35.284723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:35.599240 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937295.5987046, a20162bb-2296-4592-bd08-ecebb8896d46 => ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:01:35.603728 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-477f6467-42d2-4b3c-a9a0-3936eba9dc99 for instance a20162bb-2296-4592-bd08-ecebb8896d46 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:01:35.611013 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Successfully detached device vdb from instance a20162bb-2296-4592-bd08-ecebb8896d46 from the live domain config.
May 28 03:01:35.614113 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:01:35.614566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:35.614776 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:35.615281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:35.615654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '477f6467-42d2-4b3c-a9a0-3936eba9dc99', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:01:35.615846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99 (non-flash)
May 28 03:01:35.646952 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:35.646952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ebf3b414-9e9a-4a84-a50b-79b95d422418', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', '9')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:01:35.647425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', '9')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:01:35.647984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99', '10')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:01:35.648651 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b81aff560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99'): ({'sdg'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:01:35.649031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Removing multipathed devices sdf, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:01:35.649072 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Flush multipath device 330000000e8c7683b {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:01:35.694682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:01:35.750696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:01:35.800511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:01:35.800639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:01:35.801418 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:01:35.812134 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:01:35.812283 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:01:35.823798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:35.844345 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:01:35.851488 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.40.100,3260]
May 28 03:01:35.851488 np0000001589 nova-compute[98297]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.40.100,3260] successful.
May 28 03:01:35.851488 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:35.863449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:35.872966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:35.902683 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.50.100,3260]
May 28 03:01:35.902683 np0000001589 nova-compute[98297]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-477f6467-42d2-4b3c-a9a0-3936eba9dc99, portal: 192.168.50.100,3260] successful.
May 28 03:01:35.902683 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:35.915248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:35.915248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:35.915248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] <== disconnect_volume: return (300ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:35.915248 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:01:35.919649 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-afddb7f0-f048-4c6f-b03e-da7217cf1a7d tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.749s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:36.001168 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:36.136064 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updating instance_info_cache with network_info: [{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:36.159765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.232249 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:36.232404 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:36.232552 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:36.232690 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] No VIF found with MAC fa:16:3e:b9:da:20, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:36.240511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.241120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.312239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d/disk --force-share --output=json" returned: 0 in 0.071s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.314766 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.379777 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.380243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.449024 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.449491 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:01:36.452032 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.474037 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lazy-loading 'flavor' on Instance uuid a20162bb-2296-4592-bd08-ecebb8896d46 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:36.519942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk --force-share --output=json" returned: 0 in 0.068s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.520342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.605947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.608562 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.639238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Releasing lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:36.639890 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance network_info: |[{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:01:36.641946 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Start _get_guest_xml network_info=[{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:01:36.643740 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:01:36.645087 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-2011301087', uuid='e5117e69-981a-42a7-9fdb-c5fb550fe5b9'), owner=OwnerMeta(userid='41af6183ea4b4a668518493baf359999', username='tempest-AttachVolumeTestJSON-695798121-project-member', projectid='989151e14dc44db3b75763b654bb2199', projectname='tempest-AttachVolumeTestJSON-695798121'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937296.6447227) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:01:36.645843 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:01:36.646212 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:01:36.646841 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:01:36.647020 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:01:36.647944 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:01:36.648242 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:01:36.648396 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:01:36.648502 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:01:36.648641 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:01:36.648748 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:01:36.648807 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:01:36.648973 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:01:36.649048 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:01:36.649204 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:01:36.649334 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:01:36.649440 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:01:36.659905 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:01:36.660087 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:36.660741 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:36.661384 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'pci_devices' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:36.681060 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:36.681403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:36.681573 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:36.681633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:36.681794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:36.686613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.687336 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.688189 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Terminating instance
May 28 03:01:36.764393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.767260 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.840617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.841068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.910717 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.069s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.913466 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:36.985649 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json" returned: 0 in 0.072s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:36.986067 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:37.064142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:37.067062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:37.143354 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:37.144941 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:37.166893 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] End _get_guest_xml xml=<domain type="qemu">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <uuid>e5117e69-981a-42a7-9fdb-c5fb550fe5b9</uuid>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <name>instance-0000000b</name>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeTestJSON-server-2011301087</nova:name>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:01:36</nova:creationTime>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:user uuid="41af6183ea4b4a668518493baf359999">tempest-AttachVolumeTestJSON-695798121-project-member</nova:user>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:project uuid="989151e14dc44db3b75763b654bb2199">tempest-AttachVolumeTestJSON-695798121</nova:project>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         <nova:port uuid="a451f1e5-e9e1-4ab0-a842-5a7e598465b1">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <system>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <entry name="serial">e5117e69-981a-42a7-9fdb-c5fb550fe5b9</entry>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <entry name="uuid">e5117e69-981a-42a7-9fdb-c5fb550fe5b9</entry>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </system>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <os>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   </os>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <features>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   </features>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   <devices>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </disk>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </disk>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:e1:0d:00"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <target dev="tapa451f1e5-e9"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </interface>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/console.log" append="off"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </serial>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <video>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </video>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </rng>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:   </devices>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]: </domain>
May 28 03:01:37.166893 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:01:37.168770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Preparing to wait for external event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:01:37.168770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:37.168770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:37.168770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:37.168770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:01:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:01:37.169002 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:37.169495 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:37.169724 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:01:37.170269 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.170584 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:37.170858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:01:37.171741 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.171880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a6190f7-b6cf-50fa-aac0-e7000630422d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:37.173219 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.173326 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:37.173742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.175549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.175670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa451f1e5-e9, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:37.175968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa451f1e5-e9, col_values=(('qos', UUID('8fede797-792d-4b45-a54d-f91f37ce5fc7')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:37.176167 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa451f1e5-e9, col_values=(('external_ids', {'iface-id': 'a451f1e5-e9e1-4ab0-a842-5a7e598465b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:0d:00', 'vm-uuid': 'e5117e69-981a-42a7-9fdb-c5fb550fe5b9'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:37.176879 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.177875 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:37.184205 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.184428 np0000001589 nova-compute[98297]: INFO os_vif [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9')
May 28 03:01:37.207012 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:01:37.219116 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:37.219770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:01:37.222060 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:01:37.223271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:37.240211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.249697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.256075 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.033s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:37.256898 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=12105MB free_disk=74.50722122192383GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:01:37.257130 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:37.257407 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:37.276991 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.282452 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.309773 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.310787 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.393785 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0bd39bda-f37f-4799-ae0c-543f4321cf20 req-7ebf92c3-bd71-4a3a-a4da-bf2a392cf141 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:37.394031 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0bd39bda-f37f-4799-ae0c-543f4321cf20 req-7ebf92c3-bd71-4a3a-a4da-bf2a392cf141 service nova] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:37.394199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0bd39bda-f37f-4799-ae0c-543f4321cf20 req-7ebf92c3-bd71-4a3a-a4da-bf2a392cf141 service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:37.394699 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0bd39bda-f37f-4799-ae0c-543f4321cf20 req-7ebf92c3-bd71-4a3a-a4da-bf2a392cf141 service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:37.394699 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0bd39bda-f37f-4799-ae0c-543f4321cf20 req-7ebf92c3-bd71-4a3a-a4da-bf2a392cf141 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] No waiting events found dispatching network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:37.394699 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0bd39bda-f37f-4799-ae0c-543f4321cf20 req-7ebf92c3-bd71-4a3a-a4da-bf2a392cf141 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:37.441410 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:37.483201 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0884c0b7-3ab6-46d3-bbfa-fac7dc31632b tempest-VolumesAssistedSnapshotsTest-447134272 tempest-VolumesAssistedSnapshotsTest-447134272-project-admin] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:37.526820 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999431266000101 future=<Future at 0x7e4b6457fc80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:37.527375 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998935656999947 future=<Future at 0x7e4b6457fc80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:37.527678 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998655437000025 future=<Future at 0x7e4b6457fc80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:37.528073 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Instance destroyed successfully.
May 28 03:01:37.528570 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lazy-loading 'resources' on Instance uuid 88beccbb-1cf9-4e42-a123-c82ef83bb03d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:37.812613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e2a0526-b550-4408-981e-ee028a947cc6 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.825s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:38.030641 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2114424032',display_name='tempest-AttachSCSIVolumeTestJSON-server-2114424032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachscsivolumetestjson-server-2114424032',id=4,image_ref='69466b9b-b0ce-4ba1-b448-468fe36816a2',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC30/p54zZEFMHPxz4uNmqN7D63Iq7s94ZWcwJCXrbq2JQg84yrXpZ/jTKZxoL9nwEdZrDGRVewaiVy37/KQbs1FAWtZPhAjpqK+SBRycW4D4pJiz6e/JNUyvuG0wmLPpg==',key_name='tempest-keypair-517161197',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:00:34Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4eb9f22f72444f96b930593adc10e114',ramdisk_id='',reservation_id='r-x70kydwz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='69466b9b-b0ce-4ba1-b448-468fe36816a2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-798296180',owner_user_name='tempest-AttachSCSIVolumeTestJSON-798296180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b62e58f5c1f0472482d97879c3ed3e71',uuid=88beccbb-1cf9-4e42-a123-c82ef83bb03d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:01:38.030899 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Converting VIF {"id": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "address": "fa:16:3e:d6:a9:dd", "network": {"id": "ea06da8a-e957-431b-8bb1-a6dcb2d0ba04", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1035437467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4eb9f22f72444f96b930593adc10e114", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d93c2de-52", "ovs_interfaceid": "7d93c2de-527d-4133-aa4c-fa154c3f3460", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:38.031537 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a9:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d93c2de-527d-4133-aa4c-fa154c3f3460,network=Network(ea06da8a-e957-431b-8bb1-a6dcb2d0ba04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d93c2de-52') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:38.031754 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a9:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d93c2de-527d-4133-aa4c-fa154c3f3460,network=Network(ea06da8a-e957-431b-8bb1-a6dcb2d0ba04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d93c2de-52') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:01:38.033081 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:38.033378 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d93c2de-52, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:38.034723 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:38.035464 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:38.039847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:38.040719 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:38.040880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b91df1d9-4d08-4ec7-8da1-892938b4b663) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:38.041539 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:38.042086 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:38.047241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:38.049106 np0000001589 nova-compute[98297]: INFO os_vif [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:a9:dd,bridge_name='br-int',has_traffic_filtering=True,id=7d93c2de-527d-4133-aa4c-fa154c3f3460,network=Network(ea06da8a-e957-431b-8bb1-a6dcb2d0ba04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d93c2de-52')
May 28 03:01:38.049546 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Deleting instance files /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d_del
May 28 03:01:38.050315 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Deletion of /opt/stack/data/nova/instances/88beccbb-1cf9-4e42-a123-c82ef83bb03d_del complete
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance a20162bb-2296-4592-bd08-ecebb8896d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance f4651248-73c3-435e-842a-3858d6eb74ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance a6d1b015-c35f-4563-be6b-754693ecbe8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330318 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:01:38.330653 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:01:38.330653 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:01:37 up 29 min,  2 users,  load average: 7.90, 4.05, 1.92\n', 'num_instances': '8', 'num_vm_active': '7', 'num_task_None': '6', 'num_os_type_None': '8', 'num_proj_4d2ef1b6a03d428d94b2072c01964b49': '2', 'io_workload': '1', 'num_task_deleting': '1', 'num_proj_4eb9f22f72444f96b930593adc10e114': '1', 'num_proj_581abd74f02944689b3b2c06a6702a09': '2', 'num_proj_f68855494a334878b47ca71a36ff2254': '1', 'num_proj_55c603cee4ca4e5e8665159f4cd59021': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_989151e14dc44db3b75763b654bb2199': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:01:38.555768 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:01:38.556617 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:01:38.556997 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:01:38.557168 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:01:38.557482 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:38.638079 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:38.700316 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:38.700316 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:38.700316 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No VIF found with MAC fa:16:3e:e1:0d:00, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:38.700695 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Using config drive
May 28 03:01:38.794993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:38.795551 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:38.901733 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:38.902172 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:38.902172 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:38.902285 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:38.902368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:38.907070 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Terminating instance
May 28 03:01:39.208554 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:39.300041 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:39.346093 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Creating config drive at /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config
May 28 03:01:39.350439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwcz4pooh {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:39.386623 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwcz4pooh" returned: 0 in 0.036s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:01:39.420620 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:01:39.451377 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "interface-f4651248-73c3-435e-842a-3858d6eb74ae-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:39.451377 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "interface-f4651248-73c3-435e-842a-3858d6eb74ae-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:39.451377 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'flavor' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:39.453928 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:39.456566 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:39.465680 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:39.465680 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] Acquiring lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:39.466433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:39.466433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:39.467807 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] No waiting events found dispatching network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:39.468333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-unplugged-7d93c2de-527d-4133-aa4c-fa154c3f3460 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:39.468660 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Received event network-vif-deleted-7d93c2de-527d-4133-aa4c-fa154c3f3460 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:39.468660 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Neutron deleted interface 7d93c2de-527d-4133-aa4c-fa154c3f3460; detaching it from the instance and deleting it from the info cache
May 28 03:01:39.472938 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52fe8ca8-9322-4422-950f-889a8cd8a1f0 req-87a844b5-e108-4e31-8a04-a10dc51c8530 service nova] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Detach interface failed, port_id=7d93c2de-527d-4133-aa4c-fa154c3f3460, reason: Instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:01:39.479721 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:39.483327 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:39.521738 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:39.608349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:39.608519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:39.641849 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8c1333e8-814f-46ab-88e0-32d0f7434be3 req-18aa1553-c5f2-4d5c-8889-31efe92df3b3 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-vif-unplugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:39.646545 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8c1333e8-814f-46ab-88e0-32d0f7434be3 req-18aa1553-c5f2-4d5c-8889-31efe92df3b3 service nova] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:39.646784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8c1333e8-814f-46ab-88e0-32d0f7434be3 req-18aa1553-c5f2-4d5c-8889-31efe92df3b3 service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:39.646885 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8c1333e8-814f-46ab-88e0-32d0f7434be3 req-18aa1553-c5f2-4d5c-8889-31efe92df3b3 service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:39.647029 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8c1333e8-814f-46ab-88e0-32d0f7434be3 req-18aa1553-c5f2-4d5c-8889-31efe92df3b3 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] No waiting events found dispatching network-vif-unplugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:39.647159 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8c1333e8-814f-46ab-88e0-32d0f7434be3 req-18aa1553-c5f2-4d5c-8889-31efe92df3b3 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-vif-unplugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:39.649545 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:39.805491 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:01:39.805693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.548s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:39.806075 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.33 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:01:39.946679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:39.959823 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:39.983552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.014434 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.018567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.119712 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Detaching volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6
May 28 03:01:40.152879 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Took 1.60 seconds to deallocate network for instance.
May 28 03:01:40.177555 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'pci_requests' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:40.188371 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Attempting to driver detach volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 from mountpoint /dev/vdb
May 28 03:01:40.189897 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.192286 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999689904999968 future=<Future at 0x7e4b78188080 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:40.201666 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Instance destroyed successfully.
May 28 03:01:40.202360 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lazy-loading 'resources' on Instance uuid a20162bb-2296-4592-bd08-ecebb8896d46 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:40.203898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Found disk vdb by alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:40.206556 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Found disk vdb by alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:40.206752 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Attempting to detach device vdb from instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:01:40.207037 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:   <alias name="ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6"/>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:   <serial>25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6</serial>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:40.207037 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:40.225533 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully detached device vdb from instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 from the persistent domain config.
May 28 03:01:40.226421 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] (1/8): Attempting to detach device vdb with device alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 from instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:01:40.226421 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:   <alias name="ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6"/>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:   <serial>25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6</serial>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:40.226421 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:40.247999 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-95dfe0c4-2323-4c4d-b415-8cf8c835fa2b req-0c44111e-9754-4da1-9da3-7178d3398d04 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:40.248078 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-95dfe0c4-2323-4c4d-b415-8cf8c835fa2b req-0c44111e-9754-4da1-9da3-7178d3398d04 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:40.248667 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-95dfe0c4-2323-4c4d-b415-8cf8c835fa2b req-0c44111e-9754-4da1-9da3-7178d3398d04 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:40.248667 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-95dfe0c4-2323-4c4d-b415-8cf8c835fa2b req-0c44111e-9754-4da1-9da3-7178d3398d04 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:40.248667 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-95dfe0c4-2323-4c4d-b415-8cf8c835fa2b req-0c44111e-9754-4da1-9da3-7178d3398d04 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Processing event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:01:40.313526 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.326103 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.331399 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.358711 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.365435 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.667467 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:40.667630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:40.682790 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Object Instance<f4651248-73c3-435e-842a-3858d6eb74ae> lazy-loaded attributes: flavor,pci_requests {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:01:40.682790 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:01:40.682790 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:40.682790 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:40.704954 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-397309063',display_name='tempest-VolumesAssistedSnapshotsTest-server-397309063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesassistedsnapshotstest-server-397309063',id=7,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLj5nPv1+gWsrE2ZvZCI368B/oK0g4L3pmVAxy1jH5YkwYPYv0KtWpkeo+8Ryi9ibR0x9jRZPe+3Plck4ZouCMqEralU3R5+zV6ogL7zSUY5luQ7CHjrjlfQSflvvflnIA==',key_name='tempest-keypair-162895959',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:00:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f68855494a334878b47ca71a36ff2254',ramdisk_id='',reservation_id='r-v17w4uce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1746170207',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1746170207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='425bf68a4c264949818f73750cdddd32',uuid=a20162bb-2296-4592-bd08-ecebb8896d46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:01:40.705206 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Converting VIF {"id": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "address": "fa:16:3e:5c:ea:c3", "network": {"id": "f484a765-5e31-4b76-ad9b-77f04158ed0e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1746943444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f68855494a334878b47ca71a36ff2254", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c397d0a-90", "ovs_interfaceid": "8c397d0a-9097-46e9-991c-7d50e8ddd286", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:40.705759 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ea:c3,bridge_name='br-int',has_traffic_filtering=True,id=8c397d0a-9097-46e9-991c-7d50e8ddd286,network=Network(f484a765-5e31-4b76-ad9b-77f04158ed0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c397d0a-90') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:40.706100 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ea:c3,bridge_name='br-int',has_traffic_filtering=True,id=8c397d0a-9097-46e9-991c-7d50e8ddd286,network=Network(f484a765-5e31-4b76-ad9b-77f04158ed0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c397d0a-90') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:01:40.707684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.707684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c397d0a-90, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:40.708749 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.709614 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:40.710377 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.711122 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.711288 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b048b89c-117a-49b0-96ee-dab1be338335) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:40.711961 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.713534 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:40.713534 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:40.715194 np0000001589 nova-compute[98297]: INFO os_vif [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:ea:c3,bridge_name='br-int',has_traffic_filtering=True,id=8c397d0a-9097-46e9-991c-7d50e8ddd286,network=Network(f484a765-5e31-4b76-ad9b-77f04158ed0e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c397d0a-90')
May 28 03:01:40.719249 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Deleting instance files /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46_del
May 28 03:01:40.719249 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Deletion of /opt/stack/data/nova/instances/a20162bb-2296-4592-bd08-ecebb8896d46_del complete
May 28 03:01:40.774295 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937300.773764, ecd114ae-b8cc-4ea8-be10-0c43b8298e85 => ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:01:40.777130 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 for instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:01:40.779748 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0546cf4892194fb0b81f60e06176325e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55c603cee4ca4e5e8665159f4cd59021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:01:40.782489 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully detached device vdb from instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 from the live domain config.
May 28 03:01:40.964592 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:01:40.967650 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937300.965109, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:40.967650 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Started (Lifecycle Event)
May 28 03:01:40.967650 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:01:40.969684 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance spawned successfully.
May 28 03:01:40.970180 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:01:41.232944 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Took 1.81 seconds to destroy the instance on the hypervisor.
May 28 03:01:41.234419 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:01:41.234874 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:01:41.234874 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:01:41.235151 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:41.321573 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:41.321822 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:41.326764 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Detected multiple connections on this host for volume: 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, skipping target disconnect.
May 28 03:01:41.343558 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:41.369650 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Successfully created port: 33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:01:41.470904 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:41.475188 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:01:41.478669 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:41.478958 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:41.479316 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:41.479548 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:41.479787 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:41.480058 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:01:41.714418 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3f75dbd4-0cda-41d1-8a88-5a3de37db4f4 req-4dfc3a71-d5f2-4f12-b293-00ff587ae0e9 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-vif-unplugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:41.714652 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3f75dbd4-0cda-41d1-8a88-5a3de37db4f4 req-4dfc3a71-d5f2-4f12-b293-00ff587ae0e9 service nova] Acquiring lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:41.714885 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3f75dbd4-0cda-41d1-8a88-5a3de37db4f4 req-4dfc3a71-d5f2-4f12-b293-00ff587ae0e9 service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:41.715134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3f75dbd4-0cda-41d1-8a88-5a3de37db4f4 req-4dfc3a71-d5f2-4f12-b293-00ff587ae0e9 service nova] Lock "a20162bb-2296-4592-bd08-ecebb8896d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:41.715335 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3f75dbd4-0cda-41d1-8a88-5a3de37db4f4 req-4dfc3a71-d5f2-4f12-b293-00ff587ae0e9 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] No waiting events found dispatching network-vif-unplugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:41.715497 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3f75dbd4-0cda-41d1-8a88-5a3de37db4f4 req-4dfc3a71-d5f2-4f12-b293-00ff587ae0e9 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-vif-unplugged-8c397d0a-9097-46e9-991c-7d50e8ddd286 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:41.834339 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:41.909087 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'flavor' on Instance uuid ecd114ae-b8cc-4ea8-be10-0c43b8298e85 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:41.978774 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:01:41.979262 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937301.9786925, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:41.979262 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Paused (Lifecycle Event)
May 28 03:01:41.987116 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Took 7.10 seconds to spawn the instance on the hypervisor.
May 28 03:01:41.987314 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:42.080427 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Successfully updated port: 33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:01:42.134579 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-changed-33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:42.135067 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Refreshing instance network info cache due to event network-changed-33547409-b130-4398-bef1-bd41da13a093. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:42.135292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] Acquiring lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:42.135429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] Acquired lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:42.135586 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Refreshing network info cache for port 33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:42.340165 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:42.340416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:42.343767 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:42.343951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:42.344142 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:42.344301 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state active and task_state None.
May 28 03:01:42.344478 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Received event network-vif-deleted-8c397d0a-9097-46e9-991c-7d50e8ddd286 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:42.344636 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Neutron deleted interface 8c397d0a-9097-46e9-991c-7d50e8ddd286; detaching it from the instance and deleting it from the info cache
May 28 03:01:42.345553 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fe7d4639-64a8-4a31-babb-d473f6953dc0 req-e3fd0baf-2ac2-4f19-a578-fe0b585f87c6 service nova] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Detach interface failed, port_id=8c397d0a-9097-46e9-991c-7d50e8ddd286, reason: Instance a20162bb-2296-4592-bd08-ecebb8896d46 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:01:42.378927 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.708s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:42.385192 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:42.450892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:42.481251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:42.483437 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937302.483084, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:42.483609 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Resumed (Lifecycle Event)
May 28 03:01:42.506014 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Took 12.58 seconds to build instance.
May 28 03:01:42.521144 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Deleted allocations for instance 88beccbb-1cf9-4e42-a123-c82ef83bb03d
May 28 03:01:42.583129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:42.638206 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:42.889222 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Took 1.65 seconds to deallocate network for instance.
May 28 03:01:42.919890 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-92b37446-3c48-4351-9b5a-d91283463589 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.311s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:42.986783 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:42.989522 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:01:42.993683 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:43.009899 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.099s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:43.125332 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Added VIF to instance network info cache for port 33547409-b130-4398-bef1-bd41da13a093. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3530}}
May 28 03:01:43.125602 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:43.395210 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:43.399234 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:43.534480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4461c13-5fe2-4269-aed0-3fc2735bb7c1 tempest-AttachSCSIVolumeTestJSON-798296180 tempest-AttachSCSIVolumeTestJSON-798296180-project-member] Lock "88beccbb-1cf9-4e42-a123-c82ef83bb03d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.853s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:43.566850 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:43.627753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7ba9ad7-133f-421d-a13a-3348c90aee3b req-a660571a-ff88-4ea9-b9fe-f8d515c83510 service nova] Releasing lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:43.631587 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquired lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:43.631587 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:01:43.782807 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-changed-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:43.782942 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Refreshing instance network info cache due to event network-changed-a451f1e5-e9e1-4ab0-a842-5a7e598465b1. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:01:43.783099 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] Acquiring lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:01:43.783186 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] Acquired lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:01:43.783322 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Refreshing network info cache for port a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:01:43.858440 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:43.858657 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:44.039365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:44.039749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:44.223600 np0000001589 nova-compute[98297]: WARNING nova.network.neutron [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] 5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66 already exists in list: networks containing: ['5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66']. ignoring it
May 28 03:01:44.223753 np0000001589 nova-compute[98297]: WARNING nova.network.neutron [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] 33547409-b130-4398-bef1-bd41da13a093 already exists in list: port_ids containing: ['33547409-b130-4398-bef1-bd41da13a093']. ignoring it
May 28 03:01:44.288132 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:44.361050 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:44.443645 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:44.542068 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Detaching volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6
May 28 03:01:44.596300 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Attempting to driver detach volume 25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 from mountpoint /dev/vdb
May 28 03:01:44.604237 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Found disk vdb by alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:44.607121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Found disk vdb by alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:01:44.607121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Attempting to detach device vdb from instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:01:44.607121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:   <alias name="ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6"/>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:   <serial>25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6</serial>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:44.607121 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:44.614062 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully detached device vdb from instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 from the persistent domain config.
May 28 03:01:44.614189 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] (1/8): Attempting to detach device vdb with device alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 from instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:01:44.614390 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:   <alias name="ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6"/>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:   <serial>25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6</serial>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:44.614390 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:01:44.716759 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:44.784161 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:44.868391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.470s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:44.885914 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updated VIF entry in instance network info cache for port a451f1e5-e9e1-4ab0-a842-5a7e598465b1. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:01:44.886325 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updating instance_info_cache with network_info: [{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:44.921505 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:44.923194 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Deleted allocations for instance a20162bb-2296-4592-bd08-ecebb8896d46
May 28 03:01:45.388355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ea74fed1-bec2-4f50-8aec-44a0e1ffc4f0 req-684bc407-811c-44d7-8821-00f9d4e1e822 service nova] Releasing lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:45.423224 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Releasing lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:01:45.424747 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:01:45.424930 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converting VIF {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:45.425354 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:45.425560 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:01:45.425932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.426210 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:45.426472 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:01:45.428470 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.428660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c567d53a-5fa0-5457-a3f0-9528b1be38bc', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:45.430238 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:45.432271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.432433 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33547409-b1, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:45.432769 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33547409-b1, col_values=(('qos', UUID('19a93c0d-6437-4b2b-b9cf-2121f14b2208')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:45.432964 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33547409-b1, col_values=(('external_ids', {'iface-id': '33547409-b130-4398-bef1-bd41da13a093', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:2e:25', 'vm-uuid': 'f4651248-73c3-435e-842a-3858d6eb74ae'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:45.433670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.435080 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:45.438714 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.439762 np0000001589 nova-compute[98297]: INFO os_vif [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1')
May 28 03:01:45.440374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:01:45.440497 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converting VIF {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:45.440924 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:45.441957 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] attach device xml: <interface type="ethernet">
May 28 03:01:45.441957 np0000001589 nova-compute[98297]:   <mac address="fa:16:3e:18:2e:25"/>
May 28 03:01:45.441957 np0000001589 nova-compute[98297]:   <model type="virtio"/>
May 28 03:01:45.441957 np0000001589 nova-compute[98297]:   <driver name="qemu"/>
May 28 03:01:45.441957 np0000001589 nova-compute[98297]:   <mtu size="1372"/>
May 28 03:01:45.441957 np0000001589 nova-compute[98297]:   <target dev="tap33547409-b1"/>
May 28 03:01:45.441957 np0000001589 nova-compute[98297]: </interface>
May 28 03:01:45.441957 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:01:45.449276 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.512155 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.556250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.682171 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2526f7a9-4e4c-4645-90c3-194c0a1a16ab req-d384b86d-9705-402f-9dfa-560c592bc952 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-plugged-33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:45.682376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2526f7a9-4e4c-4645-90c3-194c0a1a16ab req-d384b86d-9705-402f-9dfa-560c592bc952 service nova] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:45.682524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2526f7a9-4e4c-4645-90c3-194c0a1a16ab req-d384b86d-9705-402f-9dfa-560c592bc952 service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:45.682629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2526f7a9-4e4c-4645-90c3-194c0a1a16ab req-d384b86d-9705-402f-9dfa-560c592bc952 service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:45.682770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2526f7a9-4e4c-4645-90c3-194c0a1a16ab req-d384b86d-9705-402f-9dfa-560c592bc952 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] No waiting events found dispatching network-vif-plugged-33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:45.682899 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-2526f7a9-4e4c-4645-90c3-194c0a1a16ab req-d384b86d-9705-402f-9dfa-560c592bc952 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received unexpected event network-vif-plugged-33547409-b130-4398-bef1-bd41da13a093 for instance with vm_state active and task_state None.
May 28 03:01:45.815210 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.815210 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.818316 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.844133 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:45.933822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-239bd5e1-2eb9-4d2e-bebf-05506b96a2da tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Lock "a20162bb-2296-4592-bd08-ecebb8896d46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.032s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:46.692656 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937306.6922925, 1268bec3-55ce-4900-b24f-1cf398ea3b91 => ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:01:46.694416 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 for instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:01:46.699195 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully detached device vdb from instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 from the live domain config.
May 28 03:01:46.733772 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:01:46.734085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:46.734237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:46.734622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:46.734921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:01:46.735056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:01:46.759715 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:46.759715 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:46.759715 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:46.759910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsi session list stdout=tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:46.759910 np0000001589 nova-compute[98297]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6 (non-flash)
May 28 03:01:46.759910 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:46.760018 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '6')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:01:46.760165 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '5')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:01:46.761093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6', '6')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:01:46.761866 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646d1b20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:01:46.762084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:01:46.762372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Flush multipath device 33000000086fa23e6 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:01:46.791946 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:01:46.848974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:01:46.891717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:01:46.891914 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:01:46.892584 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:01:46.903663 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:01:46.903962 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:01:46.916362 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:46.951286 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.40.100,3260]
May 28 03:01:46.951286 np0000001589 nova-compute[98297]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.40.100,3260] successful.
May 28 03:01:46.951286 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:46.966423 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:46.981056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:47.016171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.50.100,3260]
May 28 03:01:47.016171 np0000001589 nova-compute[98297]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-25e3bddc-8d0a-4ddf-a9c4-7b67713b69f6, portal: 192.168.50.100,3260] successful.
May 28 03:01:47.016171 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:47.035060 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:47.035284 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:47.035404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] <== disconnect_volume: return (300ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:47.035526 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:01:47.084625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:47.084625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:47.084625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No VIF found with MAC fa:16:3e:5a:ed:c3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:47.456615 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:47.460681 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:47.593308 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2072436584', uuid='f4651248-73c3-435e-842a-3858d6eb74ae'), owner=OwnerMeta(userid='0546cf4892194fb0b81f60e06176325e', username='tempest-TaggedAttachmentsTest-1991660198-project-member', projectid='55c603cee4ca4e5e8665159f4cd59021', projectname='tempest-TaggedAttachmentsTest-1991660198'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937307.5927832) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:01:47.594061 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:package version="33.1.0"/>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:creationTime>2026-05-28 03:01:47</nova:creationTime>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:flavor name="m1.nano" id="42">
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:memory>192</nova:memory>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:disk>1</nova:disk>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:swap>0</nova:swap>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:ephemeral>0</nova:ephemeral>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:vcpus>1</nova:vcpus>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:extraSpecs>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     </nova:extraSpecs>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   </nova:flavor>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:minDisk>1</nova:minDisk>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:minRam>0</nova:minRam>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:properties>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     </nova:properties>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   </nova:image>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:owner>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   </nova:owner>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   <nova:ports>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     <nova:port uuid="33547409-b130-4398-bef1-bd41da13a093">
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.10.10.140" ipVersion="4"/>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:   </nova:ports>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]: </nova:instance>
May 28 03:01:47.594061 np0000001589 nova-compute[98297]:  {{(pid=98297) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 03:01:47.624458 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'flavor' on Instance uuid 1268bec3-55ce-4900-b24f-1cf398ea3b91 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:47.791445 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ef091297-fefa-49d0-a0c8-bf526bc4fdd7 req-15de17f3-0135-473e-a6a4-e1d7677f04fa service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-plugged-33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:47.791882 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ef091297-fefa-49d0-a0c8-bf526bc4fdd7 req-15de17f3-0135-473e-a6a4-e1d7677f04fa service nova] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:47.791882 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ef091297-fefa-49d0-a0c8-bf526bc4fdd7 req-15de17f3-0135-473e-a6a4-e1d7677f04fa service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:47.791988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ef091297-fefa-49d0-a0c8-bf526bc4fdd7 req-15de17f3-0135-473e-a6a4-e1d7677f04fa service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:47.792031 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ef091297-fefa-49d0-a0c8-bf526bc4fdd7 req-15de17f3-0135-473e-a6a4-e1d7677f04fa service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] No waiting events found dispatching network-vif-plugged-33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:47.792162 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-ef091297-fefa-49d0-a0c8-bf526bc4fdd7 req-15de17f3-0135-473e-a6a4-e1d7677f04fa service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received unexpected event network-vif-plugged-33547409-b130-4398-bef1-bd41da13a093 for instance with vm_state active and task_state None.
May 28 03:01:47.939508 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:48.103472 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5290dddc-2b76-40ab-a4e3-301cfba97dac tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "interface-f4651248-73c3-435e-842a-3858d6eb74ae-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 8.654s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:48.639281 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-42bf081c-f295-4f62-8142-4567317d4495 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.598s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:49.212875 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:49.213768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:49.520537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:49.520537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:49.520537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:49.520537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:49.520537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:49.522024 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Terminating instance
May 28 03:01:49.602661 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:49.602889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:49.603760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:49.603760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:49.603760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:49.605600 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Terminating instance
May 28 03:01:49.610251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:49.720214 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'flavor' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:50.005402 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.026555 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:01:50.050773 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.054543 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.075926 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.109384 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:01:50.136630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.142544 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.164539 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.238424 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.250991 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.268385 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0b9e676-803b-4d6a-8874-5237ad097a41 req-325ef9ef-ed98-4f06-81cd-39ed447859df service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-vif-unplugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:50.268385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0b9e676-803b-4d6a-8874-5237ad097a41 req-325ef9ef-ed98-4f06-81cd-39ed447859df service nova] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:50.268385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0b9e676-803b-4d6a-8874-5237ad097a41 req-325ef9ef-ed98-4f06-81cd-39ed447859df service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:50.268385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0b9e676-803b-4d6a-8874-5237ad097a41 req-325ef9ef-ed98-4f06-81cd-39ed447859df service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:50.268385 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0b9e676-803b-4d6a-8874-5237ad097a41 req-325ef9ef-ed98-4f06-81cd-39ed447859df service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] No waiting events found dispatching network-vif-unplugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:50.268573 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0b9e676-803b-4d6a-8874-5237ad097a41 req-325ef9ef-ed98-4f06-81cd-39ed447859df service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-vif-unplugged-040ef189-c7e3-4481-bc02-9489f226ede8 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:50.275689 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.311965 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.329703 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9c370fce-95a0-4fc4-96bf-1df6670cf6fe req-0aea589b-5cbe-4f03-963c-84dd6dbe2b3e service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:50.329953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9c370fce-95a0-4fc4-96bf-1df6670cf6fe req-0aea589b-5cbe-4f03-963c-84dd6dbe2b3e service nova] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:50.330449 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9c370fce-95a0-4fc4-96bf-1df6670cf6fe req-0aea589b-5cbe-4f03-963c-84dd6dbe2b3e service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:50.334102 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9c370fce-95a0-4fc4-96bf-1df6670cf6fe req-0aea589b-5cbe-4f03-963c-84dd6dbe2b3e service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:50.334970 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9c370fce-95a0-4fc4-96bf-1df6670cf6fe req-0aea589b-5cbe-4f03-963c-84dd6dbe2b3e service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] No waiting events found dispatching network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:50.335431 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9c370fce-95a0-4fc4-96bf-1df6670cf6fe req-0aea589b-5cbe-4f03-963c-84dd6dbe2b3e service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:50.434689 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.491666 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.493215 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999021615999936 future=<Future at 0x7e4b645cd250 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:50.503794 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Instance destroyed successfully.
May 28 03:01:50.504251 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'resources' on Instance uuid ecd114ae-b8cc-4ea8-be10-0c43b8298e85 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:50.509139 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:50.513893 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999615085999949 future=<Future at 0x7e4b646fcc20 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:50.518376 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Instance destroyed successfully.
May 28 03:01:50.519340 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lazy-loading 'resources' on Instance uuid 1268bec3-55ce-4900-b24f-1cf398ea3b91 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:50.725723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:51.008366 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2058676602-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testmultiattachvolumeswap-server-2058676602-1',id=5,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpksUJlAoqEzyHXN1KYsw4hczm/hfmB4B6LUCtzCn66ZIRVNdkLUHZF1RcxgNSE/ExjgEWUWknUj98DmX+4k7p4+koEL4E5Btl8D0eg7WPn1tbDz0bGz1WOd/OOmK6b7Q==',key_name='tempest-keypair-52110820',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:00:33Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='581abd74f02944689b3b2c06a6702a09',ramdisk_id='',reservation_id='r-0oc501hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-715973546',owner_user_name='tempest-TestMultiAttachVolumeSwap-715973546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c775700e4f5c458caf730a3cce6e108f',uuid=ecd114ae-b8cc-4ea8-be10-0c43b8298e85,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:01:51.008769 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converting VIF {"id": "040ef189-c7e3-4481-bc02-9489f226ede8", "address": "fa:16:3e:b9:da:20", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap040ef189-c7", "ovs_interfaceid": "040ef189-c7e3-4481-bc02-9489f226ede8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:51.009252 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:da:20,bridge_name='br-int',has_traffic_filtering=True,id=040ef189-c7e3-4481-bc02-9489f226ede8,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040ef189-c7') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:51.009478 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:da:20,bridge_name='br-int',has_traffic_filtering=True,id=040ef189-c7e3-4481-bc02-9489f226ede8,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040ef189-c7') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:01:51.010431 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.010670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap040ef189-c7, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:51.013625 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.014220 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:51.021382 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-2058676602-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testmultiattachvolumeswap-server-2058676602-2',id=6,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMpksUJlAoqEzyHXN1KYsw4hczm/hfmB4B6LUCtzCn66ZIRVNdkLUHZF1RcxgNSE/ExjgEWUWknUj98DmX+4k7p4+koEL4E5Btl8D0eg7WPn1tbDz0bGz1WOd/OOmK6b7Q==',key_name='tempest-keypair-52110820',keypairs=<?>,launch_index=1,launched_at=2026-05-28T03:00:35Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='581abd74f02944689b3b2c06a6702a09',ramdisk_id='',reservation_id='r-0oc501hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-715973546',owner_user_name='tempest-TestMultiAttachVolumeSwap-715973546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c775700e4f5c458caf730a3cce6e108f',uuid=1268bec3-55ce-4900-b24f-1cf398ea3b91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:01:51.021676 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converting VIF {"id": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "address": "fa:16:3e:9e:5c:17", "network": {"id": "21aa52e0-bcbe-48af-aafd-9d822d4ee68a", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1137255379-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "581abd74f02944689b3b2c06a6702a09", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1710bdaa-b0", "ovs_interfaceid": "1710bdaa-b010-4021-80b2-f0e46e701bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:01:51.021998 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=1710bdaa-b010-4021-80b2-f0e46e701bc6,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1710bdaa-b0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:01:51.022295 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=1710bdaa-b010-4021-80b2-f0e46e701bc6,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1710bdaa-b0') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:01:51.022589 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.024896 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.024896 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49fb84cb-60f6-4c0f-b8dd-9d9defbc79e0) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:51.025115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:51.032521 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.033061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.033482 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1710bdaa-b0, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:51.034245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.034898 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:51.035884 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.036558 np0000001589 nova-compute[98297]: INFO os_vif [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:da:20,bridge_name='br-int',has_traffic_filtering=True,id=040ef189-c7e3-4481-bc02-9489f226ede8,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap040ef189-c7')
May 28 03:01:51.037191 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:51.037367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d05942f9-43c1-404e-bcad-4c7778969317) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:01:51.037786 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Deleting instance files /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85_del
May 28 03:01:51.038504 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:01:51.041458 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Deletion of /opt/stack/data/nova/instances/ecd114ae-b8cc-4ea8-be10-0c43b8298e85_del complete
May 28 03:01:51.046839 np0000001589 nova-compute[98297]: INFO os_vif [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5c:17,bridge_name='br-int',has_traffic_filtering=True,id=1710bdaa-b010-4021-80b2-f0e46e701bc6,network=Network(21aa52e0-bcbe-48af-aafd-9d822d4ee68a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1710bdaa-b0')
May 28 03:01:51.047543 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Deleting instance files /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91_del
May 28 03:01:51.048263 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Deletion of /opt/stack/data/nova/instances/1268bec3-55ce-4900-b24f-1cf398ea3b91_del complete
May 28 03:01:51.552503 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Took 1.53 seconds to destroy the instance on the hypervisor.
May 28 03:01:51.555090 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:01:51.555388 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:01:51.555520 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:01:51.555760 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:51.558135 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 03:01:51.558661 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:01:51.559768 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:01:51.559768 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:01:51.559768 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:51.711245 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:51.722974 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:01:51.747975 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:01:51.801774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:51.802033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:51.802260 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Attaching volume 3bddbcb6-9106-4dec-82f3-dd915b55e626 to /dev/vdb
May 28 03:01:51.856046 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:51.869827 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:01:51.894471 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:01:51.925020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:01:51.925757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:01:51.933689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:01:51.937112 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fe5a:edc3', 'fe80::6494:58ff:fee5:6a95', 'fe80::fc16:3eff:fe49:abd3', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fe18:2e25', 'fe80::b0e3:95ff:fedf:11ae'] 
May 28 03:01:51.937413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:01:51.937784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:01:51.938297 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:51.938634 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating existing volume attachment record: f861f215-d497-4e7d-9997-d913c72f0f54 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:01:52.221768 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-472a408c-0556-4496-b6b4-38ad4df05568 req-df999f47-c733-48ce-b47c-971d1f505bb7 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-vif-deleted-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:52.222932 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-472a408c-0556-4496-b6b4-38ad4df05568 req-df999f47-c733-48ce-b47c-971d1f505bb7 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Neutron deleted interface 040ef189-c7e3-4481-bc02-9489f226ede8; detaching it from the instance and deleting it from the info cache
May 28 03:01:52.226450 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-472a408c-0556-4496-b6b4-38ad4df05568 req-df999f47-c733-48ce-b47c-971d1f505bb7 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Detach interface failed, port_id=040ef189-c7e3-4481-bc02-9489f226ede8, reason: Instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:01:52.349986 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-vif-unplugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:52.351033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] Acquiring lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:52.351343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:52.351465 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:52.351660 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] No waiting events found dispatching network-vif-unplugged-040ef189-c7e3-4481-bc02-9489f226ede8 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:52.351721 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Received event network-vif-unplugged-040ef189-c7e3-4481-bc02-9489f226ede8 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:52.351865 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-deleted-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:52.352019 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Neutron deleted interface 1710bdaa-b010-4021-80b2-f0e46e701bc6; detaching it from the instance and deleting it from the info cache
May 28 03:01:52.355648 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b86bd283-a127-40bb-a84a-9ddd43b211a8 req-dbf05033-d557-4dbb-9abf-b476a2efbdc2 service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Detach interface failed, port_id=1710bdaa-b010-4021-80b2-f0e46e701bc6, reason: Instance 1268bec3-55ce-4900-b24f-1cf398ea3b91 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:01:52.383702 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:52.420990 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3a4aba3a-5129-45d1-bc79-75345326263d req-b69e2112-1403-47a4-8ea6-1620982fa5bf service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:01:52.421133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3a4aba3a-5129-45d1-bc79-75345326263d req-b69e2112-1403-47a4-8ea6-1620982fa5bf service nova] Acquiring lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:52.421329 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3a4aba3a-5129-45d1-bc79-75345326263d req-b69e2112-1403-47a4-8ea6-1620982fa5bf service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:52.421433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3a4aba3a-5129-45d1-bc79-75345326263d req-b69e2112-1403-47a4-8ea6-1620982fa5bf service nova] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:52.421488 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3a4aba3a-5129-45d1-bc79-75345326263d req-b69e2112-1403-47a4-8ea6-1620982fa5bf service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] No waiting events found dispatching network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:01:52.421593 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3a4aba3a-5129-45d1-bc79-75345326263d req-b69e2112-1403-47a4-8ea6-1620982fa5bf service nova] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Received event network-vif-unplugged-1710bdaa-b010-4021-80b2-f0e46e701bc6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:01:52.458783 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:52.481244 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:52.509391 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:01:52.509854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bddbcb6-9106-4dec-82f3-dd915b55e626', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:01:52.510050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:52.511045 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:52.511366 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bddbcb6-9106-4dec-82f3-dd915b55e626', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:01:52.525436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:52.526024 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:01:52.526481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:52.526701 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:52.527280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:01:52.527474 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:52.528124 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0018710580000060872 future=<Future at 0x7e4b6457fc80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:52.528273 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:52.528894 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] Emitting event <LifecycleEvent: 1779937297.5261352, 88beccbb-1cf9-4e42-a123-c82ef83bb03d => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:52.529428 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.662361568000051 future=<Future at 0x7e4b78188080 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:52.529624 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.662181273999977 future=<Future at 0x7e4b78188080 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:52.529862 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] VM Stopped (Lifecycle Event)
May 28 03:01:52.537662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:52.537662 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:52.550502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:01:52.550502 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:52.555805 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626] added
May 28 03:01:52.555805 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:52.555805 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:52.555805 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:52.555805 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:52.555805 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:52.555805 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:52.556489 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:52.556489 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:52.556586 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:52.562132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626] added
May 28 03:01:52.562132 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:01:52.562132 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:52.562132 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:52.562132 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:01:52.562132 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:01:52.562132 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:52.562427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:01:52.562497 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:01:52.562663 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:01:52.673346 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:01:52.984421 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Took 1.43 seconds to deallocate network for instance.
May 28 03:01:53.033525 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9c7642d5-56da-497d-99fd-c28280b20b86 tempest-VolumesAssistedSnapshotsTest-1746170207 tempest-VolumesAssistedSnapshotsTest-1746170207-project-member] [instance: 88beccbb-1cf9-4e42-a123-c82ef83bb03d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:53.175470 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Took 1.62 seconds to deallocate network for instance.
May 28 03:01:53.490238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:53.490469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:53.557691 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:01:53.563536 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:53.573687 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:53.573687 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:01:53.576694 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:01:53.576694 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.589845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.595980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:53.606372 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:53.606372 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: 
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:53.606372 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:01:53.606372 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:01:53.606372 np0000001589 nova-compute[98297]: 
May 28 03:01:53.634465 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.40.100,3260]
May 28 03:01:53.634465 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.40.100,3260] successful.
May 28 03:01:53.634465 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.644594 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.50.100,3260]
May 28 03:01:53.644594 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.50.100,3260] successful.
May 28 03:01:53.644594 np0000001589 nova-compute[98297]:  stderr=iscsiadm: could not read session targetname: 5
May 28 03:01:53.644594 np0000001589 nova-compute[98297]: iscsiadm: could not find session info for session12
May 28 03:01:53.644594 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.649080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.654453 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:01:53.662037 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.662037 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.662037 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:53.662210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.662210 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.662210 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:53.662624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:53.662802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:53.663479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] HCTL ('7', '-', '-', 0) found on session 12 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:53.663613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:53.668180 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.668180 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.668180 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:01:53.668361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.668361 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:01:53.668361 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:01:53.668666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:53.668812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:01:53.669189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] HCTL ('8', '-', '-', 0) found on session 13 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:01:53.669332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:01:53.680144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Searching for a device in session 12 and hctl ['7', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:53.690301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:53.690301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Searching for a device in session 13 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:53.896698 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:53.896945 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:54.399616 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:54.680671 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Searching for a device in session 12 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:54.681143 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bddbcb6-9106-4dec-82f3-dd915b55e626', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:54.689074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Searching for a device in session 13 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:01:54.689275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3bddbcb6-9106-4dec-82f3-dd915b55e626', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:01:54.911305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.421s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:54.912880 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.226s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:54.980509 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Deleted allocations for instance 1268bec3-55ce-4900-b24f-1cf398ea3b91
May 28 03:01:55.192170 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00033723000001373293 future=<Future at 0x7e4b78188080 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:55.192342 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:55.192342 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.299771099000054 future=<Future at 0x7e4b645cd250 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:55.192447 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.299685680000039 future=<Future at 0x7e4b645cd250 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:01:55.192962 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Emitting event <LifecycleEvent: 1779937300.1917007, a20162bb-2296-4592-bd08-ecebb8896d46 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:01:55.193181 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] VM Stopped (Lifecycle Event)
May 28 03:01:55.249958 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:01:55.250128 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:01:55.462896 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:55.528161 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:01:55.696307 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: a20162bb-2296-4592-bd08-ecebb8896d46] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:01:55.755147 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:01:55.992753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20bf26d6-d7dc-48a1-b683-65d75d8039c8 tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "1268bec3-55ce-4900-b24f-1cf398ea3b91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.390s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:56.038319 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:56.263921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.350s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:56.320475 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Deleted allocations for instance ecd114ae-b8cc-4ea8-be10-0c43b8298e85
May 28 03:01:56.544175 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Found WWN 3300000008aaa2055 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:01:56.544427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:01:56.546020 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] <== connect_volume: return (4034ms) {'type': 'block', 'scsi_wwn': '3300000008aaa2055', 'path': '/dev/dm-0', 'multipath_id': '3300000008aaa2055'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:01:56.546020 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008aaa2055', 'path': '/dev/dm-0', 'multipath_id': '3300000008aaa2055'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:01:56.547932 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'flavor' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:01:57.050897 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Attempting to attach volume 3bddbcb6-9106-4dec-82f3-dd915b55e626 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:01:57.056080 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:01:57.056080 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:01:57.056080 np0000001589 nova-compute[98297]:   <alias name="ua-3bddbcb6-9106-4dec-82f3-dd915b55e626"/>
May 28 03:01:57.056080 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:01:57.056080 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:01:57.056080 np0000001589 nova-compute[98297]:   <serial>3bddbcb6-9106-4dec-82f3-dd915b55e626</serial>
May 28 03:01:57.056080 np0000001589 nova-compute[98297]: </disk>
May 28 03:01:57.056080 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:01:57.334389 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01994326-ab35-4064-bdc3-d4d2506f0bbe tempest-TestMultiAttachVolumeSwap-715973546 tempest-TestMultiAttachVolumeSwap-715973546-project-member] Lock "ecd114ae-b8cc-4ea8-be10-0c43b8298e85" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.816s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:01:57.459997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:58.615118 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:58.736800 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:58.736800 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:01:58.736800 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] No VIF found with MAC fa:16:3e:5a:ed:c3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:01:58.740842 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:01:58.885361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:01:58.885620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:01:59.390282 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'flavor' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:00.303113 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:00.311214 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7db48bc4-2a7c-4f9c-b98c-69f3c1d86ed3 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.509s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:00.403295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:00.637264 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:00.637710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:01.040312 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:01.140965 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:02:01.478171 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:01.478608 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:01.478608 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attaching volume 58675be1-7fd6-4b3d-b052-35953ff77261 to /dev/vdb
May 28 03:02:01.531594 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:01.544755 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:02:01.567493 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:01.601792 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:02:01.602064 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:02:01.611664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:02:01.613261 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fe5a:edc3', 'fe80::6494:58ff:fee5:6a95', 'fe80::fc16:3eff:fe49:abd3', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fe18:2e25', 'fe80::b0e3:95ff:fedf:11ae'] 
May 28 03:02:01.613402 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:02:01.613539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:02:01.613855 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:01.615503 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updating existing volume attachment record: f346703f-daa5-464f-b944-62debcecb10c {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:02:01.702796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:01.703077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:01.706130 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:02:01.706347 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Claim successful on node np0000001589
May 28 03:02:01.959622 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:02.156405 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:02.156558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:02.173462 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:02:02.174454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:02.174454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:02.174454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:02.174659 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:02:02.188210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:02.188682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:02.189037 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:02.189685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:02.190300 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:02.190532 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:02.201349 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:02.201349 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:02.205761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:02.205761 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:02.215084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261] added
May 28 03:02:02.215084 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:02.215084 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:02.215084 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:02.215084 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:02.215084 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:02.215084 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:02.215448 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:02.215562 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:02.215679 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:02.219892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261] added
May 28 03:02:02.219892 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:02.219892 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:02.219892 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:02.219892 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:02.219892 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:02.219892 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:02.220111 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:02.220193 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:02.220351 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:02.462048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:02.659180 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Detaching volume 3bddbcb6-9106-4dec-82f3-dd915b55e626
May 28 03:02:02.706857 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Attempting to driver detach volume 3bddbcb6-9106-4dec-82f3-dd915b55e626 from mountpoint /dev/vdb
May 28 03:02:02.710517 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Found disk vdb by alias ua-3bddbcb6-9106-4dec-82f3-dd915b55e626 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:02:02.711522 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Found disk vdb by alias ua-3bddbcb6-9106-4dec-82f3-dd915b55e626 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:02:02.711593 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Attempting to detach device vdb from instance f4651248-73c3-435e-842a-3858d6eb74ae from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:02:02.712045 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:02:02.712045 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:02.712045 np0000001589 nova-compute[98297]:   <alias name="ua-3bddbcb6-9106-4dec-82f3-dd915b55e626"/>
May 28 03:02:02.712045 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:02:02.712045 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:02:02.712045 np0000001589 nova-compute[98297]:   <serial>3bddbcb6-9106-4dec-82f3-dd915b55e626</serial>
May 28 03:02:02.712045 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:02:02.712045 np0000001589 nova-compute[98297]: </disk>
May 28 03:02:02.712045 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:02:02.718070 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully detached device vdb from instance f4651248-73c3-435e-842a-3858d6eb74ae from the persistent domain config.
May 28 03:02:02.718205 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] (1/8): Attempting to detach device vdb with device alias ua-3bddbcb6-9106-4dec-82f3-dd915b55e626 from instance f4651248-73c3-435e-842a-3858d6eb74ae from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:02:02.718507 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:02:02.718507 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:02.718507 np0000001589 nova-compute[98297]:   <alias name="ua-3bddbcb6-9106-4dec-82f3-dd915b55e626"/>
May 28 03:02:02.718507 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:02:02.718507 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:02:02.718507 np0000001589 nova-compute[98297]:   <serial>3bddbcb6-9106-4dec-82f3-dd915b55e626</serial>
May 28 03:02:02.718507 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:02:02.718507 np0000001589 nova-compute[98297]: </disk>
May 28 03:02:02.718507 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:02:02.999198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:02:02.999413 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:02:03.217594 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:03.221550 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:03.234382 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:03.234382 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:03.245123 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:03.245123 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.248657 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.262863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.263922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.263922 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.263922 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:03.264102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.264102 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.264102 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:03.278417 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937323.277883, f4651248-73c3-435e-842a-3858d6eb74ae => ua-3bddbcb6-9106-4dec-82f3-dd915b55e626> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:02:03.279929 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3bddbcb6-9106-4dec-82f3-dd915b55e626 for instance f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:02:03.280853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.280853 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.280853 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:03.280853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.280853 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.280853 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:03.282658 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully detached device vdb from instance f4651248-73c3-435e-842a-3858d6eb74ae from the live domain config.
May 28 03:02:03.283481 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:02:03.283793 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bddbcb6-9106-4dec-82f3-dd915b55e626', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:03.284166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:03.299621 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260]
May 28 03:02:03.299621 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260] successful.
May 28 03:02:03.299621 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.311179 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.318715 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260]
May 28 03:02:03.318715 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260] successful.
May 28 03:02:03.318715 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.327317 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.327317 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.327317 np0000001589 nova-compute[98297]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.327317 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.327317 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:03.327515 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.327515 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.327515 np0000001589 nova-compute[98297]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.327515 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.327515 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:03.328177 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.139s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:03.328378 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:03.329258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('9', '-', '-', 0) found on session 14 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:03.329417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:03.344454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:03.354214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 14 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:03.354214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:03.355855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.355855 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.355855 np0000001589 nova-compute[98297]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.355855 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.355855 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:03.356094 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.356094 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:03.356094 np0000001589 nova-compute[98297]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.356094 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:03.356094 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:03.356287 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:03.356439 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:03.357100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('10', '-', '-', 0) found on session 15 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:03.357195 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:03.381566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 15 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:03.381566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:03.502063 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:02:03.629975 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:03.876861 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:04.012074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.309s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:04.013264 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:02:04.192249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:02:04.247036 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:04.520286 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:02:04.520523 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:02:04.521336 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:04.521474 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:04.685338 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca35293e06644323b1379cbcfa028d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea07081265c14a80b849530dbb4de34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:02:05.023857 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:02:05.209325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Found WWN 33000000044380a15 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:02:05.209590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:05.209767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '33000000044380a15', 'path': '/dev/dm-1', 'multipath_id': '33000000044380a15'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:05.209908 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000044380a15', 'path': '/dev/dm-1', 'multipath_id': '33000000044380a15'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:02:05.210547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.926s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:05.211069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3bddbcb6-9106-4dec-82f3-dd915b55e626', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:02:05.211676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:02:05.212728 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'flavor' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:05.239872 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:05.239872 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:05.239872 np0000001589 nova-compute[98297]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:05.239872 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:05.239872 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:05.240085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsi session list stdout=tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:05.240085 np0000001589 nova-compute[98297]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626 (non-flash)
May 28 03:02:05.240085 np0000001589 nova-compute[98297]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:05.240085 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:05.240085 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:05.240085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '15')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:02:05.240381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', '12')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:05.241021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626', '13')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:05.241816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646d2b60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:02:05.241938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:02:05.242148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Flush multipath device 3300000008aaa2055 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:02:05.280907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:02:05.335682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:02:05.378113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:02:05.378427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:02:05.379565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:02:05.395208 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:02:05.395404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:02:05.409571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:05.448203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.40.100,3260]
May 28 03:02:05.448203 np0000001589 nova-compute[98297]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.40.100,3260] successful.
May 28 03:02:05.448203 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:05.460457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:05.471346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:05.492609 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004504549999637675 future=<Future at 0x7e4b645cd250 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:05.493142 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:05.493142 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.020327977999841096 future=<Future at 0x7e4b646fcc20 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:05.493142 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.020220708999886483 future=<Future at 0x7e4b646fcc20 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:05.493763 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Emitting event <LifecycleEvent: 1779937310.4920645, ecd114ae-b8cc-4ea8-be10-0c43b8298e85 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:05.494030 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] VM Stopped (Lifecycle Event)
May 28 03:02:05.503275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.50.100,3260]
May 28 03:02:05.503275 np0000001589 nova-compute[98297]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-3bddbcb6-9106-4dec-82f3-dd915b55e626, portal: 192.168.50.100,3260] successful.
May 28 03:02:05.503275 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:05.514101 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0008343520000835269 future=<Future at 0x7e4b646fcc20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:05.515297 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Emitting event <LifecycleEvent: 1779937310.5131233, 1268bec3-55ce-4900-b24f-1cf398ea3b91 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:05.515471 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:05.515655 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] VM Stopped (Lifecycle Event)
May 28 03:02:05.517321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:05.517549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:05.517746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] <== disconnect_volume: return (2234ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:05.517857 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:02:05.527621 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:02:05.685348 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Successfully created port: 45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:02:05.715910 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attempting to attach volume 58675be1-7fd6-4b3d-b052-35953ff77261 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:02:05.717250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:02:05.717250 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:05.717250 np0000001589 nova-compute[98297]:   <alias name="ua-58675be1-7fd6-4b3d-b052-35953ff77261"/>
May 28 03:02:05.717250 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:02:05.717250 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:02:05.717250 np0000001589 nova-compute[98297]:   <serial>58675be1-7fd6-4b3d-b052-35953ff77261</serial>
May 28 03:02:05.717250 np0000001589 nova-compute[98297]: </disk>
May 28 03:02:05.717250 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:02:05.962806 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:05.998082 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a12c6af7-fec9-4386-8bd6-fdbeca45269a tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: ecd114ae-b8cc-4ea8-be10-0c43b8298e85] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:06.021094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: 1268bec3-55ce-4900-b24f-1cf398ea3b91] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:06.041928 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:06.100244 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'flavor' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:06.111932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:06.534834 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:02:06.535768 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:02:06.535993 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Creating image(s)
May 28 03:02:06.536429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:06.536602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:06.537782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:06.537782 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:06.541220 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:06.543952 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:06.630403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:06.630919 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:06.631774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:06.632250 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:06.636115 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:06.636896 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:06.680841 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Successfully updated port: 45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:02:06.713332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.076s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:06.714102 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:06.742070 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-changed-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:06.742220 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Refreshing instance network info cache due to event network-changed-45ca207b-12db-4df0-9d88-83d537d0bb64. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:02:06.742478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] Acquiring lock "refresh_cache-ad211867-f4ec-4773-bca9-5383cde1e916" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:06.742965 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] Acquired lock "refresh_cache-ad211867-f4ec-4773-bca9-5383cde1e916" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:06.743335 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Refreshing network info cache for port 45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:02:06.756539 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk 1073741824" returned: 0 in 0.042s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:06.757056 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.125s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:06.757420 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:06.839449 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:06.840030 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:02:06.840099 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:06.921451 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:06.921930 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Cannot resize image /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:02:06.922338 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:02:06.922554 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Ensure instance console log exists: /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:02:06.922884 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:06.923148 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:06.923351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:07.183401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-ad211867-f4ec-4773-bca9-5383cde1e916" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:07.246331 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:07.339970 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:02:07.401314 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:07.401794 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:07.401972 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:07.402145 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No VIF found with MAC fa:16:3e:49:ab:d3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:02:07.463797 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:07.466582 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "interface-f4651248-73c3-435e-842a-3858d6eb74ae-33547409-b130-4398-bef1-bd41da13a093" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:07.468045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "interface-f4651248-73c3-435e-842a-3858d6eb74ae-33547409-b130-4398-bef1-bd41da13a093" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:07.613839 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:07.618152 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bfb0d7b6-0544-4c72-9684-9da90fe1302d tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.461s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:07.976461 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'flavor' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:08.116409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0506827b-1e24-446f-a3d3-f20c5ccb06d6 req-32735e1a-fd72-4398-8809-7ddc968a817f service nova] Releasing lock "refresh_cache-ad211867-f4ec-4773-bca9-5383cde1e916" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:08.116707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-ad211867-f4ec-4773-bca9-5383cde1e916" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:08.116879 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:02:08.399572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:08.485830 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:02:08.487432 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converting VIF {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:08.489507 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:08.492443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface> {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 03:02:08.496738 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface> {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 03:02:08.500420 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Attempting to detach device tap33547409-b1 from instance f4651248-73c3-435e-842a-3858d6eb74ae from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:02:08.501172 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] detach device xml: <interface type="ethernet">
May 28 03:02:08.501172 np0000001589 nova-compute[98297]:   <mac address="fa:16:3e:18:2e:25"/>
May 28 03:02:08.501172 np0000001589 nova-compute[98297]:   <model type="virtio"/>
May 28 03:02:08.501172 np0000001589 nova-compute[98297]:   <driver name="qemu"/>
May 28 03:02:08.501172 np0000001589 nova-compute[98297]:   <mtu size="1372"/>
May 28 03:02:08.501172 np0000001589 nova-compute[98297]:   <target dev="tap33547409-b1"/>
May 28 03:02:08.501172 np0000001589 nova-compute[98297]: </interface>
May 28 03:02:08.501172 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:02:08.505571 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface> {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 03:02:08.509372 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface>not found in domain: <domain type='qemu' id='9'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <name>instance-00000009</name>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <uuid>f4651248-73c3-435e-842a-3858d6eb74ae</uuid>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:package version="33.1.0"/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:creationTime>2026-05-28 03:01:47</nova:creationTime>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:flavor name="m1.nano" id="42">
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:memory>192</nova:memory>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:disk>1</nova:disk>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:swap>0</nova:swap>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:vcpus>1</nova:vcpus>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:extraSpecs>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </nova:extraSpecs>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </nova:flavor>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:minDisk>1</nova:minDisk>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:minRam>0</nova:minRam>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:properties>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </nova:properties>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </nova:image>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:owner>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </nova:owner>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <nova:ports>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <nova:port uuid="33547409-b130-4398-bef1-bd41da13a093">
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.10.10.140" ipVersion="4"/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </nova:ports>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]: </nova:instance>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <memory unit='KiB'>196608</memory>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <vcpu placement='static'>1</vcpu>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <resource>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <partition>/machine</partition>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </resource>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <sysinfo type='smbios'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <entry name='product'>OpenStack Nova</entry>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <entry name='version'>33.1.0</entry>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <entry name='serial'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <entry name='uuid'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <entry name='family'>Virtual Machine</entry>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <boot dev='hd'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <smbios mode='sysinfo'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <vmcoreinfo state='on'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <cpu mode='custom' match='exact' check='full'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <model fallback='forbid'>Nehalem</model>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <feature policy='require' name='hypervisor'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <clock offset='utc'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <on_poweroff>destroy</on_poweroff>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <on_reboot>restart</on_reboot>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <on_crash>destroy</on_crash>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <disk type='file' device='disk'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk' index='2'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <backingStore type='file' index='3'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:         <format type='raw'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:         <source file='/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:         <backingStore/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       </backingStore>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <target dev='vda' bus='virtio'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='virtio-disk0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <disk type='file' device='cdrom'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <driver name='qemu' type='raw' cache='none'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config' index='1'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <backingStore/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <target dev='hda' bus='ide'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <readonly/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='ide0-0-0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <controller type='usb' index='0' model='none'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='usb'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <controller type='pci' index='0' model='pci-root'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='pci.0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <controller type='ide' index='0'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='ide'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <interface type='ethernet'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <mac address='fa:16:3e:5a:ed:c3'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <target dev='tapaefcb3f3-45'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <model type='virtio'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <driver name='qemu'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <mtu size='1372'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='net0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <interface type='ethernet'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <mac address='fa:16:3e:18:2e:25'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <target dev='tap33547409-b1'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <model type='virtio'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <driver name='qemu'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <mtu size='1372'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='net1'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <serial type='pty'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <target type='isa-serial' port='0'>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:         <model name='isa-serial'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       </target>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:08.509372 np0000001589 nova-compute[98297]:     <console type='pty' tty='/dev/pts/1'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <target type='serial' port='0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     </console>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <input type='mouse' bus='ps2'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <alias name='input0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <input type='keyboard' bus='ps2'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <alias name='input1'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <listen type='address' address='0.0.0.0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     </graphics>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <audio id='1' type='none'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <model type='virtio' heads='1' primary='yes'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <alias name='video0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <stats period='10'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <alias name='balloon0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <rng model='virtio'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <backend model='random'>/dev/urandom</backend>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <alias name='rng0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <label>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</label>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <imagelabel>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</imagelabel>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <label>+64055:+993</label>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:     <imagelabel>+64055:+993</imagelabel>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:  {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 03:02:08.512849 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully detached device tap33547409-b1 from instance f4651248-73c3-435e-842a-3858d6eb74ae from the persistent domain config.
May 28 03:02:08.512849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] (1/8): Attempting to detach device tap33547409-b1 with device alias net1 from instance f4651248-73c3-435e-842a-3858d6eb74ae from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:02:08.512849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] detach device xml: <interface type="ethernet">
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   <mac address="fa:16:3e:18:2e:25"/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   <model type="virtio"/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   <driver name="qemu"/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   <mtu size="1372"/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:   <target dev="tap33547409-b1"/>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]: </interface>
May 28 03:02:08.512849 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:02:08.721801 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:02:08.983000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59a286d1-ecfc-409e-b565-03f8cbfa6269 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.501s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:09.068956 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:09.326281 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Updating instance_info_cache with network_info: [{"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:09.680018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.693435 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937329.691937, f4651248-73c3-435e-842a-3858d6eb74ae => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:02:09.696092 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Start waiting for the detach event from libvirt for device tap33547409-b1 with device alias net1 for instance f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:02:09.697553 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface> {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 03:02:09.700183 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface>not found in domain: <domain type='qemu' id='9'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <name>instance-00000009</name>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <uuid>f4651248-73c3-435e-842a-3858d6eb74ae</uuid>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:package version="33.1.0"/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:creationTime>2026-05-28 03:01:47</nova:creationTime>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:flavor name="m1.nano" id="42">
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:memory>192</nova:memory>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:disk>1</nova:disk>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:swap>0</nova:swap>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:vcpus>1</nova:vcpus>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:extraSpecs>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </nova:extraSpecs>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </nova:flavor>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:minDisk>1</nova:minDisk>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:minRam>0</nova:minRam>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:properties>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </nova:properties>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </nova:image>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:owner>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </nova:owner>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <nova:ports>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <nova:port uuid="33547409-b130-4398-bef1-bd41da13a093">
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.10.10.140" ipVersion="4"/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </nova:ports>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]: </nova:instance>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <memory unit='KiB'>196608</memory>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <vcpu placement='static'>1</vcpu>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <resource>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <partition>/machine</partition>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </resource>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <sysinfo type='smbios'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <entry name='product'>OpenStack Nova</entry>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <entry name='version'>33.1.0</entry>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <entry name='serial'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <entry name='uuid'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <entry name='family'>Virtual Machine</entry>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <boot dev='hd'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <smbios mode='sysinfo'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <vmcoreinfo state='on'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <cpu mode='custom' match='exact' check='full'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <model fallback='forbid'>Nehalem</model>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <feature policy='require' name='hypervisor'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <clock offset='utc'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <on_poweroff>destroy</on_poweroff>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <on_reboot>restart</on_reboot>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <on_crash>destroy</on_crash>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <disk type='file' device='disk'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk' index='2'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <backingStore type='file' index='3'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:         <format type='raw'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:         <source file='/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:         <backingStore/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       </backingStore>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <target dev='vda' bus='virtio'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='virtio-disk0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <disk type='file' device='cdrom'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <driver name='qemu' type='raw' cache='none'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config' index='1'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <backingStore/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <target dev='hda' bus='ide'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <readonly/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='ide0-0-0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <controller type='usb' index='0' model='none'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='usb'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <controller type='pci' index='0' model='pci-root'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='pci.0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <controller type='ide' index='0'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='ide'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <interface type='ethernet'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <mac address='fa:16:3e:5a:ed:c3'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <target dev='tapaefcb3f3-45'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <model type='virtio'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <driver name='qemu'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <mtu size='1372'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='net0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <serial type='pty'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <target type='isa-serial' port='0'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:         <model name='isa-serial'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       </target>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <console type='pty' tty='/dev/pts/1'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <target type='serial' port='0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </console>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <input type='mouse' bus='ps2'>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:       <alias name='input0'/>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:09.700183 np0000001589 nova-compute[98297]:     <input type='keyboard' bus='ps2'>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <alias name='input1'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <listen type='address' address='0.0.0.0'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     </graphics>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <audio id='1' type='none'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <model type='virtio' heads='1' primary='yes'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <alias name='video0'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <stats period='10'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <alias name='balloon0'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <rng model='virtio'>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <backend model='random'>/dev/urandom</backend>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <alias name='rng0'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <label>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</label>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <imagelabel>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</imagelabel>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <label>+64055:+993</label>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:     <imagelabel>+64055:+993</imagelabel>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:09.708198 np0000001589 nova-compute[98297]:  {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 03:02:09.708198 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully detached device tap33547409-b1 from instance f4651248-73c3-435e-842a-3858d6eb74ae from the live domain config.
May 28 03:02:09.708198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:02:09.710253 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converting VIF {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:09.710253 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:09.710253 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:02:09.710253 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.710253 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.710253 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33547409-b1, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:09.712108 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.713833 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:09.716089 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.716520 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19a93c0d-6437-4b2b-b9cf-2121f14b2208) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:09.717013 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.718193 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:09.718482 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.722340 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.727448 np0000001589 nova-compute[98297]: INFO os_vif [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1')
May 28 03:02:09.728592 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2072436584', uuid='f4651248-73c3-435e-842a-3858d6eb74ae'), owner=OwnerMeta(userid='0546cf4892194fb0b81f60e06176325e', username='tempest-TaggedAttachmentsTest-1991660198-project-member', projectid='55c603cee4ca4e5e8665159f4cd59021', projectname='tempest-TaggedAttachmentsTest-1991660198'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937329.7281647) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:02:09.729335 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:package version="33.1.0"/>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:creationTime>2026-05-28 03:02:09</nova:creationTime>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:flavor name="m1.nano" id="42">
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:memory>192</nova:memory>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:disk>1</nova:disk>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:swap>0</nova:swap>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:vcpus>1</nova:vcpus>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:extraSpecs>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     </nova:extraSpecs>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   </nova:flavor>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:minDisk>1</nova:minDisk>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:minRam>0</nova:minRam>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:properties>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     </nova:properties>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   </nova:image>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:owner>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   </nova:owner>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   <nova:ports>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:   </nova:ports>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]: </nova:instance>
May 28 03:02:09.729335 np0000001589 nova-compute[98297]:  {{(pid=98297) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 03:02:09.731307 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:09.731599 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:09.746847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.749079 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:09.831836 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-ad211867-f4ec-4773-bca9-5383cde1e916" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:09.832676 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Instance network_info: |[{"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:02:09.835595 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Start _get_guest_xml network_info=[{"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:02:09.840545 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:02:09.842610 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-129358001', uuid='ad211867-f4ec-4773-bca9-5383cde1e916'), owner=OwnerMeta(userid='ca35293e06644323b1379cbcfa028d87', username='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member', projectid='ea07081265c14a80b849530dbb4de34a', projectname='tempest-ServerBootFromVolumeStableRescueTest-1646172629'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937329.8421094) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:02:09.846120 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:02:09.847244 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:02:09.849778 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:02:09.850942 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:02:09.852310 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:02:09.854240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:02:09.854626 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:02:09.854781 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:02:09.872933 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-129358001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-129358001',id=12,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-t0qwf0qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:06Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=ad211867-f4ec-4773-bca9-5383cde1e916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:02:09.873547 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:09.874103 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f9:40,bridge_name='br-int',has_traffic_filtering=True,id=45ca207b-12db-4df0-9d88-83d537d0bb64,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ca207b-12') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:09.874834 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'pci_devices' on Instance uuid ad211867-f4ec-4773-bca9-5383cde1e916 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:10.116877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.378328 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] End _get_guest_xml xml=<domain type="qemu">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <uuid>ad211867-f4ec-4773-bca9-5383cde1e916</uuid>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <name>instance-0000000c</name>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-129358001</nova:name>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:02:09</nova:creationTime>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:user uuid="ca35293e06644323b1379cbcfa028d87">tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member</nova:user>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:project uuid="ea07081265c14a80b849530dbb4de34a">tempest-ServerBootFromVolumeStableRescueTest-1646172629</nova:project>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         <nova:port uuid="45ca207b-12db-4df0-9d88-83d537d0bb64">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <entry name="serial">ad211867-f4ec-4773-bca9-5383cde1e916</entry>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <entry name="uuid">ad211867-f4ec-4773-bca9-5383cde1e916</entry>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk.config"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:c3:f9:40"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <target dev="tap45ca207b-12"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/console.log" append="off"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:10.378328 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:02:10.380653 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Preparing to wait for external event network-vif-plugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:02:10.380653 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:10.380653 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:10.380653 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:10.380653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-129358001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-129358001',id=12,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-t0qwf0qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:06Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=ad211867-f4ec-4773-bca9-5383cde1e916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:02:10.381002 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:10.382767 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f9:40,bridge_name='br-int',has_traffic_filtering=True,id=45ca207b-12db-4df0-9d88-83d537d0bb64,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ca207b-12') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:10.382876 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f9:40,bridge_name='br-int',has_traffic_filtering=True,id=45ca207b-12db-4df0-9d88-83d537d0bb64,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ca207b-12') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:02:10.385823 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.385823 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:10.386063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:02:10.386692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.386847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39e25ad3-1933-593c-91d3-7e3d8bf8aa7c', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:10.387961 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.389591 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:10.389591 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.393486 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.393486 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45ca207b-12, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:10.393486 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45ca207b-12, col_values=(('qos', UUID('5dc3b699-e220-42ea-8f8e-3af63a6cb56a')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:10.393486 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45ca207b-12, col_values=(('external_ids', {'iface-id': '45ca207b-12db-4df0-9d88-83d537d0bb64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:f9:40', 'vm-uuid': 'ad211867-f4ec-4773-bca9-5383cde1e916'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:10.394809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.396160 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:10.403251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:10.403251 np0000001589 nova-compute[98297]: INFO os_vif [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f9:40,bridge_name='br-int',has_traffic_filtering=True,id=45ca207b-12db-4df0-9d88-83d537d0bb64,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ca207b-12')
May 28 03:02:11.025755 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Rebuilding instance
May 28 03:02:11.240005 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:11.292399 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-deleted-33547409-b130-4398-bef1-bd41da13a093 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:11.293494 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Neutron deleted interface 33547409-b130-4398-bef1-bd41da13a093; detaching it from the instance and deleting it from the info cache
May 28 03:02:11.298049 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Lazy-loading 'system_metadata' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:11.806121 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Lazy-loading 'flavor' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:11.921848 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:11.922017 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:11.922200 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No VIF found with MAC fa:16:3e:c3:f9:40, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:02:11.922639 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Using config drive
May 28 03:02:12.113002 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.280959 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.282762 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.304641 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.314030 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Object Instance<f4651248-73c3-435e-842a-3858d6eb74ae> lazy-loaded attributes: system_metadata,flavor {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:12.314615 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001589',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:02:12.314833 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Converting VIF {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:12.315436 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:12.321271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface> {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 03:02:12.322950 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface>not found in domain: <domain type='qemu' id='9'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <name>instance-00000009</name>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <uuid>f4651248-73c3-435e-842a-3858d6eb74ae</uuid>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:package version="33.1.0"/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:creationTime>2026-05-28 03:02:09</nova:creationTime>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:flavor name="m1.nano" id="42">
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:memory>192</nova:memory>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:disk>1</nova:disk>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:swap>0</nova:swap>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:vcpus>1</nova:vcpus>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:extraSpecs>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </nova:extraSpecs>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </nova:flavor>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:minDisk>1</nova:minDisk>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:minRam>0</nova:minRam>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:properties>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </nova:properties>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </nova:image>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:owner>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </nova:owner>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <nova:ports>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </nova:ports>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]: </nova:instance>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <memory unit='KiB'>196608</memory>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <vcpu placement='static'>1</vcpu>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <resource>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <partition>/machine</partition>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </resource>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <sysinfo type='smbios'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <entry name='product'>OpenStack Nova</entry>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <entry name='version'>33.1.0</entry>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <entry name='serial'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <entry name='uuid'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <entry name='family'>Virtual Machine</entry>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <boot dev='hd'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <smbios mode='sysinfo'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <vmcoreinfo state='on'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <cpu mode='custom' match='exact' check='full'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <model fallback='forbid'>Nehalem</model>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <feature policy='require' name='hypervisor'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <clock offset='utc'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <on_poweroff>destroy</on_poweroff>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <on_reboot>restart</on_reboot>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <on_crash>destroy</on_crash>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <disk type='file' device='disk'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk' index='2'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <backingStore type='file' index='3'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:         <format type='raw'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:         <source file='/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:         <backingStore/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       </backingStore>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <target dev='vda' bus='virtio'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='virtio-disk0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <disk type='file' device='cdrom'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <driver name='qemu' type='raw' cache='none'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config' index='1'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <backingStore/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <target dev='hda' bus='ide'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <readonly/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='ide0-0-0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <controller type='usb' index='0' model='none'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='usb'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <controller type='pci' index='0' model='pci-root'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='pci.0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <controller type='ide' index='0'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='ide'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <interface type='ethernet'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <mac address='fa:16:3e:5a:ed:c3'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <target dev='tapaefcb3f3-45'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <model type='virtio'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <driver name='qemu'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <mtu size='1372'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='net0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <serial type='pty'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <target type='isa-serial' port='0'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:         <model name='isa-serial'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       </target>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <console type='pty' tty='/dev/pts/1'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <target type='serial' port='0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </console>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <input type='mouse' bus='ps2'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='input0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <input type='keyboard' bus='ps2'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <alias name='input1'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:       <listen type='address' address='0.0.0.0'/>
May 28 03:02:12.322950 np0000001589 nova-compute[98297]:     </graphics>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <audio id='1' type='none'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <model type='virtio' heads='1' primary='yes'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <alias name='video0'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <stats period='10'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <alias name='balloon0'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <rng model='virtio'>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <backend model='random'>/dev/urandom</backend>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <alias name='rng0'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <label>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</label>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <imagelabel>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</imagelabel>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <label>+64055:+993</label>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:     <imagelabel>+64055:+993</imagelabel>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:12.327158 np0000001589 nova-compute[98297]:  {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 03:02:12.327158 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface> {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 28 03:02:12.333342 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:18:2e:25"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap33547409-b1"/></interface>not found in domain: <domain type='qemu' id='9'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <name>instance-00000009</name>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <uuid>f4651248-73c3-435e-842a-3858d6eb74ae</uuid>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:package version="33.1.0"/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:creationTime>2026-05-28 03:02:09</nova:creationTime>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:flavor name="m1.nano" id="42">
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:memory>192</nova:memory>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:disk>1</nova:disk>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:swap>0</nova:swap>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:vcpus>1</nova:vcpus>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:extraSpecs>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </nova:extraSpecs>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </nova:flavor>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:minDisk>1</nova:minDisk>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:minRam>0</nova:minRam>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:properties>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </nova:properties>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </nova:image>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:owner>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </nova:owner>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <nova:ports>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </nova:ports>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]: </nova:instance>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <memory unit='KiB'>196608</memory>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <currentMemory unit='KiB'>196608</currentMemory>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <vcpu placement='static'>1</vcpu>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <resource>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <partition>/machine</partition>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </resource>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <sysinfo type='smbios'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <entry name='product'>OpenStack Nova</entry>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <entry name='version'>33.1.0</entry>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <entry name='serial'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <entry name='uuid'>f4651248-73c3-435e-842a-3858d6eb74ae</entry>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <entry name='family'>Virtual Machine</entry>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <boot dev='hd'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <smbios mode='sysinfo'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <vmcoreinfo state='on'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <tb-cache unit='KiB'>131072</tb-cache>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <cpu mode='custom' match='exact' check='full'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <model fallback='forbid'>Nehalem</model>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <feature policy='require' name='hypervisor'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <clock offset='utc'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <on_poweroff>destroy</on_poweroff>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <on_reboot>restart</on_reboot>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <on_crash>destroy</on_crash>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <disk type='file' device='disk'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <driver name='qemu' type='qcow2' cache='none'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk' index='2'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <backingStore type='file' index='3'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:         <format type='raw'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:         <source file='/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:         <backingStore/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       </backingStore>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <target dev='vda' bus='virtio'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='virtio-disk0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <disk type='file' device='cdrom'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <driver name='qemu' type='raw' cache='none'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <source file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/disk.config' index='1'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <backingStore/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <target dev='hda' bus='ide'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <readonly/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='ide0-0-0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <controller type='usb' index='0' model='none'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='usb'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <controller type='pci' index='0' model='pci-root'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='pci.0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <controller type='ide' index='0'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='ide'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </controller>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <interface type='ethernet'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <mac address='fa:16:3e:5a:ed:c3'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <target dev='tapaefcb3f3-45'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <model type='virtio'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <driver name='qemu'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <mtu size='1372'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='net0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <serial type='pty'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <target type='isa-serial' port='0'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:         <model name='isa-serial'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       </target>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <console type='pty' tty='/dev/pts/1'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <source path='/dev/pts/1'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <log file='/opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae/console.log' append='off'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <target type='serial' port='0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='serial0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </console>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <input type='mouse' bus='ps2'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='input0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <input type='keyboard' bus='ps2'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <alias name='input1'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </input>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     <graphics type='vnc' port='5901' autoport='yes' listen='0.0.0.0'>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:       <listen type='address' address='0.0.0.0'/>
May 28 03:02:12.333342 np0000001589 nova-compute[98297]:     </graphics>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <audio id='1' type='none'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <model type='virtio' heads='1' primary='yes'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <alias name='video0'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <stats period='10'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <alias name='balloon0'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <rng model='virtio'>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <backend model='random'>/dev/urandom</backend>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <alias name='rng0'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <label>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</label>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <imagelabel>libvirt-f4651248-73c3-435e-842a-3858d6eb74ae</imagelabel>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <label>+64055:+993</label>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:     <imagelabel>+64055:+993</imagelabel>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:   </seclabel>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:12.337268 np0000001589 nova-compute[98297]:  {{(pid=98297) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 28 03:02:12.337268 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Detaching interface fa:16:3e:18:2e:25 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap33547409-b1' not found.
May 28 03:02:12.337268 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001589',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:02:12.338060 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Converting VIF {"id": "33547409-b130-4398-bef1-bd41da13a093", "address": "fa:16:3e:18:2e:25", "network": {"id": "5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-245485250", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.140", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33547409-b1", "ovs_interfaceid": "33547409-b130-4398-bef1-bd41da13a093", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:12.338060 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:12.338060 np0000001589 nova-compute[98297]: DEBUG os_vif [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:02:12.338060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.338060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33547409-b1, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:12.338060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:02:12.342683 np0000001589 nova-compute[98297]: INFO os_vif [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:2e:25,bridge_name='br-int',has_traffic_filtering=True,id=33547409-b130-4398-bef1-bd41da13a093,network=Network(5b864cdb-6f8e-48e9-a9fe-fdf85dafcc66),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33547409-b1')
May 28 03:02:12.344030 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-2072436584', uuid='f4651248-73c3-435e-842a-3858d6eb74ae'), owner=OwnerMeta(userid='0546cf4892194fb0b81f60e06176325e', username='tempest-TaggedAttachmentsTest-1991660198-project-member', projectid='55c603cee4ca4e5e8665159f4cd59021', projectname='tempest-TaggedAttachmentsTest-1991660198'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937332.3432853) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:02:12.344975 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:package version="33.1.0"/>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:name>tempest-device-tagging-server-2072436584</nova:name>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:creationTime>2026-05-28 03:02:12</nova:creationTime>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:flavor name="m1.nano" id="42">
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:memory>192</nova:memory>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:disk>1</nova:disk>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:swap>0</nova:swap>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:vcpus>1</nova:vcpus>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:extraSpecs>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     </nova:extraSpecs>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   </nova:flavor>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:minDisk>1</nova:minDisk>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:minRam>0</nova:minRam>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:properties>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     </nova:properties>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   </nova:image>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:owner>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:user uuid="0546cf4892194fb0b81f60e06176325e">tempest-TaggedAttachmentsTest-1991660198-project-member</nova:user>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:project uuid="55c603cee4ca4e5e8665159f4cd59021">tempest-TaggedAttachmentsTest-1991660198</nova:project>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   </nova:owner>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   <nova:ports>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     <nova:port uuid="aefcb3f3-4513-4238-8126-bff01f489cf6">
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:       <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:     </nova:port>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:   </nova:ports>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]: </nova:instance>
May 28 03:02:12.344975 np0000001589 nova-compute[98297]:  {{(pid=98297) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 28 03:02:12.349613 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-117c3652-7e3b-4509-b6a1-f27b0a927772 req-570149fc-5a7d-43a4-b980-6ca036ddd380 service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:12.428809 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:12.467540 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.472364 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a766191d-b1c0-43b1-b08a-d3229f1101b5 req-a68c1c5e-3bf5-4146-bfb9-7b8da41351f5 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:12.472551 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a766191d-b1c0-43b1-b08a-d3229f1101b5 req-a68c1c5e-3bf5-4146-bfb9-7b8da41351f5 service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:12.472742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a766191d-b1c0-43b1-b08a-d3229f1101b5 req-a68c1c5e-3bf5-4146-bfb9-7b8da41351f5 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:12.472742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a766191d-b1c0-43b1-b08a-d3229f1101b5 req-a68c1c5e-3bf5-4146-bfb9-7b8da41351f5 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:12.473073 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a766191d-b1c0-43b1-b08a-d3229f1101b5 req-a68c1c5e-3bf5-4146-bfb9-7b8da41351f5 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] No waiting events found dispatching network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:12.473073 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a766191d-b1c0-43b1-b08a-d3229f1101b5 req-a68c1c5e-3bf5-4146-bfb9-7b8da41351f5 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received unexpected event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd for instance with vm_state active and task_state rebuilding.
May 28 03:02:12.491184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.503164 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:12.627112 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999638319000042 future=<Future at 0x7e4b64507f50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:12.627734 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance destroyed successfully.
May 28 03:02:12.627990 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998727342000166 future=<Future at 0x7e4b64507f50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:12.628096 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998603772000024 future=<Future at 0x7e4b64507f50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:12.676394 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Creating config drive at /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk.config
May 28 03:02:12.682717 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnyxlyvn4 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:12.725432 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:12.725598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquired lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:12.727920 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:02:12.734717 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Detaching volume 58675be1-7fd6-4b3d-b052-35953ff77261
May 28 03:02:12.748557 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnyxlyvn4" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:12.798942 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attempting to driver detach volume 58675be1-7fd6-4b3d-b052-35953ff77261 from mountpoint /dev/vdb
May 28 03:02:12.806516 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Found disk vdb by alias ua-58675be1-7fd6-4b3d-b052-35953ff77261 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:02:12.806516 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Attempting to detach device vdb from instance a6d1b015-c35f-4563-be6b-754693ecbe8d from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:02:12.806516 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:02:12.806516 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:12.806516 np0000001589 nova-compute[98297]:   <alias name="ua-58675be1-7fd6-4b3d-b052-35953ff77261"/>
May 28 03:02:12.806516 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:02:12.806516 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:02:12.806516 np0000001589 nova-compute[98297]:   <serial>58675be1-7fd6-4b3d-b052-35953ff77261</serial>
May 28 03:02:12.806516 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:02:12.806516 np0000001589 nova-compute[98297]: </disk>
May 28 03:02:12.806516 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:02:12.817460 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully detached device vdb from instance a6d1b015-c35f-4563-be6b-754693ecbe8d from the persistent domain config.
May 28 03:02:12.818731 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:02:12.818731 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:12.818923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:12.819264 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:12.821449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:02:12.821449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:12.854251 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:12.854251 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5', '16')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:02:12.854251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '14')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:12.856368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '15')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:12.857108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b800a5bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:02:12.857375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:02:12.858135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flush multipath device 33000000044380a15 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:02:12.890658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:02:12.938653 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:02:12.983464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:02:12.983464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:02:12.983566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:02:13.002070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:02:13.002070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:02:13.027474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:13.064932 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260]
May 28 03:02:13.064932 np0000001589 nova-compute[98297]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260] successful.
May 28 03:02:13.064932 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:13.078392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:13.092156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:13.116665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260]
May 28 03:02:13.116665 np0000001589 nova-compute[98297]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260] successful.
May 28 03:02:13.116665 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:13.129768 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:13.130029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:13.130174 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== disconnect_volume: return (311ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:13.130411 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:02:13.229936 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:13.296605 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:13.329085 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:13.441905 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:13.679779 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:13.689063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:13.690899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:13.717426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:13.728098 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.092281 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:14.221425 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance destroyed successfully.
May 28 03:02:14.222796 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1347059805',display_name='tempest-ServerActionsTestOtherA-server-1451633244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-tempest-common-compute-instance-1347059805',id=10,image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3H3xbkuEJFp5BVC9tKLUKzuY22S28zMPGvGibNwb7aG9A8j7iR2rOpJXsWGV+ZFxoYlaqtGtx5+IK7e6ZVXbzZE2A6Oh/00/TmK0lxprE9tXtzjPsvTuUyPdpOpxd10A==',key_name='tempest-keypair-1895656678',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:19Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-7xlcz90c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=a6d1b015-c35f-4563-be6b-754693ecbe8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:02:14.223035 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:14.223880 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:14.224205 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:02:14.226980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.228155 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82527285-98, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:14.230071 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.230988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:14.231158 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.231992 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.232133 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e69828ac-a727-4627-86e9-7703cf0a123d) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:14.233436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.233547 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:14.234465 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.239616 np0000001589 nova-compute[98297]: INFO os_vif [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98')
May 28 03:02:14.240842 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:02:14.241187 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:14.241297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:14.242430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:14.242889 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:02:14.243071 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:02:14.273136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:14.273136 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:14.273136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:14.273136 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:14.273375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5', '16')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:02:14.273375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:14.277897 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:02:14.277989 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:14.278125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:02:14.278299 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64451e40>, {}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:02:14.278427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Disconnecting from: [] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:02:14.278565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.037s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:14.278640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== disconnect_volume: return (37ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:14.278754 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:02:14.279249 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Deleting instance files /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d_del
May 28 03:02:14.280286 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Deletion of /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d_del complete
May 28 03:02:14.302071 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937334.3016593, ad211867-f4ec-4773-bca9-5383cde1e916 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:14.302161 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] VM Started (Lifecycle Event)
May 28 03:02:14.435810 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [{"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:14.553423 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:14.568800 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-562351fe-0223-4c51-bd4a-19254dae5113 req-732833d4-2707-47f1-a941-4fa9e3b37728 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:14.568800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-562351fe-0223-4c51-bd4a-19254dae5113 req-732833d4-2707-47f1-a941-4fa9e3b37728 service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:14.568800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-562351fe-0223-4c51-bd4a-19254dae5113 req-732833d4-2707-47f1-a941-4fa9e3b37728 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:14.568800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-562351fe-0223-4c51-bd4a-19254dae5113 req-732833d4-2707-47f1-a941-4fa9e3b37728 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:14.568800 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-562351fe-0223-4c51-bd4a-19254dae5113 req-732833d4-2707-47f1-a941-4fa9e3b37728 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] No waiting events found dispatching network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:14.569879 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-562351fe-0223-4c51-bd4a-19254dae5113 req-732833d4-2707-47f1-a941-4fa9e3b37728 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received unexpected event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd for instance with vm_state active and task_state rebuilding.
May 28 03:02:14.805109 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:14.808353 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937334.806764, ad211867-f4ec-4773-bca9-5383cde1e916 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:14.808353 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] VM Paused (Lifecycle Event)
May 28 03:02:14.939144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Releasing lock "refresh_cache-f4651248-73c3-435e-842a-3858d6eb74ae" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:15.292017 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Booting with volume 58675be1-7fd6-4b3d-b052-35953ff77261 at /dev/vdb
May 28 03:02:15.310049 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:15.313636 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:15.345383 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:15.359577 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:02:15.388462 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:15.431059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:02:15.431059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:02:15.441241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:02:15.442288 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fe5a:edc3', 'fe80::6494:58ff:fee5:6a95', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea'] 
May 28 03:02:15.442417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:02:15.442583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:02:15.442872 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:15.442996 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updating existing volume attachment record: 223f42c6-b6a1-407b-aa62-6001661fd2b9 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:02:15.450732 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc9f891a-9aeb-4d1a-85b1-063ba18d0e39 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "interface-f4651248-73c3-435e-842a-3858d6eb74ae-33547409-b130-4398-bef1-bd41da13a093" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 7.983s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:15.817791 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:02:15.853910 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:16.635245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:16.635245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:16.635245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:16.635245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:16.635245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:16.636605 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Terminating instance
May 28 03:02:16.683616 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d25eac3e-bbee-4a98-be13-4108a68c2004 req-4b046121-8318-49ae-8918-0b980622bdab service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:16.683877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d25eac3e-bbee-4a98-be13-4108a68c2004 req-4b046121-8318-49ae-8918-0b980622bdab service nova] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:16.684039 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d25eac3e-bbee-4a98-be13-4108a68c2004 req-4b046121-8318-49ae-8918-0b980622bdab service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:16.684196 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d25eac3e-bbee-4a98-be13-4108a68c2004 req-4b046121-8318-49ae-8918-0b980622bdab service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:16.684379 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d25eac3e-bbee-4a98-be13-4108a68c2004 req-4b046121-8318-49ae-8918-0b980622bdab service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] No event matching network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 in dict_keys([('network-vif-plugged', '45ca207b-12db-4df0-9d88-83d537d0bb64')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:02:16.684558 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d25eac3e-bbee-4a98-be13-4108a68c2004 req-4b046121-8318-49ae-8918-0b980622bdab service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received unexpected event network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 for instance with vm_state building and task_state spawning.
May 28 03:02:17.142624 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:02:17.173947 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.193765 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.196115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.219804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.449014 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.464476 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.467829 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.484308 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999648219000164 future=<Future at 0x7e4b64498770 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:17.485461 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Instance destroyed successfully.
May 28 03:02:17.486080 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lazy-loading 'resources' on Instance uuid f4651248-73c3-435e-842a-3858d6eb74ae {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:17.592455 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:02:17.592455 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Creating image(s)
May 28 03:02:17.592685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:17.592885 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:17.593628 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:17.594838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "7f2d95f28427062f745e4f2db8e556f4bf0558c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:17.594838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "7f2d95f28427062f745e4f2db8e556f4bf0558c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:17.977646 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:17.992626 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2072436584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-2072436584',id=9,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOlRrUu75BDp0nDePNmDymziR6tFFTY+EOboFnPVodDm0gBvdmi9F/1lC/GZfLWr8N8TrJEM2PEWEO3m8kln72SP86BMZkbIiVKN0fqYUBrGle+g4AefT79TWFTcJmmpA==',key_name='tempest-keypair-1498916093',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='55c603cee4ca4e5e8665159f4cd59021',ramdisk_id='',reservation_id='r-kmhpjc22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1991660198',owner_user_name='tempest-TaggedAttachmentsTest-1991660198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:01:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0546cf4892194fb0b81f60e06176325e',uuid=f4651248-73c3-435e-842a-3858d6eb74ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:02:17.995195 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converting VIF {"id": "aefcb3f3-4513-4238-8126-bff01f489cf6", "address": "fa:16:3e:5a:ed:c3", "network": {"id": "2ba295a3-f501-4809-b860-6b6cb475472f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-860064993-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "55c603cee4ca4e5e8665159f4cd59021", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaefcb3f3-45", "ovs_interfaceid": "aefcb3f3-4513-4238-8126-bff01f489cf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:17.997101 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:ed:c3,bridge_name='br-int',has_traffic_filtering=True,id=aefcb3f3-4513-4238-8126-bff01f489cf6,network=Network(2ba295a3-f501-4809-b860-6b6cb475472f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefcb3f3-45') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:18.000742 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:ed:c3,bridge_name='br-int',has_traffic_filtering=True,id=aefcb3f3-4513-4238-8126-bff01f489cf6,network=Network(2ba295a3-f501-4809-b860-6b6cb475472f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefcb3f3-45') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:02:18.002654 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:18.002654 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaefcb3f3-45, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:18.005178 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:18.008850 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:18.014754 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:18.014920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5e06804-259e-4f30-bfcc-1a78ccb90b53) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:18.022296 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:18.026317 np0000001589 nova-compute[98297]: INFO os_vif [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:ed:c3,bridge_name='br-int',has_traffic_filtering=True,id=aefcb3f3-4513-4238-8126-bff01f489cf6,network=Network(2ba295a3-f501-4809-b860-6b6cb475472f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaefcb3f3-45')
May 28 03:02:18.026740 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Deleting instance files /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae_del
May 28 03:02:18.027917 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Deletion of /opt/stack/data/nova/instances/f4651248-73c3-435e-842a-3858d6eb74ae_del complete
May 28 03:02:18.058864 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-03a849e1-dfff-4aa2-a46a-63eaa0c7ced8 req-4975a1df-fa52-4fb4-8d66-625a91ce3c4e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-unplugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:18.058864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-03a849e1-dfff-4aa2-a46a-63eaa0c7ced8 req-4975a1df-fa52-4fb4-8d66-625a91ce3c4e service nova] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:18.058864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-03a849e1-dfff-4aa2-a46a-63eaa0c7ced8 req-4975a1df-fa52-4fb4-8d66-625a91ce3c4e service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:18.058864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-03a849e1-dfff-4aa2-a46a-63eaa0c7ced8 req-4975a1df-fa52-4fb4-8d66-625a91ce3c4e service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:18.058864 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-03a849e1-dfff-4aa2-a46a-63eaa0c7ced8 req-4975a1df-fa52-4fb4-8d66-625a91ce3c4e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] No waiting events found dispatching network-vif-unplugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:18.059039 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-03a849e1-dfff-4aa2-a46a-63eaa0c7ced8 req-4975a1df-fa52-4fb4-8d66-625a91ce3c4e service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-unplugged-aefcb3f3-4513-4238-8126-bff01f489cf6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:02:18.323984 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:18.326327 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:18.326639 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:18.408071 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.part --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:18.408686 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] fa0eb55a-2d07-4302-93b3-8cc680ecbfc7 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:02:18.409115 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:02:18.409418 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.part /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:18.542242 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 03:02:18.543237 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:02:18.546297 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:02:18.546297 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:02:18.546297 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:18.592338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.part /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.converted" returned: 0 in 0.183s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:18.598042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:18.665589 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:18.689472 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7.converted --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:18.690082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "7f2d95f28427062f745e4f2db8e556f4bf0558c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.096s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:18.690529 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:18.693279 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:18.694838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:18.781349 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-plugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:18.781743 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:18.782344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:18.782553 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:18.782648 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Processing event network-vif-plugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:02:18.782854 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-plugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:18.782978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:18.785379 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:02:18.786106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7 --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:18.786616 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "7f2d95f28427062f745e4f2db8e556f4bf0558c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:18.787932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "7f2d95f28427062f745e4f2db8e556f4bf0558c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:18.788266 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:18.792887 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:18.793039 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:18.793319 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:18.794122 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] No waiting events found dispatching network-vif-plugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:18.794559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:18.810483 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937338.7939072, ad211867-f4ec-4773-bca9-5383cde1e916 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:18.812058 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a0854a61-a142-49e0-9adb-d1ca2988bfe0 req-8753681c-a1d4-43ea-9f37-3a05aa8d924a service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received unexpected event network-vif-plugged-45ca207b-12db-4df0-9d88-83d537d0bb64 for instance with vm_state building and task_state spawning.
May 28 03:02:18.818633 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] VM Resumed (Lifecycle Event)
May 28 03:02:18.819246 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:02:18.828157 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Instance spawned successfully.
May 28 03:02:18.828672 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:02:18.852393 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:18.888510 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7 --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:18.889285 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7,backing_fmt=raw /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:18.941416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7,backing_fmt=raw /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk 1073741824" returned: 0 in 0.052s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:18.941866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "7f2d95f28427062f745e4f2db8e556f4bf0558c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:18.942219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:19.036504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f2d95f28427062f745e4f2db8e556f4bf0558c7 --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:19.036953 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:02:19.037197 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:19.132938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:19.133468 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Cannot resize image /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:02:19.133928 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:02:19.134131 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Ensure instance console log exists: /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:02:19.134723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:19.134723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:19.134971 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:19.138461 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Start _get_guest_xml network_info=[{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T02:57:49Z,direct_url=<?>,disk_format='qcow2',id=fa0eb55a-2d07-4302-93b3-8cc680ecbfc7,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T02:57:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '223f42c6-b6a1-407b-aa62-6001661fd2b9', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a6d1b015-c35f-4563-be6b-754693ecbe8d', 'attached_at': '', 'detached_at': '', 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'serial': '58675be1-7fd6-4b3d-b052-35953ff77261'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:02:19.141279 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 03:02:19.142639 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1451633244', uuid='a6d1b015-c35f-4563-be6b-754693ecbe8d'), owner=OwnerMeta(userid='2776d33c40e0490eb87787c8dafc8066', username='tempest-ServerActionsTestOtherA-1968473744-project-member', projectid='4d2ef1b6a03d428d94b2072c01964b49', projectname='tempest-ServerActionsTestOtherA-1968473744'), image=ImageMeta(id='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937339.1422853) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:02:19.144485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:02:19.145691 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:02:19.147371 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T02:57:49Z,direct_url=<?>,disk_format='qcow2',id=fa0eb55a-2d07-4302-93b3-8cc680ecbfc7,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T02:57:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:02:19.150608 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:02:19.151030 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:02:19.151122 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:02:19.151465 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:02:19.151651 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:02:19.151896 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:02:19.152278 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'vcpu_model' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:19.324372 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:19.328661 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:19.336146 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:19.336319 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:19.336678 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:19.336959 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:19.337273 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:19.337731 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:19.668430 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:02:19.669809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:19.669809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:19.669809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:19.669809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:02:19.687654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:19.688354 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:19.688873 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:19.689238 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:19.689425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:19.689641 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:19.702932 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:19.702932 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:19.709385 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:19.709385 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:19.720199 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261] added
May 28 03:02:19.720199 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:19.720199 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:19.720199 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:19.720199 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:19.720199 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:19.720199 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:19.720453 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:19.720637 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:19.720768 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:19.728929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261] added
May 28 03:02:19.728929 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:19.728929 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:19.728929 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:19.728929 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:19.728929 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:19.728929 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:19.729162 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:19.729315 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0396(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:19.729557 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:19.832032 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:02:19.843090 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Took 13.31 seconds to spawn the instance on the hypervisor.
May 28 03:02:19.843307 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:20.199595 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:20.239582 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:20.356724 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Took 18.71 seconds to build instance.
May 28 03:02:20.497897 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-98b3a9cd-457e-4ba7-b336-258a46747337 req-90a7af52-1d11-40ab-b9f4-907dcb75eabe service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-unplugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:20.498665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-98b3a9cd-457e-4ba7-b336-258a46747337 req-90a7af52-1d11-40ab-b9f4-907dcb75eabe service nova] Acquiring lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:20.499030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-98b3a9cd-457e-4ba7-b336-258a46747337 req-90a7af52-1d11-40ab-b9f4-907dcb75eabe service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:20.499218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-98b3a9cd-457e-4ba7-b336-258a46747337 req-90a7af52-1d11-40ab-b9f4-907dcb75eabe service nova] Lock "f4651248-73c3-435e-842a-3858d6eb74ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:20.499422 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-98b3a9cd-457e-4ba7-b336-258a46747337 req-90a7af52-1d11-40ab-b9f4-907dcb75eabe service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] No waiting events found dispatching network-vif-unplugged-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:20.499575 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-98b3a9cd-457e-4ba7-b336-258a46747337 req-90a7af52-1d11-40ab-b9f4-907dcb75eabe service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-unplugged-aefcb3f3-4513-4238-8126-bff01f489cf6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:02:20.499706 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-98b3a9cd-457e-4ba7-b336-258a46747337 req-90a7af52-1d11-40ab-b9f4-907dcb75eabe service nova] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Received event network-vif-deleted-aefcb3f3-4513-4238-8126-bff01f489cf6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:20.702168 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Took 2.16 seconds to deallocate network for instance.
May 28 03:02:20.721203 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:20.731182 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:20.733332 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:20.733332 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.750626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:20.757587 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:20.757587 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.773342 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.781514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.781514 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:20.781844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.781844 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:20.794745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.794745 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:20.794926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.794926 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:20.814892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260]
May 28 03:02:20.814892 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260] successful.
May 28 03:02:20.814892 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.828214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.836071 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260]
May 28 03:02:20.836071 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260] successful.
May 28 03:02:20.836071 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.845691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.845691 np0000001589 nova-compute[98297]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.845691 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.845691 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:20.845862 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.845862 np0000001589 nova-compute[98297]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.845862 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.845862 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:20.846188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:20.846349 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:20.847112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('8', '-', '-', 0) found on session 17 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:20.847275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:20.857779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:20.858613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.221s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:20.865743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 17 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:20.872341 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.872341 np0000001589 nova-compute[98297]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.872341 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.872341 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:20.872712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:20.872712 np0000001589 nova-compute[98297]: tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.872712 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:20.872712 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:20.872994 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:20.873122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:20.873802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('9', '-', '-', 0) found on session 18 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:20.873937 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:20.892191 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 18 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:20.892404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:21.209483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:21.209940 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:21.563342 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:02:21.563693 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:02:21.866356 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 17 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:21.866467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:22.066663 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:02:22.101284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:22.201761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:22.319512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:22.319919 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:22.470574 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:22.577899 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.368s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:22.659534 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Deleted allocations for instance f4651248-73c3-435e-842a-3858d6eb74ae
May 28 03:02:22.714657 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Found WWN 33000000044380a15 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:02:22.715041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:22.715301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '33000000044380a15', 'path': '/dev/dm-0', 'multipath_id': '33000000044380a15'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:22.715385 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000044380a15', 'path': '/dev/dm-0', 'multipath_id': '33000000044380a15'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:02:22.826372 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:23.019616 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.222945 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1347059805',display_name='tempest-ServerActionsTestOtherA-server-1451633244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-tempest-common-compute-instance-1347059805',id=10,image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3H3xbkuEJFp5BVC9tKLUKzuY22S28zMPGvGibNwb7aG9A8j7iR2rOpJXsWGV+ZFxoYlaqtGtx5+IK7e6ZVXbzZE2A6Oh/00/TmK0lxprE9tXtzjPsvTuUyPdpOpxd10A==',key_name='tempest-keypair-1895656678',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:19Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-7xlcz90c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=a6d1b015-c35f-4563-be6b-754693ecbe8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:02:23.222945 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:23.223143 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:23.224682 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] End _get_guest_xml xml=<domain type="qemu">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <uuid>a6d1b015-c35f-4563-be6b-754693ecbe8d</uuid>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <name>instance-0000000a</name>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsTestOtherA-server-1451633244</nova:name>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:02:19</nova:creationTime>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:image uuid="fa0eb55a-2d07-4302-93b3-8cc680ecbfc7">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:user uuid="2776d33c40e0490eb87787c8dafc8066">tempest-ServerActionsTestOtherA-1968473744-project-member</nova:user>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:project uuid="4d2ef1b6a03d428d94b2072c01964b49">tempest-ServerActionsTestOtherA-1968473744</nova:project>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="fa0eb55a-2d07-4302-93b3-8cc680ecbfc7"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         <nova:port uuid="82527285-9862-47e9-92e1-5f234948dddd">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <entry name="serial">a6d1b015-c35f-4563-be6b-754693ecbe8d</entry>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <entry name="uuid">a6d1b015-c35f-4563-be6b-754693ecbe8d</entry>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <alias name="ua-58675be1-7fd6-4b3d-b052-35953ff77261"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <serial>58675be1-7fd6-4b3d-b052-35953ff77261</serial>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:49:ab:d3"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <target dev="tap82527285-98"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/console.log" append="off"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:23.224682 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:02:23.227614 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1347059805',display_name='tempest-ServerActionsTestOtherA-server-1451633244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-tempest-common-compute-instance-1347059805',id=10,image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3H3xbkuEJFp5BVC9tKLUKzuY22S28zMPGvGibNwb7aG9A8j7iR2rOpJXsWGV+ZFxoYlaqtGtx5+IK7e6ZVXbzZE2A6Oh/00/TmK0lxprE9tXtzjPsvTuUyPdpOpxd10A==',key_name='tempest-keypair-1895656678',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:19Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-7xlcz90c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=a6d1b015-c35f-4563-be6b-754693ecbe8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:02:23.227880 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:23.228511 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:23.228863 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:02:23.230097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.230324 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:23.230509 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:02:23.231464 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.231627 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30184f66-40a9-52a2-b320-da167b064be7', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:23.232333 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.232941 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:23.234318 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.235926 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.236060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82527285-98, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:23.236529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82527285-98, col_values=(('qos', UUID('58de7021-fe32-4259-bbc3-832c2717dcd5')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:23.236792 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82527285-98, col_values=(('external_ids', {'iface-id': '82527285-9862-47e9-92e1-5f234948dddd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:ab:d3', 'vm-uuid': 'a6d1b015-c35f-4563-be6b-754693ecbe8d'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:23.240482 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.240482 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:23.246206 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.247380 np0000001589 nova-compute[98297]: INFO os_vif [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98')
May 28 03:02:23.479130 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:23.670643 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c3898dd7-213b-46e3-8bfe-fa90035c8094 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Lock "f4651248-73c3-435e-842a-3858d6eb74ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.038s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:23.833690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:24.465579 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:24.774586 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:24.774898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:24.774898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:24.774898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No VIF found with MAC fa:16:3e:49:ab:d3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:02:24.775334 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Using config drive
May 28 03:02:24.914567 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:24.914567 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:24.914567 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Attaching volume 8b21e0e5-41f1-458e-b254-d46b30be8b1f to /dev/vdb
May 28 03:02:24.975394 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] instance snapshotting
May 28 03:02:24.980347 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:24.997129 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:02:25.019669 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:25.054448 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:02:25.055542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:02:25.067558 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:02:25.067558 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea'] 
May 28 03:02:25.067558 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:02:25.067558 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:02:25.067558 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:25.067558 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updating existing volume attachment record: ea51956a-d6c8-4447-9297-72beb555321d {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:02:25.138617 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Beginning live snapshot process
May 28 03:02:25.144387 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:25.146420 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 03:02:25.217894 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:25.278239 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'ec2_ids' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:25.639823 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:02:25.640186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:25.640775 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:25.640850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:25.641007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:02:25.652327 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] There are 0 instances to clean {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 03:02:25.653079 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:25.653079 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98297) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 03:02:25.658723 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:25.659577 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:25.660788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:25.660788 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:25.661089 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:25.661290 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:25.675530 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:25.675530 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:25.682115 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:25.682115 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:25.690799 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f] added
May 28 03:02:25.690799 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:25.690799 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:25.690799 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:25.690799 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:25.690799 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:25.690799 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:25.690799 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:25.690995 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:25.691319 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:25.696007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f] added
May 28 03:02:25.696007 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:25.696007 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:25.696007 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:25.696007 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:25.696007 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:25.696007 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:25.696326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:25.696445 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:25.696630 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:25.785875 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Object Instance<a6d1b015-c35f-4563-be6b-754693ecbe8d> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:25.786444 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'keypairs' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:26.158358 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:26.293173 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Object Instance<a6d1b015-c35f-4563-be6b-754693ecbe8d> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:26.298778 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 03:02:26.531782 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Creating config drive at /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config
May 28 03:02:26.541134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvcnmtxsb {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:26.585132 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvcnmtxsb" returned: 0 in 0.043s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:26.664366 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:02:26.669249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:26.692607 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:26.699515 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:26.711541 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:26.711541 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:26.713922 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:26.713922 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.725413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.731004 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.741619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.741619 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.741619 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:26.741619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.741619 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.741619 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:26.746193 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.746193 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.746193 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:26.746607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.746607 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.746607 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:26.753625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json -f qcow2" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:26.757250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:26.785236 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260]
May 28 03:02:26.785236 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260] successful.
May 28 03:02:26.785236 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.786342 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260]
May 28 03:02:26.786342 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260] successful.
May 28 03:02:26.786342 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.803516 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.803516 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:26.819128 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.819128 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.819128 np0000001589 nova-compute[98297]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.819128 np0000001589 nova-compute[98297]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.819128 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:26.819646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.819646 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.819646 np0000001589 nova-compute[98297]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.819646 np0000001589 nova-compute[98297]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.819646 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:26.820443 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.820443 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.820443 np0000001589 nova-compute[98297]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.820443 np0000001589 nova-compute[98297]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.820443 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:26.820634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.820634 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:26.820634 np0000001589 nova-compute[98297]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.820634 np0000001589 nova-compute[98297]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:26.820634 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:26.822341 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:26.823370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:26.825246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:26.825246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:26.825246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('7', '-', '-', 0) found on session 19 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:26.825246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:26.828184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('10', '-', '-', 0) found on session 20 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:26.828184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:26.845152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 19 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:26.863330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:26.863330 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json -f qcow2" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:26.863330 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:26.863330 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:26.863330 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:26.879635 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 20 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:26.879635 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:26.946783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:26.950452 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0xxomm5m/db60bce7ffe64c11992e5ec1e8579a1e.delta 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:27.009878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0xxomm5m/db60bce7ffe64c11992e5ec1e8579a1e.delta 1073741824" returned: 0 in 0.062s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:27.010535 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 03:02:27.132710 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:27.162136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:27.331915 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:27.339147 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-21bb473c-aa7b-4bc8-b6ad-55f2956db042 req-7d2b4a10-27c5-4454-996d-b983e1c6f342 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:27.339147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-21bb473c-aa7b-4bc8-b6ad-55f2956db042 req-7d2b4a10-27c5-4454-996d-b983e1c6f342 service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:27.339147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-21bb473c-aa7b-4bc8-b6ad-55f2956db042 req-7d2b4a10-27c5-4454-996d-b983e1c6f342 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:27.339407 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-21bb473c-aa7b-4bc8-b6ad-55f2956db042 req-7d2b4a10-27c5-4454-996d-b983e1c6f342 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:27.339407 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-21bb473c-aa7b-4bc8-b6ad-55f2956db042 req-7d2b4a10-27c5-4454-996d-b983e1c6f342 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] No waiting events found dispatching network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:27.339640 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-21bb473c-aa7b-4bc8-b6ad-55f2956db042 req-7d2b4a10-27c5-4454-996d-b983e1c6f342 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received unexpected event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd for instance with vm_state active and task_state rebuild_spawning.
May 28 03:02:27.340069 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:27.426942 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98297) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 03:02:27.429957 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 03:02:27.471556 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:27.573840 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:27.604748 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:02:27.604748 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0xxomm5m/db60bce7ffe64c11992e5ec1e8579a1e.delta /opt/stack/data/nova/instances/snapshots/tmp0xxomm5m/db60bce7ffe64c11992e5ec1e8579a1e {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:27.629300 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.002415073999827655 future=<Future at 0x7e4b64507f50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:27.629486 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:27.631070 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779937332.6266143, a6d1b015-c35f-4563-be6b-754693ecbe8d => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:27.631463 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.852466990000039 future=<Future at 0x7e4b64498770 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:27.631666 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] VM Stopped (Lifecycle Event)
May 28 03:02:27.638113 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.84584428900007 future=<Future at 0x7e4b64498770 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:27.660078 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:27.660777 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:27.660910 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:02:27.661510 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:02:27.662330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:02:27.709098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0xxomm5m/db60bce7ffe64c11992e5ec1e8579a1e.delta /opt/stack/data/nova/instances/snapshots/tmp0xxomm5m/db60bce7ffe64c11992e5ec1e8579a1e" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:27.710220 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Snapshot extracted, beginning image upload
May 28 03:02:28.139272 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:28.139758 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:28.139758 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:02:28.145323 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:28.239386 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:28.249836 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937348.2489333, a6d1b015-c35f-4563-be6b-754693ecbe8d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:28.250071 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] VM Resumed (Lifecycle Event)
May 28 03:02:28.252554 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:02:28.252715 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:02:28.254435 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance spawned successfully.
May 28 03:02:28.255203 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:02:28.681457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found WWN 330000000be19de31 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:02:28.682735 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:28.682926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000be19de31', 'path': '/dev/dm-1', 'multipath_id': '330000000be19de31'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:28.683066 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be19de31', 'path': '/dev/dm-1', 'multipath_id': '330000000be19de31'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:02:28.689242 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:28.733666 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:28.753178 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:28.755907 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:28.767768 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:28.768845 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:28.769437 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:28.770180 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:28.773036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:28.773036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:29.139263 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:29.196126 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Attempting to attach volume 8b21e0e5-41f1-458e-b254-d46b30be8b1f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:02:29.199797 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:02:29.199797 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:29.199797 np0000001589 nova-compute[98297]:   <alias name="ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f"/>
May 28 03:02:29.199797 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:02:29.199797 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:02:29.199797 np0000001589 nova-compute[98297]:   <serial>8b21e0e5-41f1-458e-b254-d46b30be8b1f</serial>
May 28 03:02:29.199797 np0000001589 nova-compute[98297]: </disk>
May 28 03:02:29.199797 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:02:29.260292 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:29.264036 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 03:02:29.264395 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937349.2641299, a6d1b015-c35f-4563-be6b-754693ecbe8d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:29.264576 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] VM Started (Lifecycle Event)
May 28 03:02:29.277022 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:29.420710 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0ca5bda5-7f2c-4300-b708-b4677e094abf req-4202a16a-68fe-40ab-963d-612390753414 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:29.421009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0ca5bda5-7f2c-4300-b708-b4677e094abf req-4202a16a-68fe-40ab-963d-612390753414 service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:29.421253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0ca5bda5-7f2c-4300-b708-b4677e094abf req-4202a16a-68fe-40ab-963d-612390753414 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:29.421387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0ca5bda5-7f2c-4300-b708-b4677e094abf req-4202a16a-68fe-40ab-963d-612390753414 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:29.421508 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0ca5bda5-7f2c-4300-b708-b4677e094abf req-4202a16a-68fe-40ab-963d-612390753414 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] No waiting events found dispatching network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:29.421628 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-0ca5bda5-7f2c-4300-b708-b4677e094abf req-4202a16a-68fe-40ab-963d-612390753414 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received unexpected event network-vif-plugged-82527285-9862-47e9-92e1-5f234948dddd for instance with vm_state active and task_state None.
May 28 03:02:29.643240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:29.644918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:29.644918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:29.644918 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:02:29.770104 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:29.773725 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:29.795269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:29.795642 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:29.795838 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98297) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 03:02:30.444073 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Snapshot image upload complete
May 28 03:02:30.444542 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f42ee5b7-88dd-4c93-a507-9f0136bca405 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Took 5.46 seconds to snapshot the instance on the hypervisor.
May 28 03:02:30.683551 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:30.761680 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:30.762314 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:30.807245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f174bd2-7f7e-4121-bb6c-f310692bda13 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.011s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:30.838992 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:30.844053 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:30.905458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:30.905458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:30.905458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:30.905458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No VIF found with MAC fa:16:3e:e1:0d:00, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:02:30.932566 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:30.933336 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:31.019725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:31.024698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:31.107524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:31.108187 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:31.200458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:31.201014 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:02:31.205023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:31.304692 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:31.308584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:31.354117 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:31.401678 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:31.402207 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:02:31.410250 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:02:31.410250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:31.461062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:31.461818 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13283MB free_disk=74.53302001953125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:02:31.461983 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:31.462258 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:32.202508 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:32.384278 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:32.384542 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:32.476364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:32.486254 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0005781719999049528 future=<Future at 0x7e4b64498770 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:32.486254 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:32.486254 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-dbc88a5b-4390-492b-a3a3-0be35bf8110d None None] Emitting event <LifecycleEvent: 1779937337.4838257, f4651248-73c3-435e-842a-3858d6eb74ae => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:32.486254 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-dbc88a5b-4390-492b-a3a3-0be35bf8110d None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] VM Stopped (Lifecycle Event)
May 28 03:02:32.509014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6acfede3-20d4-4a06-b01b-420b04d11f75 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.596s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:32.532010 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:02:32.532416 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance a6d1b015-c35f-4563-be6b-754693ecbe8d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:02:32.532571 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:02:32.532666 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ad211867-f4ec-4773-bca9-5383cde1e916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:02:32.888655 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:02:32.897308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:32.898578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:32.898864 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:32.901942 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98297) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 03:02:32.902391 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:32.988692 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dbc88a5b-4390-492b-a3a3-0be35bf8110d None None] [instance: f4651248-73c3-435e-842a-3858d6eb74ae] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:33.036746 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ada45e15-d8ee-4ad0-b222-30f543ee7089 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 03:02:33.037038 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:02:33.037267 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:02:31 up 30 min,  2 users,  load average: 8.76, 4.86, 2.31\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_4d2ef1b6a03d428d94b2072c01964b49': '2', 'io_workload': '0', 'num_proj_989151e14dc44db3b75763b654bb2199': '1', 'num_proj_ea07081265c14a80b849530dbb4de34a': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:02:33.241857 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:33.349074 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:02:33.349324 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:02:33.453275 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:33.852849 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:02:33.933730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:33.937067 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:33.958356 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:33.960082 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:34.000783 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:34.246623 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:34.304160 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999699242999895 future=<Future at 0x7e4b645f4530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:34.307078 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.996896130000096 future=<Future at 0x7e4b645f4530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:34.307078 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.996737164000024 future=<Future at 0x7e4b645f4530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:34.308143 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance destroyed successfully.
May 28 03:02:34.308597 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'numa_topology' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:34.363943 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:02:34.364148 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.902s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:34.365674 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.913s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:34.368684 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:02:34.368854 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Claim successful on node np0000001589
May 28 03:02:34.371544 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:02:34.815331 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:34.815331 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:35.332020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-24ee87b4-2d84-45eb-bd64-259f4e0bf26f tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.434s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:35.367190 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:35.367864 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:35.368175 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:02:35.368528 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.77 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:02:35.506813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:35.714018 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:02:35.714938 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:02:35.733962 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:36.218350 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:02:36.245253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:36.245253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquired lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:36.245584 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:02:36.245823 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'info_cache' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:36.746644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.381s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:36.747247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:02:36.751497 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:37.254049 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:02:37.254166 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:02:37.254460 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:37.254854 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:37.256885 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:37.339488 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca35293e06644323b1379cbcfa028d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea07081265c14a80b849530dbb4de34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:02:37.491449 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:37.680619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:37.728553 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72f6ec84-6a48-4257-9953-7112bc620ea1 req-98c9bd05-3fcf-4c8f-956b-2d0fedf5abd8 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:37.733477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72f6ec84-6a48-4257-9953-7112bc620ea1 req-98c9bd05-3fcf-4c8f-956b-2d0fedf5abd8 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:37.733477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72f6ec84-6a48-4257-9953-7112bc620ea1 req-98c9bd05-3fcf-4c8f-956b-2d0fedf5abd8 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:37.733477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72f6ec84-6a48-4257-9953-7112bc620ea1 req-98c9bd05-3fcf-4c8f-956b-2d0fedf5abd8 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:37.733477 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72f6ec84-6a48-4257-9953-7112bc620ea1 req-98c9bd05-3fcf-4c8f-956b-2d0fedf5abd8 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:37.733477 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-72f6ec84-6a48-4257-9953-7112bc620ea1 req-98c9bd05-3fcf-4c8f-956b-2d0fedf5abd8 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state powering-on.
May 28 03:02:37.739097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:37.763330 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:02:38.243874 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:38.276624 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:38.278725 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:02:38.491517 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updating instance_info_cache with network_info: [{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:38.714665 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:38.788292 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Booting with blank volume at /dev/vda
May 28 03:02:38.805193 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Successfully created port: 34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:02:38.996877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Releasing lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:39.859020 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e1a6db8f-e86f-4acd-b3b6-bc93ca24fa85 req-d2fdd006-02b2-49a0-9a5b-e0bbb85b92a9 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:39.860032 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1a6db8f-e86f-4acd-b3b6-bc93ca24fa85 req-d2fdd006-02b2-49a0-9a5b-e0bbb85b92a9 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:39.860718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1a6db8f-e86f-4acd-b3b6-bc93ca24fa85 req-d2fdd006-02b2-49a0-9a5b-e0bbb85b92a9 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:39.860718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1a6db8f-e86f-4acd-b3b6-bc93ca24fa85 req-d2fdd006-02b2-49a0-9a5b-e0bbb85b92a9 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:39.860718 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e1a6db8f-e86f-4acd-b3b6-bc93ca24fa85 req-d2fdd006-02b2-49a0-9a5b-e0bbb85b92a9 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:39.860718 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e1a6db8f-e86f-4acd-b3b6-bc93ca24fa85 req-d2fdd006-02b2-49a0-9a5b-e0bbb85b92a9 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state powering-on.
May 28 03:02:40.012541 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance destroyed successfully.
May 28 03:02:40.013006 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'numa_topology' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:40.144151 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Successfully updated port: 34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:02:40.217956 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-changed-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:40.218560 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Refreshing instance network info cache due to event network-changed-34e756fe-3ab6-4283-b1fb-dd1682f398c3. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:02:40.219800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] Acquiring lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:40.219932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] Acquired lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:40.220129 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Refreshing network info cache for port 34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:02:40.516110 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:40.516589 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'resources' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:40.647219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:40.725108 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:40.730878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:40.806347 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:02:41.021280 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:41.021854 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:02:41.021854 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:41.024136 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:41.024136 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:02:41.024645 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:41.025172 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa451f1e5-e9, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:41.029259 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:41.031210 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:41.032095 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:41.032337 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8fede797-792d-4b45-a54d-f91f37ce5fc7) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:41.033630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:41.033695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:41.034565 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:41.038359 np0000001589 nova-compute[98297]: INFO os_vif [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9')
May 28 03:02:41.040751 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:02:41.042609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:41.042609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:41.042609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:41.042609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:02:41.044391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:02:41.080048 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:41.080048 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:41.080048 np0000001589 nova-compute[98297]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:41.080048 np0000001589 nova-compute[98297]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:41.080048 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:41.080048 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:41.080048 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:41.080761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:41.080761 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:41.080761 np0000001589 nova-compute[98297]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:41.080761 np0000001589 nova-compute[98297]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:41.080761 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:41.080761 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:41.080761 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:41.080991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3', '22')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:02:41.081156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '19')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:41.082368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '20')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:02:41.084698 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:41.086452 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b644a51c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:02:41.086736 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Removing multipathed devices sde, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:02:41.087044 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flush multipath device 330000000be19de31 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:02:41.119420 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:02:41.167162 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:02:41.209913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:02:41.210109 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] SCSI volumes sde, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:02:41.210980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:02:41.231985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:02:41.231985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:02:41.245220 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:41.286947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260]
May 28 03:02:41.286947 np0000001589 nova-compute[98297]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260] successful.
May 28 03:02:41.286947 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:41.306595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:41.320541 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:41.349128 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260]
May 28 03:02:41.349128 np0000001589 nova-compute[98297]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260] successful.
May 28 03:02:41.349128 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:41.365563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:41.365851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:41.365959 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== disconnect_volume: return (324ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:41.366020 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:02:41.372532 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Start _get_guest_xml network_info=[{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'ea51956a-d6c8-4447-9297-72beb555321d', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': 'e5117e69-981a-42a7-9fdb-c5fb550fe5b9', 'attached_at': '', 'detached_at': '', 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'serial': '8b21e0e5-41f1-458e-b254-d46b30be8b1f'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:02:41.378857 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:02:41.383553 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-2011301087', uuid='e5117e69-981a-42a7-9fdb-c5fb550fe5b9'), owner=OwnerMeta(userid='41af6183ea4b4a668518493baf359999', username='tempest-AttachVolumeTestJSON-695798121-project-member', projectid='989151e14dc44db3b75763b654bb2199', projectname='tempest-AttachVolumeTestJSON-695798121'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937361.3795786) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:02:41.385369 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:02:41.386200 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:02:41.386497 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:02:41.387254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:02:41.387725 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:02:41.387988 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:02:41.388112 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:02:41.388248 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:02:41.388409 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:02:41.388483 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:02:41.388578 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:02:41.388718 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:02:41.388891 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:02:41.389054 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:02:41.390318 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:02:41.390318 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:02:41.390450 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:41.589587 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-20d82856-4aa7-453f-b4f5-42d40bcd7cf0 req-fdc369f1-1460-41ae-bdcd-39788c5f544f service nova] Releasing lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:41.590612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:41.590763 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:02:41.892567 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:41.905615 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:42.000396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:42.002248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:42.002248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:42.003085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:42.003703 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:02:42.004168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:42.004276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:42.004619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:42.004861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:02:42.026587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:42.027557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:42.028361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:42.028361 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:42.028845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:42.029092 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:42.042569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:42.042569 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:42.052286 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:42.052286 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f] added
May 28 03:02:42.061631 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:42.061631 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:42.061631 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f] added
May 28 03:02:42.069819 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:42.069819 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:42.069819 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:42.081308 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:42.232172 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:02:42.289753 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:42.314776 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:02:42.363249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:42.402813 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:02:42.402813 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:02:42.412919 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:02:42.414977 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe49:abd3'] 
May 28 03:02:42.414977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:02:42.414977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:02:42.414977 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:42.414977 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Updating existing volume attachment record: cfa35300-de51-4b1f-b1eb-d0af18cb665a {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:02:42.495008 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:42.513119 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:42.741945 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Updating instance_info_cache with network_info: [{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:43.061999 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:43.070546 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:43.072918 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:43.072918 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:43.083995 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:43.083995 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.087007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.100739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.106555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.106555 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.106555 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.106555 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.106555 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:43.106748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.106748 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.106748 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.106748 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.106748 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:43.117728 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.117728 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.117728 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.117728 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.117728 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:43.117934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.117934 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.117934 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.117934 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.117934 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:43.150215 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260]
May 28 03:02:43.150215 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260] successful.
May 28 03:02:43.150215 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.164041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.173432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260]
May 28 03:02:43.173432 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260] successful.
May 28 03:02:43.173432 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.181608 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.181608 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.181608 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.181608 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.181608 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.181608 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.181608 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:43.181792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.181792 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.181792 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.181792 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.181792 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.181792 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.181792 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:43.182054 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:43.182159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:43.182891 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('7', '-', '-', 0) found on session 25 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:43.182999 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:43.184392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:43.202406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 25 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:43.202406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:43.207606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.207606 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.207606 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.207606 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.207606 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.207606 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.207606 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:43.207792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.207792 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:43.207792 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:43.207792 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:43.207792 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.207792 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:43.207792 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:43.207949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.179s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:43.208046 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:43.208667 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('10', '-', '-', 0) found on session 26 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:43.208764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:43.223012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 26 and hctl ['10', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:43.244835 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:43.244835 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance network_info: |[{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:02:43.771884 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:44.223657 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 26 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:44.224073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:44.319325 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:44.596710 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:02:44.612450 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:02:44.612771 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Creating image(s)
May 28 03:02:44.613180 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:02:44.615104 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Ensure instance console log exists: /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:02:44.616863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:44.616863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:44.616863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:44.617472 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Start _get_guest_xml network_info=[{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'cfa35300-de51-4b1f-b1eb-d0af18cb665a', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ada45e15-d8ee-4ad0-b222-30f543ee7089', 'attached_at': '', 'detached_at': '', 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'serial': '827eac3f-e35b-4ade-a140-b62fff706262'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:02:44.619976 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:02:44.621283 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1530392760', uuid='ada45e15-d8ee-4ad0-b222-30f543ee7089'), owner=OwnerMeta(userid='ca35293e06644323b1379cbcfa028d87', username='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member', projectid='ea07081265c14a80b849530dbb4de34a', projectname='tempest-ServerBootFromVolumeStableRescueTest-1646172629'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937364.6209145) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:02:44.622665 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:02:44.623002 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:02:44.623995 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:02:44.624151 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:02:44.625170 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:02:44.625503 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:02:44.625667 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:02:44.625775 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:02:44.625959 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:02:44.626022 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:02:44.626129 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:02:44.626317 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:02:44.626460 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:02:44.626644 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:02:44.626761 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:02:44.626902 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:02:44.641447 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:02:44.641447 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:44.641447 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:45.045954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found WWN 330000000be19de31 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:02:45.046297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:45.046625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== connect_volume: return (3041ms) {'type': 'block', 'scsi_wwn': '330000000be19de31', 'path': '/dev/dm-1', 'multipath_id': '330000000be19de31'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:45.046625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be19de31', 'path': '/dev/dm-1', 'multipath_id': '330000000be19de31'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:02:45.047476 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.406s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:45.048055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:02:45.061764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:45.062532 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:02:45.063202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:45.063785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:02:45.064091 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:45.064528 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:45.077684 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:45.077684 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:45.084316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:02:45.084316 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:45.091361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262] added
May 28 03:02:45.091361 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:45.091361 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:45.091361 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:45.091361 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:45.091361 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:45.091361 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:45.091626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:45.091626 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:45.091764 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:45.095765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262] added
May 28 03:02:45.095765 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:02:45.095765 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:45.095765 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:45.095765 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:02:45.095765 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:02:45.095765 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:45.096012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:02:45.096077 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:02:45.096239 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:02:45.334196 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:45.556648 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:02:45.556903 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:45.557497 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:45.558130 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'pci_devices' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:46.034048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:46.063564 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:46.065213 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] End _get_guest_xml xml=<domain type="qemu">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <uuid>e5117e69-981a-42a7-9fdb-c5fb550fe5b9</uuid>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <name>instance-0000000b</name>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeTestJSON-server-2011301087</nova:name>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:02:41</nova:creationTime>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:user uuid="41af6183ea4b4a668518493baf359999">tempest-AttachVolumeTestJSON-695798121-project-member</nova:user>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:project uuid="989151e14dc44db3b75763b654bb2199">tempest-AttachVolumeTestJSON-695798121</nova:project>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         <nova:port uuid="a451f1e5-e9e1-4ab0-a842-5a7e598465b1">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <entry name="serial">e5117e69-981a-42a7-9fdb-c5fb550fe5b9</entry>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <entry name="uuid">e5117e69-981a-42a7-9fdb-c5fb550fe5b9</entry>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <alias name="ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-1"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <serial>8b21e0e5-41f1-458e-b254-d46b30be8b1f</serial>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:e1:0d:00"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <target dev="tapa451f1e5-e9"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/console.log" append="off"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:46.065213 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:02:46.071357 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:46.097593 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:02:46.098430 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:02:46.112062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:46.112810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:46.116802 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:46.116802 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:02:46.125534 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:02:46.125534 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.134164 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.144359 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.155084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.155084 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.155084 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.155084 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.155084 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.155084 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.155084 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:46.155916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.155916 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.155916 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.155916 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.155916 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.155916 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.155916 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:46.163594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:46.166245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:46.182944 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.182944 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.182944 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.182944 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.182944 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.182944 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.182944 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:46.184252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.184252 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.184252 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.184252 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.184252 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.184252 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.184252 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:46.209174 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.40.100,3260]
May 28 03:02:46.209174 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.40.100,3260] successful.
May 28 03:02:46.209174 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.227056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.246215 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.50.100,3260]
May 28 03:02:46.246215 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.50.100,3260] successful.
May 28 03:02:46.246215 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.247605 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.247936 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:46.248389 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:46.248486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:46.249587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('13', '-', '-', 0) found on session 27 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:46.249747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:46.264185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:46.264688 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:02:46.265370 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:46.267350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:02:46.281161 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 27 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:46.281320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.288208 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7662cf30-4bfe-46eb-bca4-9181ac7a11a5 (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a922054-80e5-4060-8b29-0b9adfab87d3 (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:02:46.289090 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:02:46.290642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:46.290642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:02:46.291581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('14', '-', '-', 0) found on session 28 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:02:46.291806 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:02:46.306904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 28 and hctl ['14', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:46.617666 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:02:46.768251 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:46.768869 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:46.867656 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:46.867656 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:02:46.867656 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:46.949485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:46.950014 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Cannot resize image /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:02:46.950475 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'migration_context' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:47.305993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 28 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:02:47.306185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:02:47.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:47.362155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:47.365721 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:02:47.365943 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Claim successful on node np0000001589
May 28 03:02:47.382801 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:47.453258 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:02:47.454123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:02:47.454468 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:47.454906 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:47.455147 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:02:47.457461 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:47.457770 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:47.458055 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:02:47.460159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:47.461496 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a6190f7-b6cf-50fa-aac0-e7000630422d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:47.463761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:47.465048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:47.466916 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:47.467112 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa451f1e5-e9, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:47.467543 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa451f1e5-e9, col_values=(('qos', UUID('a6b14325-4ca7-4884-9c07-9bf3deb6347e')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:47.467732 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa451f1e5-e9, col_values=(('external_ids', {'iface-id': 'a451f1e5-e9e1-4ab0-a842-5a7e598465b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:0d:00', 'vm-uuid': 'e5117e69-981a-42a7-9fdb-c5fb550fe5b9'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:47.469904 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:47.471451 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:47.474513 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:47.476589 np0000001589 nova-compute[98297]: INFO os_vif [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9')
May 28 03:02:47.497413 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:48.023011 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:48.053738 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:48.085108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Found WWN 330000000b6978475 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:02:48.085580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:02:48.085803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== connect_volume: return (3445ms) {'type': 'block', 'scsi_wwn': '330000000b6978475', 'path': '/dev/dm-2', 'multipath_id': '330000000b6978475'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:48.085976 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b6978475', 'path': '/dev/dm-2', 'multipath_id': '330000000b6978475'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:02:48.150524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:48.388617 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f5f69a5d-b859-47ca-98eb-d6688b3ed612 req-3d7af6db-2da9-47ee-ac85-49971fb8bafd service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:48.396384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f5f69a5d-b859-47ca-98eb-d6688b3ed612 req-3d7af6db-2da9-47ee-ac85-49971fb8bafd service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:48.396384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f5f69a5d-b859-47ca-98eb-d6688b3ed612 req-3d7af6db-2da9-47ee-ac85-49971fb8bafd service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:48.396384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f5f69a5d-b859-47ca-98eb-d6688b3ed612 req-3d7af6db-2da9-47ee-ac85-49971fb8bafd service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:48.396384 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f5f69a5d-b859-47ca-98eb-d6688b3ed612 req-3d7af6db-2da9-47ee-ac85-49971fb8bafd service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:48.396384 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f5f69a5d-b859-47ca-98eb-d6688b3ed612 req-3d7af6db-2da9-47ee-ac85-49971fb8bafd service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state powering-on.
May 28 03:02:48.418523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:48.427318 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:48.453401 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:48.481199 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Refreshing inventories for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 03:02:48.546366 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Updating ProviderTree inventory for provider 672703c4-2150-4765-9740-44d3bdb44a8c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 03:02:48.546366 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 03:02:48.597577 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1530392760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-1530392760',id=13,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-q26dj0rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:38Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=ada45e15-d8ee-4ad0-b222-30f543ee7089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:02:48.597577 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:48.597799 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:48.599252 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'pci_devices' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:48.619545 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Refreshing aggregate associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, aggregates: None {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 03:02:48.692124 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Refreshing trait associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, traits: COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 03:02:48.864584 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6dc238f9-4c03-44cf-acc9-8cbc94784fe8 req-536b5b04-40b3-4f64-872b-a17427f9c642 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:48.864902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6dc238f9-4c03-44cf-acc9-8cbc94784fe8 req-536b5b04-40b3-4f64-872b-a17427f9c642 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:48.866502 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6dc238f9-4c03-44cf-acc9-8cbc94784fe8 req-536b5b04-40b3-4f64-872b-a17427f9c642 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:48.866744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6dc238f9-4c03-44cf-acc9-8cbc94784fe8 req-536b5b04-40b3-4f64-872b-a17427f9c642 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:48.866744 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6dc238f9-4c03-44cf-acc9-8cbc94784fe8 req-536b5b04-40b3-4f64-872b-a17427f9c642 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:48.866834 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6dc238f9-4c03-44cf-acc9-8cbc94784fe8 req-536b5b04-40b3-4f64-872b-a17427f9c642 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state building and task_state spawning.
May 28 03:02:49.071072 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:02:49.071602 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:02:49.103920 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] End _get_guest_xml xml=<domain type="qemu">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <uuid>ada45e15-d8ee-4ad0-b222-30f543ee7089</uuid>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <name>instance-0000000d</name>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1530392760</nova:name>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:02:44</nova:creationTime>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:user uuid="ca35293e06644323b1379cbcfa028d87">tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member</nova:user>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:project uuid="ea07081265c14a80b849530dbb4de34a">tempest-ServerBootFromVolumeStableRescueTest-1646172629</nova:project>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         <nova:port uuid="34e756fe-3ab6-4283-b1fb-dd1682f398c3">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <entry name="serial">ada45e15-d8ee-4ad0-b222-30f543ee7089</entry>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <entry name="uuid">ada45e15-d8ee-4ad0-b222-30f543ee7089</entry>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <alias name="ua-827eac3f-e35b-4ade-a140-b62fff706262"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-2"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <serial>827eac3f-e35b-4ade-a140-b62fff706262</serial>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:10:02:01"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <target dev="tap34e756fe-3a"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/console.log" append="off"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:49.103920 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:02:49.106284 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Preparing to wait for external event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:02:49.106284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:49.106284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:49.106284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:49.108821 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1530392760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-1530392760',id=13,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-q26dj0rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:38Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=ada45e15-d8ee-4ad0-b222-30f543ee7089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:02:49.109782 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:49.110558 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:49.116072 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:02:49.116800 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:02:49.116948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:49.117659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:49.117830 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:02:49.118932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:49.119137 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7426b8e7-2113-57d0-97b8-f481f495be20', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:49.119921 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for e5117e69-981a-42a7-9fdb-c5fb550fe5b9 due to new event <LifecycleEvent: 1779937369.1195927, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:02:49.120064 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937369.1195927, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:49.120176 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Resumed (Lifecycle Event)
May 28 03:02:49.124597 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:49.128085 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance rebooted successfully.
May 28 03:02:49.134500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:49.134897 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34e756fe-3a, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:49.135470 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34e756fe-3a, col_values=(('qos', UUID('695ce4d8-3e7a-437a-845f-2ef8d5efa750')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:49.135571 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34e756fe-3a, col_values=(('external_ids', {'iface-id': '34e756fe-3ab6-4283-b1fb-dd1682f398c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:02:01', 'vm-uuid': 'ada45e15-d8ee-4ad0-b222-30f543ee7089'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:49.138586 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:49.144089 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:49.145254 np0000001589 nova-compute[98297]: INFO os_vif [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a')
May 28 03:02:49.304346 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00045440300004884193 future=<Future at 0x7e4b645f4530 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:49.304624 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:02:49.574655 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:02:49.634019 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:49.642379 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:50.091006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.727s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:50.091006 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:02:50.146162 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 03:02:50.147950 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937370.1465511, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:50.147950 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Started (Lifecycle Event)
May 28 03:02:50.458700 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7955f850-2f2d-4b63-aba3-ddaebe36a40d req-d0609a1f-103e-4343-bf25-f3a712330ba0 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:50.459131 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7955f850-2f2d-4b63-aba3-ddaebe36a40d req-d0609a1f-103e-4343-bf25-f3a712330ba0 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:50.459410 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7955f850-2f2d-4b63-aba3-ddaebe36a40d req-d0609a1f-103e-4343-bf25-f3a712330ba0 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:50.459854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7955f850-2f2d-4b63-aba3-ddaebe36a40d req-d0609a1f-103e-4343-bf25-f3a712330ba0 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:50.460119 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7955f850-2f2d-4b63-aba3-ddaebe36a40d req-d0609a1f-103e-4343-bf25-f3a712330ba0 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:50.460463 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7955f850-2f2d-4b63-aba3-ddaebe36a40d req-d0609a1f-103e-4343-bf25-f3a712330ba0 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state powering-on.
May 28 03:02:50.597248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:02:50.597248 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:02:50.597248 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:50.597248 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:50.644094 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:50.644280 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:50.644404 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:50.644492 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No VIF found with MAC fa:16:3e:e1:0d:00, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:02:50.645212 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e54695eb-66ae-49c8-83cf-331f7440136c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:50.649788 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:50.651820 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:50.665657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:50.665657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:50.665657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No VIF found with MAC fa:16:3e:10:02:01, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:02:50.666325 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Using config drive
May 28 03:02:50.699151 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3934dcdb33cf4de8af57c2013e4896eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bf996a1cea4736a6ecbeaf104eff75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:02:51.105111 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:02:51.155998 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 03:02:51.173903 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:51.208176 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Successfully created port: a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:02:51.309344 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Creating config drive at /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config
May 28 03:02:51.312706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6cw2syfq {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:51.354111 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6cw2syfq" returned: 0 in 0.041s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:51.612431 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:02:51.735925 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Successfully updated port: a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:02:51.775627 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-changed-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:51.775796 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Refreshing instance network info cache due to event network-changed-a7037f7a-d698-47af-8ea0-4a5c0129f183. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:02:51.776038 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] Acquiring lock "refresh_cache-00e053f4-d22d-4a88-b4ec-ef55f263964d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:51.776153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] Acquired lock "refresh_cache-00e053f4-d22d-4a88-b4ec-ef55f263964d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:51.776339 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Refreshing network info cache for port a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:02:51.784920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:51.812675 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:51.901417 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:51.960163 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:51.961510 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:52.238336 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "refresh_cache-00e053f4-d22d-4a88-b4ec-ef55f263964d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:52.283047 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:52.388246 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:02:52.498655 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:52.566580 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:52.627682 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:02:52.627682 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:02:52.627682 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Creating image(s)
May 28 03:02:52.628974 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "/opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:52.629636 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "/opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:52.630585 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "/opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:52.631246 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:52.635154 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:52.636431 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:52.714368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.077s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:52.714368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:52.714810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:52.715445 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:52.719099 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:02:52.719477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:52.750396 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937372.749505, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:52.750867 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Started (Lifecycle Event)
May 28 03:02:52.806114 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:52.806559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:52.857118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk 1073741824" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:52.857662 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.143s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:52.857876 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:52.940926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:52.941754 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:02:52.941999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:53.022902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:53.023315 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Cannot resize image /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:02:53.023689 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:02:53.023856 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Ensure instance console log exists: /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:02:53.024120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:53.024672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:53.024672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:53.069028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e10bb9cd-6e56-466c-9f89-2a8590fc424a req-34a7ccc8-6cb3-4d7c-abeb-c411b52ba2f4 service nova] Releasing lock "refresh_cache-00e053f4-d22d-4a88-b4ec-ef55f263964d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:53.076055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquired lock "refresh_cache-00e053f4-d22d-4a88-b4ec-ef55f263964d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:53.076450 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:02:53.078698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:53.079918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:53.254475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:53.256824 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937373.2564769, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:53.257059 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Paused (Lifecycle Event)
May 28 03:02:53.582164 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:02:53.664754 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:02:53.759474 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:53.761747 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:53.845729 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:54.000109 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Updating instance_info_cache with network_info: [{"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:54.139778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:54.140203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:54.142364 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:54.147965 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:02:54.148199 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Claim successful on node np0000001589
May 28 03:02:54.264112 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:02:54.501982 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Releasing lock "refresh_cache-00e053f4-d22d-4a88-b4ec-ef55f263964d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:02:54.502245 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Instance network_info: |[{"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:02:54.503768 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Start _get_guest_xml network_info=[{"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:02:54.508691 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:02:54.509727 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1108390179', uuid='00e053f4-d22d-4a88-b4ec-ef55f263964d'), owner=OwnerMeta(userid='3934dcdb33cf4de8af57c2013e4896eb', username='tempest-VolumesAdminNegativeTest-2114472830-project-member', projectid='c5bf996a1cea4736a6ecbeaf104eff75', projectname='tempest-VolumesAdminNegativeTest-2114472830'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937374.5094368) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:02:54.510628 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:02:54.510922 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:02:54.512457 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:02:54.512608 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:02:54.513470 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:02:54.513810 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:02:54.513974 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:02:54.514293 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:02:54.514393 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:02:54.514488 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:02:54.514578 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:02:54.514716 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:02:54.514916 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:02:54.514916 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:02:54.515069 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:02:54.515172 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:02:54.525467 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1108390179',display_name='tempest-VolumesAdminNegativeTest-server-1108390179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesadminnegativetest-server-1108390179',id=14,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bf996a1cea4736a6ecbeaf104eff75',ramdisk_id='',reservation_id='r-yuqpqohk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2114472830',owner_user_name='tempest-VolumesAdminNegativeTest-2114472830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:52Z,user_data=None,user_id='3934dcdb33cf4de8af57c2013e4896eb',uuid=00e053f4-d22d-4a88-b4ec-ef55f263964d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:02:54.525653 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Converting VIF {"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:54.526324 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=a7037f7a-d698-47af-8ea0-4a5c0129f183,network=Network(cad4012b-91a1-4403-a602-743681a190b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7037f7a-d6') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:54.526871 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lazy-loading 'pci_devices' on Instance uuid 00e053f4-d22d-4a88-b4ec-ef55f263964d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:02:55.029619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] End _get_guest_xml xml=<domain type="qemu">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <uuid>00e053f4-d22d-4a88-b4ec-ef55f263964d</uuid>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <name>instance-0000000e</name>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1108390179</nova:name>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:02:54</nova:creationTime>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:user uuid="3934dcdb33cf4de8af57c2013e4896eb">tempest-VolumesAdminNegativeTest-2114472830-project-member</nova:user>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:project uuid="c5bf996a1cea4736a6ecbeaf104eff75">tempest-VolumesAdminNegativeTest-2114472830</nova:project>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         <nova:port uuid="a7037f7a-d698-47af-8ea0-4a5c0129f183">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <system>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <entry name="serial">00e053f4-d22d-4a88-b4ec-ef55f263964d</entry>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <entry name="uuid">00e053f4-d22d-4a88-b4ec-ef55f263964d</entry>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </system>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <os>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   </os>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <features>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   </features>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   <devices>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk.config"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </disk>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:f1:12:9f"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <target dev="tapa7037f7a-d6"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </interface>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/console.log" append="off"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </serial>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <video>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </video>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </rng>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:   </devices>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]: </domain>
May 28 03:02:55.029619 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:02:55.029619 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Preparing to wait for external event network-vif-plugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:02:55.029619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:55.031486 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:55.031486 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:55.031486 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1108390179',display_name='tempest-VolumesAdminNegativeTest-server-1108390179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesadminnegativetest-server-1108390179',id=14,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5bf996a1cea4736a6ecbeaf104eff75',ramdisk_id='',reservation_id='r-yuqpqohk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-2114472830',owner_user_name='tempest-VolumesAdminNegativeTest-2114472830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:52Z,user_data=None,user_id='3934dcdb33cf4de8af57c2013e4896eb',uuid=00e053f4-d22d-4a88-b4ec-ef55f263964d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:02:55.031486 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Converting VIF {"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:02:55.031709 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=a7037f7a-d698-47af-8ea0-4a5c0129f183,network=Network(cad4012b-91a1-4403-a602-743681a190b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7037f7a-d6') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:02:55.031709 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=a7037f7a-d698-47af-8ea0-4a5c0129f183,network=Network(cad4012b-91a1-4403-a602-743681a190b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7037f7a-d6') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:02:55.031709 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:55.031951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:55.032236 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:02:55.032921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:55.033098 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ff9c22c-5177-5507-864f-f6e9ef13ae53', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:55.035067 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:55.036162 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:55.040716 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:55.040910 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7037f7a-d6, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:55.041293 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7037f7a-d6, col_values=(('qos', UUID('7fd5c30c-adb3-463b-80c2-48b44ffd168e')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:55.041455 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7037f7a-d6, col_values=(('external_ids', {'iface-id': 'a7037f7a-d698-47af-8ea0-4a5c0129f183', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:12:9f', 'vm-uuid': '00e053f4-d22d-4a88-b4ec-ef55f263964d'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:02:55.043167 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:55.044484 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:02:55.049908 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:55.051138 np0000001589 nova-compute[98297]: INFO os_vif [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=a7037f7a-d698-47af-8ea0-4a5c0129f183,network=Network(cad4012b-91a1-4403-a602-743681a190b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7037f7a-d6')
May 28 03:02:55.417064 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6fc0e403-d554-49ab-88b8-10cb24de22c3 req-351b469c-3660-4d40-a2f7-5d8dfbbe8635 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:55.417646 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6fc0e403-d554-49ab-88b8-10cb24de22c3 req-351b469c-3660-4d40-a2f7-5d8dfbbe8635 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:55.417646 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6fc0e403-d554-49ab-88b8-10cb24de22c3 req-351b469c-3660-4d40-a2f7-5d8dfbbe8635 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:55.417754 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6fc0e403-d554-49ab-88b8-10cb24de22c3 req-351b469c-3660-4d40-a2f7-5d8dfbbe8635 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:55.417906 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6fc0e403-d554-49ab-88b8-10cb24de22c3 req-351b469c-3660-4d40-a2f7-5d8dfbbe8635 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Processing event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:02:55.420028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:02:55.425057 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937375.4227185, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:55.425057 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Resumed (Lifecycle Event)
May 28 03:02:55.425057 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:02:55.430524 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance spawned successfully.
May 28 03:02:55.431142 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:02:55.559036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:02:55.559158 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:02:55.926679 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:55.930222 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:55.939117 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:55.939283 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:55.939591 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:55.939852 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:55.940142 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:55.940500 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:56.074888 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:02:56.136810 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-74cc98d4-a25d-49f0-b4d9-5eba06dc9376 req-08f159ed-e7ee-4181-89fc-b54c4245cdc1 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:56.136950 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-74cc98d4-a25d-49f0-b4d9-5eba06dc9376 req-08f159ed-e7ee-4181-89fc-b54c4245cdc1 service nova] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:56.138462 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-74cc98d4-a25d-49f0-b4d9-5eba06dc9376 req-08f159ed-e7ee-4181-89fc-b54c4245cdc1 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:56.139005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-74cc98d4-a25d-49f0-b4d9-5eba06dc9376 req-08f159ed-e7ee-4181-89fc-b54c4245cdc1 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:56.139137 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-74cc98d4-a25d-49f0-b4d9-5eba06dc9376 req-08f159ed-e7ee-4181-89fc-b54c4245cdc1 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] No event matching network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 in dict_keys([('network-vif-plugged', 'a7037f7a-d698-47af-8ea0-4a5c0129f183')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:02:56.139317 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-74cc98d4-a25d-49f0-b4d9-5eba06dc9376 req-08f159ed-e7ee-4181-89fc-b54c4245cdc1 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received unexpected event network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 for instance with vm_state building and task_state spawning.
May 28 03:02:56.433892 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:02:56.447457 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Took 11.85 seconds to spawn the instance on the hypervisor.
May 28 03:02:56.447770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:56.575694 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.435s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:56.576083 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:02:56.582709 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:56.582867 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:02:56.583015 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] No VIF found with MAC fa:16:3e:f1:12:9f, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:02:56.583626 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Using config drive
May 28 03:02:56.962476 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Took 23.57 seconds to build instance.
May 28 03:02:57.082744 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:02:57.082952 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:02:57.083530 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:57.083530 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:57.095077 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:57.297562 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Creating config drive at /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk.config
May 28 03:02:57.301192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe74qyx_1 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:57.334713 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdecdb6bfb004d4ab1ac71e4d7441b17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715ade0a672744fd95d77abe2cf06e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:02:57.355984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpe74qyx_1" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:02:57.466327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4ada6633-cd9b-474a-ba77-66b4bf59fd28 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.081s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:57.506395 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:57.603171 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:02:57.837392 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:57.868168 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:57.872172 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:57.951360 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:57.996263 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully created port: 3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:02:58.257184 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7440247e-d1ce-4328-b635-48eb8856df0d req-e75b99eb-e41d-4b27-9368-93decbd12eff service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:58.257800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7440247e-d1ce-4328-b635-48eb8856df0d req-e75b99eb-e41d-4b27-9368-93decbd12eff service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:58.257800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7440247e-d1ce-4328-b635-48eb8856df0d req-e75b99eb-e41d-4b27-9368-93decbd12eff service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:58.257800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7440247e-d1ce-4328-b635-48eb8856df0d req-e75b99eb-e41d-4b27-9368-93decbd12eff service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:58.257800 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7440247e-d1ce-4328-b635-48eb8856df0d req-e75b99eb-e41d-4b27-9368-93decbd12eff service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:02:58.258001 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7440247e-d1ce-4328-b635-48eb8856df0d req-e75b99eb-e41d-4b27-9368-93decbd12eff service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state active and task_state rescuing.
May 28 03:02:58.306255 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:58.338054 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:02:58.379409 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0cb1ef4f-ed38-4729-a87b-cefc7385ea3c req-93c181d2-be75-469d-925e-1f1dac5ca112 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-plugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:02:58.379409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0cb1ef4f-ed38-4729-a87b-cefc7385ea3c req-93c181d2-be75-469d-925e-1f1dac5ca112 service nova] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:58.379409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0cb1ef4f-ed38-4729-a87b-cefc7385ea3c req-93c181d2-be75-469d-925e-1f1dac5ca112 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:58.379409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0cb1ef4f-ed38-4729-a87b-cefc7385ea3c req-93c181d2-be75-469d-925e-1f1dac5ca112 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:02:58.379409 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0cb1ef4f-ed38-4729-a87b-cefc7385ea3c req-93c181d2-be75-469d-925e-1f1dac5ca112 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Processing event network-vif-plugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:02:58.480366 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully created port: 5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:02:58.735169 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Rescuing
May 28 03:02:58.735601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:02:58.735601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:02:58.735723 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:02:58.792093 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937378.7916062, 00e053f4-d22d-4a88-b4ec-ef55f263964d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:58.792888 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:02:58.793180 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] VM Started (Lifecycle Event)
May 28 03:02:58.795926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:02:58.803255 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Instance spawned successfully.
May 28 03:02:58.803255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:02:59.002591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:02:59.003026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:02:59.051547 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully created port: 8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:02:59.122418 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:02:59.239919 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:59.299248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:59.305151 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:02:59.313087 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:59.313472 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:59.313713 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:59.313998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:59.314351 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:59.314686 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:02:59.491056 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully created port: 2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:02:59.509429 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:02:59.617609 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:02:59.629035 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Booting with volume 15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 at /dev/vda
May 28 03:02:59.679756 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:02:59.695039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:02:59.724744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:02:59.750838 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Updating instance_info_cache with network_info: [{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:02:59.767690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:02:59.767935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:02:59.780939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:02:59.781739 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe49:abd3', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fef1:129f', 'fe80::30fa:eaff:fe95:2596'] 
May 28 03:02:59.781739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:02:59.781739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:02:59.781739 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:02:59.781739 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating existing volume attachment record: 9d34df14-e283-4742-bf07-932d80af5e80 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:02:59.810768 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:02:59.813446 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937379.8109953, 00e053f4-d22d-4a88-b4ec-ef55f263964d => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:02:59.813446 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] VM Paused (Lifecycle Event)
May 28 03:02:59.821612 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Took 7.19 seconds to spawn the instance on the hypervisor.
May 28 03:02:59.821612 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:02:59.954485 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully created port: 83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:00.044194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:00.084034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:00.084340 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:00.087574 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:03:00.087723 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Claim successful on node np0000001589
May 28 03:03:00.254038 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:00.314026 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:00.317076 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937380.3166144, 00e053f4-d22d-4a88-b4ec-ef55f263964d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:00.317076 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] VM Resumed (Lifecycle Event)
May 28 03:03:00.333480 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Took 13.21 seconds to build instance.
May 28 03:03:00.414630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:00.414867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:00.468572 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a83c5bd3-b046-47bc-a25c-3e542ba23e85 req-2aea3852-e385-4f53-a2c0-76f37502ccbe service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-plugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:00.472138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a83c5bd3-b046-47bc-a25c-3e542ba23e85 req-2aea3852-e385-4f53-a2c0-76f37502ccbe service nova] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:00.472271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a83c5bd3-b046-47bc-a25c-3e542ba23e85 req-2aea3852-e385-4f53-a2c0-76f37502ccbe service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:00.472384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a83c5bd3-b046-47bc-a25c-3e542ba23e85 req-2aea3852-e385-4f53-a2c0-76f37502ccbe service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:00.472499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a83c5bd3-b046-47bc-a25c-3e542ba23e85 req-2aea3852-e385-4f53-a2c0-76f37502ccbe service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] No waiting events found dispatching network-vif-plugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:00.472607 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a83c5bd3-b046-47bc-a25c-3e542ba23e85 req-2aea3852-e385-4f53-a2c0-76f37502ccbe service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received unexpected event network-vif-plugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 for instance with vm_state active and task_state None.
May 28 03:03:00.548172 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully updated port: 3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:00.819667 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:00.821587 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:00.835542 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.723s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:00.919758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:03:01.411046 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Booting with volume c05d3409-3e4a-42de-ab33-7823c0faba4a at /dev/vdb
May 28 03:03:01.478039 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:01.480345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:01.491182 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:01.514427 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:01.549877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:01.550407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:01.562117 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:01.564078 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe49:abd3', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fef1:129f', 'fe80::30fa:eaff:fe95:2596'] 
May 28 03:03:01.564078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:01.564078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:01.564078 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:01.564332 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating existing volume attachment record: 83f447c5-e2be-4e22-9db8-acde4e7eb661 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:01.648135 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:01.649250 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:01.656377 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully updated port: 2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:01.742029 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:01.742127 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:01.742370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:01.742506 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:01.742624 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port 2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:01.906652 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:01.940081 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:02.064738 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87a36af3-3e2f-48a6-ae88-55a0756ace7b req-40a1a37d-5727-45a5-8c52-29face765aea service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:02.064738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87a36af3-3e2f-48a6-ae88-55a0756ace7b req-40a1a37d-5727-45a5-8c52-29face765aea service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:02.064738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87a36af3-3e2f-48a6-ae88-55a0756ace7b req-40a1a37d-5727-45a5-8c52-29face765aea service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:02.064738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87a36af3-3e2f-48a6-ae88-55a0756ace7b req-40a1a37d-5727-45a5-8c52-29face765aea service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:02.064738 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87a36af3-3e2f-48a6-ae88-55a0756ace7b req-40a1a37d-5727-45a5-8c52-29face765aea service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:02.065565 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-87a36af3-3e2f-48a6-ae88-55a0756ace7b req-40a1a37d-5727-45a5-8c52-29face765aea service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state active and task_state rescuing.
May 28 03:03:02.079753 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:02.087524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:02.153269 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:02.224442 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99904934899996 future=<Future at 0x7e4b40635e50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:02.226239 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.997273739999855 future=<Future at 0x7e4b40635e50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:02.226507 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance destroyed successfully.
May 28 03:03:02.226709 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.996784212999955 future=<Future at 0x7e4b40635e50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:02.227757 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'numa_topology' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:02.249344 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:02.325896 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:02.510414 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:02.515654 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:02.570254 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:02.570671 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-3216c453-3e7f-455e-8c3b-d1d783b1c2a1. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:02.570671 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:02.665928 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.582s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:02.666768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.186s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:02.667458 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:03:02.674865 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:03:02.675075 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Claim successful on node np0000001589
May 28 03:03:02.736957 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Attempting a stable device rescue
May 28 03:03:02.790475 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully updated port: f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:02.829686 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98297) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 03:03:02.833198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:03:02.833351 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Creating image(s)
May 28 03:03:02.833798 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:02.833936 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:02.834387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:02.834543 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'trusted_certs' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:03.017923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-42605665-b85f-4118-b126-da7c0ffbacd1 req-2ef33ecf-8a9c-4f9b-9387-d5bc3f24d0a4 service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:03.018168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:03.018361 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port 3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:03.185066 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:03:03.185066 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:03:03.185066 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:03.185066 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:03.188828 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Booting with volume db58a6fd-90c3-4be8-8727-e5e79872375f at /dev/vdc
May 28 03:03:03.232504 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:03.248007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:03.270495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:03.286738 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49a98ac8a8a84d1496b8b48952956e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00f74b8638345979e76606cba0149ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:03:03.304296 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:03.304647 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:03.314661 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:03.319982 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe49:abd3', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fef1:129f', 'fe80::30fa:eaff:fe95:2596'] 
May 28 03:03:03.320184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:03.320378 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:03.320678 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:03.320936 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating existing volume attachment record: 49ae5df0-d7a9-4d16-88a2-e18f5c5398dd {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:03.336254 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:03.339281 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "56768f25ecf309c990f2570fd63133f84323b898" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:03.339281 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "56768f25ecf309c990f2570fd63133f84323b898" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:03.455073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:03.455604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:03.455604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:03.455604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:03.455779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:03.460806 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Terminating instance
May 28 03:03:03.521305 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:03.631007 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:03.684525 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:03:03.951344 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:03.969673 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:03:04.001922 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Successfully created port: 534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:04.005637 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.027594 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.034258 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.063884 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.114373 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully updated port: 5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:04.149948 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-382a5d01-cd62-4180-b27e-c95a50c4fd1a req-77b5cb24-9924-469e-b3b5-d64fde56c034 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:04.150118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-382a5d01-cd62-4180-b27e-c95a50c4fd1a req-77b5cb24-9924-469e-b3b5-d64fde56c034 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:04.151103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-382a5d01-cd62-4180-b27e-c95a50c4fd1a req-77b5cb24-9924-469e-b3b5-d64fde56c034 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:04.151243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-382a5d01-cd62-4180-b27e-c95a50c4fd1a req-77b5cb24-9924-469e-b3b5-d64fde56c034 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:04.151438 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-382a5d01-cd62-4180-b27e-c95a50c4fd1a req-77b5cb24-9924-469e-b3b5-d64fde56c034 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:04.152370 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-382a5d01-cd62-4180-b27e-c95a50c4fd1a req-77b5cb24-9924-469e-b3b5-d64fde56c034 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state active and task_state rescuing.
May 28 03:03:04.194559 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:03:04.242086 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:04.245325 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:04.245867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:04.330334 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998790378999956 future=<Future at 0x7e4b407f4470 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:04.337333 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Instance destroyed successfully.
May 28 03:03:04.340757 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lazy-loading 'resources' on Instance uuid 00e053f4-d22d-4a88-b4ec-ef55f263964d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:04.344893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.part --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:04.345828 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] 12a08f8a-cf3c-4000-b2e0-8bb0dbdcaae5 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:03:04.346500 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:03:04.346851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.part /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:04.370424 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:04.371045 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:04.424725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.part /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.converted" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:04.430310 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:04.459935 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc8675c1-ee8f-4871-a182-88421edaa740 req-08963fcb-8f86-4872-ae77-cda319e4dde8 service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:04.520221 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898.converted --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:04.520893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "56768f25ecf309c990f2570fd63133f84323b898" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.184s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:04.521523 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:04.526841 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:04.528926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "56768f25ecf309c990f2570fd63133f84323b898" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:04.529553 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "56768f25ecf309c990f2570fd63133f84323b898" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:04.529876 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:04.532628 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:04.533133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:04.621506 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898 --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:04.622253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898,backing_fmt=raw /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.rescue {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:04.654554 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:04.657412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-f05a7921-2b12-438f-ba0c-e3246b54d45c. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:04.660219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:04.660219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:04.660219 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:04.671052 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/56768f25ecf309c990f2570fd63133f84323b898,backing_fmt=raw /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.rescue" returned: 0 in 0.049s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:04.671520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "56768f25ecf309c990f2570fd63133f84323b898" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:04.671835 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'migration_context' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:04.691545 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Successfully updated port: 534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:04.745847 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-changed-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:04.746359 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Refreshing instance network info cache due to event network-changed-534ae006-09c5-4883-b913-8365ce689378. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:04.746610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] Acquiring lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:04.746840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] Acquired lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:04.748065 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Refreshing network info cache for port 534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:04.847317 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1108390179',display_name='tempest-VolumesAdminNegativeTest-server-1108390179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesadminnegativetest-server-1108390179',id=14,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:02:59Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5bf996a1cea4736a6ecbeaf104eff75',ramdisk_id='',reservation_id='r-yuqpqohk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-2114472830',owner_user_name='tempest-VolumesAdminNegativeTest-2114472830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:00Z,user_data=None,user_id='3934dcdb33cf4de8af57c2013e4896eb',uuid=00e053f4-d22d-4a88-b4ec-ef55f263964d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:03:04.847529 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Converting VIF {"id": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "address": "fa:16:3e:f1:12:9f", "network": {"id": "cad4012b-91a1-4403-a602-743681a190b9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-987645249-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c5bf996a1cea4736a6ecbeaf104eff75", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7037f7a-d6", "ovs_interfaceid": "a7037f7a-d698-47af-8ea0-4a5c0129f183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:04.848439 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=a7037f7a-d698-47af-8ea0-4a5c0129f183,network=Network(cad4012b-91a1-4403-a602-743681a190b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7037f7a-d6') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:04.848756 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=a7037f7a-d698-47af-8ea0-4a5c0129f183,network=Network(cad4012b-91a1-4403-a602-743681a190b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7037f7a-d6') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:03:04.851365 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.851687 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7037f7a-d6, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:04.852957 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.853876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:04.861117 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.862201 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.862379 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7fd5c30c-adb3-463b-80c2-48b44ffd168e) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:04.862890 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.863443 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:04.872867 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:04.877832 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:04.884522 np0000001589 nova-compute[98297]: INFO os_vif [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:12:9f,bridge_name='br-int',has_traffic_filtering=True,id=a7037f7a-d698-47af-8ea0-4a5c0129f183,network=Network(cad4012b-91a1-4403-a602-743681a190b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7037f7a-d6')
May 28 03:03:04.884948 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Deleting instance files /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d_del
May 28 03:03:04.886000 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Deletion of /opt/stack/data/nova/instances/00e053f4-d22d-4a88-b4ec-ef55f263964d_del complete
May 28 03:03:05.162835 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:05.175660 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:05.175953 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:03:05.176741 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Start _get_guest_xml network_info=[{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:10:02:01"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '12a08f8a-cf3c-4000-b2e0-8bb0dbdcaae5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'cfa35300-de51-4b1f-b1eb-d0af18cb665a', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, 'status': 'reserved', 'instance': 'ada45e15-d8ee-4ad0-b222-30f543ee7089', 'attached_at': '', 'detached_at': '', 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'serial': '827eac3f-e35b-4ade-a140-b62fff706262'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:05.176969 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'resources' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:05.186099 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully updated port: 8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:05.194894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:05.207998 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:03:05.209009 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:03:05.209295 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Creating image(s)
May 28 03:03:05.210040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:05.210238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "/opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:05.210710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "/opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:05.211239 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:05.213841 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:05.218719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:05.251061 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:05.290798 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:05.312692 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:05.314030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:05.314030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:05.314030 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:05.316445 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:05.316891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:05.331927 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:05.391808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.725s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:05.395417 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:03:05.398459 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Took 1.43 seconds to destroy the instance on the hypervisor.
May 28 03:03:05.399256 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:03:05.399464 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:03:05.399554 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:03:05.399891 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:05.406714 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:05.407440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:05.457908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk 1073741824" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:05.458511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.145s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:05.458897 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:05.486276 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:03:05.489551 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:03:05.489875 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Creating image(s)
May 28 03:03:05.491073 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:03:05.491073 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Ensure instance console log exists: /opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:03:05.491193 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:05.491666 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:05.491889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:05.536008 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:05.550029 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:05.557780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:05.558611 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:03:05.560084 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:05.578195 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:05.635799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:05.636518 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Cannot resize image /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:03:05.636844 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:03:05.637007 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Ensure instance console log exists: /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:03:05.637547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:05.637547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:05.637685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:05.683689 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:05.691063 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:05.692411 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1530392760', uuid='ada45e15-d8ee-4ad0-b222-30f543ee7089'), owner=OwnerMeta(userid='ca35293e06644323b1379cbcfa028d87', username='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member', projectid='ea07081265c14a80b849530dbb4de34a', projectname='tempest-ServerBootFromVolumeStableRescueTest-1646172629'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:10:02:01"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937385.6918652) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:05.693626 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:05.694085 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:05.695507 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:05.695757 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:05.697059 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:05.697583 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:05.697775 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:05.697913 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:05.698078 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:05.698213 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:05.698390 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:05.698601 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:05.698826 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:05.699019 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:05.699019 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:05.699195 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:05.700080 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'vcpu_model' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:05.906894 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:03:05.907034 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:03:05.907295 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:05.907528 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:06.038477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:06.038665 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:06.038776 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-5560f8fa-1f24-462f-b908-5aa738c9240b. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:06.038905 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:06.038986 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:06.039094 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port 5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:06.052594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c6db2742-45e6-42a4-bbcc-f7c3a8e8b9cc req-b8e43bfb-be1c-4393-9854-45c6203937cc service nova] Releasing lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:06.053378 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquired lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:06.053531 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:06.140237 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcd7536c083d44349596a82948bb40e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '077e33a200944c65a8018f12fe6f499e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:03:06.202486 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:06.217700 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:06.242249 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully updated port: 2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:06.289347 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:06.289347 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-2b109c91-d16a-4f52-8cc6-f1327fcd5621. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:06.289347 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:06.301544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:06.301998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:06.302204 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:06.302746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:06.303062 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:06.303465 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:06.303637 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:06.303990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:06.304210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:06.317257 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:06.317257 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:06.317515 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:06.317581 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:06.318783 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:06.320440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:06.320709 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:06.330469 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:06.330469 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:06.338012 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:06.338012 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:06.350456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:06.350977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:06.367617 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.367617 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.367617 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.367617 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.367617 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.367617 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.367617 np0000001589 nova-compute[98297]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:06.367617 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:06.368017 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:06.368017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.048s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:06.368391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:06.368669 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('14', '0', '0', 0) found on session 28 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:06.368767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 14 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:06.373002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.373002 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.373002 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.373002 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.373002 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.373002 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.373002 np0000001589 nova-compute[98297]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:06.373002 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:06.373207 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.373207 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:06.373207 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.373207 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:06.373207 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.373207 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:06.373207 np0000001589 nova-compute[98297]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:06.373207 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:06.373370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:06.373483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:06.373928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('13', '0', '0', 0) found on session 27 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:06.374022 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 13 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:06.380645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 28 and hctl ('14', '0', '0', 0) yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:06.380917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:06.388458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 27 and hctl ('13', '0', '0', 0) yield: sdh {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:06.388596 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:06.410976 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:03:06.544992 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:06.673693 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:06.721302 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:06.791489 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:06.792495 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-8f4823d8-e26e-4c35-8521-88219b693c40. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:06.792732 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:06.802842 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully created port: 3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:06.822703 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Took 1.42 seconds to deallocate network for instance.
May 28 03:03:06.912910 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:06.966833 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:07.118774 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Updating instance_info_cache with network_info: [{"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:07.264857 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully created port: a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:07.310263 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Successfully updated port: 83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:07.321404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:07.335739 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:07.335979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:07.372214 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:07.374551 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-83bdc31d-1f6f-4435-a9b1-0e17677f9340. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:07.374862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:07.469329 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:07.469575 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:07.469827 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:07.470026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:07.470182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:07.470373 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] No waiting events found dispatching network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:07.470543 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:03:07.470708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:07.470976 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Acquiring lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:07.471074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:07.471267 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:07.471453 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] No waiting events found dispatching network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:07.471720 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-44b6bff6-4aa0-4c27-84c2-ed74343ba964 req-5ae7597f-2eec-407d-8efd-6848d8000816 service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-unplugged-a7037f7a-d698-47af-8ea0-4a5c0129f183 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:03:07.472030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:07.472148 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port 2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:07.512128 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:07.591824 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:07.592017 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:07.623491 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Releasing lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:07.623832 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Instance network_info: |[{"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:03:07.625743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Start _get_guest_xml network_info=[{"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:07.628393 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:07.629414 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-622675806', uuid='ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe'), owner=OwnerMeta(userid='49a98ac8a8a84d1496b8b48952956e32', username='tempest-VolumesSnapshotTestJSON-1234909468-project-member', projectid='e00f74b8638345979e76606cba0149ce', projectname='tempest-VolumesSnapshotTestJSON-1234909468'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937387.628969) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:07.631269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:07.631663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:07.632470 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:07.632655 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:07.633619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:07.633910 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:07.634063 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:07.634175 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:07.634301 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:07.634374 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:07.634457 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:07.634619 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:07.634713 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:07.634833 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:07.634934 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:07.635059 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:07.648602 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-622675806',display_name='tempest-VolumesSnapshotTestJSON-instance-622675806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumessnapshottestjson-instance-622675806',id=16,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErIwtzqefvEOm/YN8ek3ZSyZ2dXfp2SL+0IYTZ4S4i6ZmNPY5Ax9/JL1ilLg7mWxyB7B7bhQcumSMdau9TK9MfS9yTfbiuk2RgO5AjtQPktXUZtvZrhtdLYBMUgvUFm6g==',key_name='tempest-keypair-241551643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e00f74b8638345979e76606cba0149ce',ramdisk_id='',reservation_id='r-5q5zjm2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1234909468',owner_user_name='tempest-VolumesSnapshotTestJSON-1234909468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a98ac8a8a84d1496b8b48952956e32',uuid=ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:07.648891 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converting VIF {"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:07.649486 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f3:0e,bridge_name='br-int',has_traffic_filtering=True,id=534ae006-09c5-4883-b913-8365ce689378,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534ae006-09') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:07.650185 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'pci_devices' on Instance uuid ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:07.744851 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully created port: f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:07.812963 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:07.845503 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:07.845868 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:07.922748 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:03:07.974510 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:08.064503 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:08.096634 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Detaching volume 58675be1-7fd6-4b3d-b052-35953ff77261
May 28 03:03:08.142146 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Attempting to driver detach volume 58675be1-7fd6-4b3d-b052-35953ff77261 from mountpoint /dev/vdb
May 28 03:03:08.145437 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Found disk vdb by alias ua-58675be1-7fd6-4b3d-b052-35953ff77261 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:03:08.146609 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Found disk vdb by alias ua-58675be1-7fd6-4b3d-b052-35953ff77261 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:03:08.146781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Attempting to detach device vdb from instance a6d1b015-c35f-4563-be6b-754693ecbe8d from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:03:08.147067 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:03:08.147067 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:08.147067 np0000001589 nova-compute[98297]:   <alias name="ua-58675be1-7fd6-4b3d-b052-35953ff77261"/>
May 28 03:03:08.147067 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:03:08.147067 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:03:08.147067 np0000001589 nova-compute[98297]:   <serial>58675be1-7fd6-4b3d-b052-35953ff77261</serial>
May 28 03:03:08.147067 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:03:08.147067 np0000001589 nova-compute[98297]: </disk>
May 28 03:03:08.147067 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:03:08.159034 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <uuid>ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe</uuid>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <name>instance-00000010</name>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-622675806</nova:name>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:07</nova:creationTime>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:user uuid="49a98ac8a8a84d1496b8b48952956e32">tempest-VolumesSnapshotTestJSON-1234909468-project-member</nova:user>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:project uuid="e00f74b8638345979e76606cba0149ce">tempest-VolumesSnapshotTestJSON-1234909468</nova:project>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         <nova:port uuid="534ae006-09c5-4883-b913-8365ce689378">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <entry name="serial">ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe</entry>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <entry name="uuid">ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe</entry>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk.config"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:2a:f3:0e"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <target dev="tap534ae006-09"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/console.log" append="off"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:08.159034 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:08.161302 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully detached device vdb from instance a6d1b015-c35f-4563-be6b-754693ecbe8d from the persistent domain config.
May 28 03:03:08.161809 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Preparing to wait for external event network-vif-plugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:08.161908 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] (1/8): Attempting to detach device vdb with device alias ua-58675be1-7fd6-4b3d-b052-35953ff77261 from instance a6d1b015-c35f-4563-be6b-754693ecbe8d from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:03:08.162349 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:03:08.162349 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:08.162349 np0000001589 nova-compute[98297]:   <alias name="ua-58675be1-7fd6-4b3d-b052-35953ff77261"/>
May 28 03:03:08.162349 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:03:08.162349 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:03:08.162349 np0000001589 nova-compute[98297]:   <serial>58675be1-7fd6-4b3d-b052-35953ff77261</serial>
May 28 03:03:08.162349 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:03:08.162349 np0000001589 nova-compute[98297]: </disk>
May 28 03:03:08.162349 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:03:08.162642 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:08.162973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:08.163220 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:08.163981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-622675806',display_name='tempest-VolumesSnapshotTestJSON-instance-622675806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumessnapshottestjson-instance-622675806',id=16,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErIwtzqefvEOm/YN8ek3ZSyZ2dXfp2SL+0IYTZ4S4i6ZmNPY5Ax9/JL1ilLg7mWxyB7B7bhQcumSMdau9TK9MfS9yTfbiuk2RgO5AjtQPktXUZtvZrhtdLYBMUgvUFm6g==',key_name='tempest-keypair-241551643',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e00f74b8638345979e76606cba0149ce',ramdisk_id='',reservation_id='r-5q5zjm2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1234909468',owner_user_name='tempest-VolumesSnapshotTestJSON-1234909468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a98ac8a8a84d1496b8b48952956e32',uuid=ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:08.164145 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converting VIF {"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:08.164726 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f3:0e,bridge_name='br-int',has_traffic_filtering=True,id=534ae006-09c5-4883-b913-8365ce689378,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534ae006-09') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:08.165000 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f3:0e,bridge_name='br-int',has_traffic_filtering=True,id=534ae006-09c5-4883-b913-8365ce689378,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534ae006-09') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:08.166804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:08.166804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:08.166804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:08.166804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:08.167150 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbe8520c-f24d-5c47-8191-637afcb87310', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:08.167940 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:08.169481 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:08.174828 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:08.177765 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:08.177989 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap534ae006-09, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:08.178373 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap534ae006-09, col_values=(('qos', UUID('384d000e-357a-4d7b-addd-4c2f042b514c')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:08.178574 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap534ae006-09, col_values=(('external_ids', {'iface-id': '534ae006-09c5-4883-b913-8365ce689378', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:f3:0e', 'vm-uuid': 'ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:08.180608 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:08.182061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:08.196545 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:08.200259 np0000001589 nova-compute[98297]: INFO os_vif [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:f3:0e,bridge_name='br-int',has_traffic_filtering=True,id=534ae006-09c5-4883-b913-8365ce689378,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534ae006-09')
May 28 03:03:08.218567 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully created port: ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:08.248877 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:08.339855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Found WWN 330000000b6978475 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:08.340051 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:08.340236 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== connect_volume: return (2036ms) {'type': 'block', 'scsi_wwn': '330000000b6978475', 'path': '/dev/dm-2', 'multipath_id': '330000000b6978475'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:08.340367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b6978475', 'path': '/dev/dm-2', 'multipath_id': '330000000b6978475'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:08.348642 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:08.428285 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Booting with volume ef60b330-4fcb-41e8-871c-edf3f5932bba at /dev/vda
May 28 03:03:08.487702 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:08.498619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:08.519016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:08.552511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:08.553042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:08.561743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:08.563037 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe49:abd3', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6'] 
May 28 03:03:08.563183 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:08.563322 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:08.563548 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:08.563859 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating existing volume attachment record: 326b4536-2622-4731-accb-cc881ff07444 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:08.717550 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully created port: a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:08.751417 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a0dd5a65-92cd-473b-a0b4-6ded0c39c30e req-d93bedd1-7cb5-4ea9-b35b-6ec8a4f2cbfc service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:08.751981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:08.752102 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port 8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:08.794462 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937388.7928815, a6d1b015-c35f-4563-be6b-754693ecbe8d => ua-58675be1-7fd6-4b3d-b052-35953ff77261> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:03:08.795367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-58675be1-7fd6-4b3d-b052-35953ff77261 for instance a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:03:08.797932 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully detached device vdb from instance a6d1b015-c35f-4563-be6b-754693ecbe8d from the live domain config.
May 28 03:03:08.798898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:03:08.799359 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:08.799490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:08.799927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:08.800243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '58675be1-7fd6-4b3d-b052-35953ff77261', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:03:08.800397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:03:08.826523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:08.826523 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:08.826523 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:08.826523 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:08.826523 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:08.826523 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:08.826523 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:08.826738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [17] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:08.826738 np0000001589 nova-compute[98297]: tcp: [18] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261 (non-flash)
May 28 03:03:08.826738 np0000001589 nova-compute[98297]: tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:08.826738 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:08.826738 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:08.826738 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:08.826738 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:08.826899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '17'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:03:08.826899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '17')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:03:08.828286 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261', '18')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:03:08.828967 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b800a58a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'): ({'sdd'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:03:08.829154 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Removing multipathed devices sdd, sdc {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:03:08.829417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flush multipath device 33000000044380a15 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:03:08.847988 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1530392760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-1530392760',id=13,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:02:56Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-q26dj0rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:56Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=ada45e15-d8ee-4ad0-b222-30f543ee7089,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:10:02:01"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:08.848249 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:10:02:01"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:08.848734 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:08.849433 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'pci_devices' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:08.856046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.520s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:08.870544 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:03:08.906456 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Deleted allocations for instance 00e053f4-d22d-4a88-b4ec-ef55f263964d
May 28 03:03:08.920507 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:03:08.960475 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:03:08.960658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:03:08.961540 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:03:08.972675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:03:08.972983 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:03:08.985357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:09.014314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260]
May 28 03:03:09.014314 np0000001589 nova-compute[98297]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.40.100,3260] successful.
May 28 03:03:09.014314 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:09.029073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:09.038886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:09.073133 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260]
May 28 03:03:09.073133 np0000001589 nova-compute[98297]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-58675be1-7fd6-4b3d-b052-35953ff77261, portal: 192.168.50.100,3260] successful.
May 28 03:03:09.073133 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:09.085666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:09.085854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:09.085970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== disconnect_volume: return (286ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:09.086098 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:03:09.198269 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully updated port: 3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:09.254243 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:09.325620 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:09.352046 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:09.353380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <uuid>ada45e15-d8ee-4ad0-b222-30f543ee7089</uuid>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <name>instance-0000000d</name>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1530392760</nova:name>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:05</nova:creationTime>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:user uuid="ca35293e06644323b1379cbcfa028d87">tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member</nova:user>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:project uuid="ea07081265c14a80b849530dbb4de34a">tempest-ServerBootFromVolumeStableRescueTest-1646172629</nova:project>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         <nova:port uuid="34e756fe-3ab6-4283-b1fb-dd1682f398c3">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <entry name="serial">ada45e15-d8ee-4ad0-b222-30f543ee7089</entry>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <entry name="uuid">ada45e15-d8ee-4ad0-b222-30f543ee7089</entry>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <alias name="ua-827eac3f-e35b-4ade-a140-b62fff706262"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-2"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <serial>827eac3f-e35b-4ade-a140-b62fff706262</serial>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.rescue"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <boot order="1"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:10:02:01"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <target dev="tap34e756fe-3a"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/console.log" append="off"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:09.353380 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:09.362663 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance destroyed successfully.
May 28 03:03:09.427594 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:09.428534 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:09.428691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:09.428774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:09.428875 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port 3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:09.461001 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:09.631133 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'flavor' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:09.718439 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:09.718439 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:09.718597 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No VIF found with MAC fa:16:3e:2a:f3:0e, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:09.718971 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Using config drive
May 28 03:03:09.915840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1715699b-c3f7-447f-a47b-1ec2e4305560 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Lock "00e053f4-d22d-4a88-b4ec-ef55f263964d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.460s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:09.933567 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:09.962604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:09.962793 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b544c46-f6bf-46e7-a2d3-9f06ce2a6541 req-94abbd30-666d-4d67-b851-146bacf178ea service nova] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Received event network-vif-deleted-a7037f7a-d698-47af-8ea0-4a5c0129f183 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:09.963058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:09.963187 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port 83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:10.008351 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:10.149334 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:10.166195 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Booting with volume aac98498-ef87-4ea4-8b0a-47d9eef04ca9 at /dev/vdb
May 28 03:03:10.207851 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:10.218853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:10.223571 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:10.241085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:10.275570 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:10.275951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:10.284442 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:10.286364 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe49:abd3', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6'] 
May 28 03:03:10.286574 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:10.286725 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:10.287248 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:10.288096 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating existing volume attachment record: d1604db0-8ff9-4840-89c5-215d919c1300 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:10.375391 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Creating config drive at /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk.config
May 28 03:03:10.384104 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp48furs7z {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:10.429006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp48furs7z" returned: 0 in 0.045s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:10.465623 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:10.615568 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully updated port: 6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:10.637859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8745c786-7dbb-4a14-99d4-a4e472ee0a73 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.046s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:10.650792 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d3cf8b3f-7774-48ce-bbaf-291cbb7c0d1c req-ab25f5c9-eff6-4bf7-9f26-899aeefbd20b service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:10.658978 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:10.798210 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:10.882653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:10.882787 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:10.883055 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:10.883055 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No VIF found with MAC fa:16:3e:10:02:01, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:10.883832 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Using config drive
May 28 03:03:10.905090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:10.905307 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:10.905468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:10.905618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:10.905711 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:10.907838 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Terminating instance
May 28 03:03:10.915991 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:10.951626 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.039615 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.222352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.229175 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.232564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.262523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.268670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.300762 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d9a2c2a-645c-4158-8966-47459aef1864 req-638f181e-6a74-4f9d-84eb-d9d6f6fb0b07 service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:11.302168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:11.302168 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:11.387573 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'ec2_ids' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:11.415551 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:03:11.442788 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.446307 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.471466 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.505880 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:11.506085 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-6f9d30b5-ddb6-4742-a71e-4586b2896fd7. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:11.506280 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:11.506372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:11.506583 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port 6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:11.601718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.611250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:11.700757 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b2be8b95-8788-470f-80ea-5d784dff8fa9 req-c4facaad-05de-43cb-9fbb-064cca06f8d5 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:11.701268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b2be8b95-8788-470f-80ea-5d784dff8fa9 req-c4facaad-05de-43cb-9fbb-064cca06f8d5 service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:11.702563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b2be8b95-8788-470f-80ea-5d784dff8fa9 req-c4facaad-05de-43cb-9fbb-064cca06f8d5 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:11.702563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b2be8b95-8788-470f-80ea-5d784dff8fa9 req-c4facaad-05de-43cb-9fbb-064cca06f8d5 service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:11.702563 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b2be8b95-8788-470f-80ea-5d784dff8fa9 req-c4facaad-05de-43cb-9fbb-064cca06f8d5 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] No waiting events found dispatching network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:11.702563 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b2be8b95-8788-470f-80ea-5d784dff8fa9 req-c4facaad-05de-43cb-9fbb-064cca06f8d5 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:03:11.703031 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937391.7028067, ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:11.703195 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] VM Started (Lifecycle Event)
May 28 03:03:11.736146 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Instance destroyed successfully.
May 28 03:03:11.736620 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'resources' on Instance uuid a6d1b015-c35f-4563-be6b-754693ecbe8d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:11.853811 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully updated port: 71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:11.891191 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:11.893373 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Booting with volume 8f810741-3315-4c52-9a1f-0c51ae77e7db at /dev/vdc
May 28 03:03:11.896661 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:11.897529 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'keypairs' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:11.944603 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:11.957297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:11.984415 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:12.005239 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:12.013692 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:12.018215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:12.018522 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:12.027590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:12.029026 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fee1:d00', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fe2a:f30e', 'fe80::e88a:9dff:fe29:20d6'] 
May 28 03:03:12.029271 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:12.029348 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:12.029590 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:12.029817 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating existing volume attachment record: 0bc0f2a3-8d66-471e-90a1-1b3756696ef1 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:12.121077 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:12.136527 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:12.206021 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:12.210202 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937392.209908, ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:12.210396 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] VM Paused (Lifecycle Event)
May 28 03:03:12.238879 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1347059805',display_name='tempest-ServerActionsTestOtherA-server-1451633244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-tempest-common-compute-instance-1347059805',id=10,image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3H3xbkuEJFp5BVC9tKLUKzuY22S28zMPGvGibNwb7aG9A8j7iR2rOpJXsWGV+ZFxoYlaqtGtx5+IK7e6ZVXbzZE2A6Oh/00/TmK0lxprE9tXtzjPsvTuUyPdpOpxd10A==',key_name='tempest-keypair-1895656678',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:02:29Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-7xlcz90c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=a6d1b015-c35f-4563-be6b-754693ecbe8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:03:12.239169 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "82527285-9862-47e9-92e1-5f234948dddd", "address": "fa:16:3e:49:ab:d3", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap82527285-98", "ovs_interfaceid": "82527285-9862-47e9-92e1-5f234948dddd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:12.239891 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:12.240210 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:03:12.242250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:12.242479 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82527285-98, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:12.244849 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:12.250024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:12.251024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:12.251266 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58de7021-fe32-4259-bbc3-832c2717dcd5) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:12.252009 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:12.252545 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:12.258096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:12.260407 np0000001589 nova-compute[98297]: INFO os_vif [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:49:ab:d3,bridge_name='br-int',has_traffic_filtering=True,id=82527285-9862-47e9-92e1-5f234948dddd,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82527285-98')
May 28 03:03:12.260751 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Deleting instance files /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d_del
May 28 03:03:12.261628 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Deletion of /opt/stack/data/nova/instances/a6d1b015-c35f-4563-be6b-754693ecbe8d_del complete
May 28 03:03:12.310489 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:12.402438 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:12.404826 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:12.514709 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:12.643213 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:12.665385 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Creating config drive at /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config.rescue
May 28 03:03:12.669340 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmponxci1zp {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:12.715184 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:12.720965 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:12.726261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmponxci1zp" returned: 0 in 0.056s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:12.770249 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:03:12.770974 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:03:12.771408 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:03:12.771548 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:03:12.772045 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:12.823247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:12.823375 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-vif-plugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:12.824181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:12.824181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:12.824181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:12.824181 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acc3db11-90df-4dd6-88bb-566f62abcb37 req-e7c73c1f-ddef-4ba0-8112-dc683d44e42f service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Processing event network-vif-plugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:12.824793 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:03:12.827852 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:03:12.838139 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Instance spawned successfully.
May 28 03:03:12.838497 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:03:12.892102 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:13.199722 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:13.224409 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:03:13.225996 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999712446999865 future=<Future at 0x7e4b407c1040 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:13.227815 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937393.2261858, ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:13.227815 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] VM Resumed (Lifecycle Event)
May 28 03:03:13.228137 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:13.229956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:13.328159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:13.349641 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:13.349641 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:13.350446 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:13.350446 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:13.350979 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:13.351046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:13.408749 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:13.410318 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:13.597463 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully updated port: a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:13.631829 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:13.725580 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-vif-plugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:13.725580 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:13.725580 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:13.725580 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:13.725580 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] No waiting events found dispatching network-vif-plugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:13.725580 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received unexpected event network-vif-plugged-534ae006-09c5-4883-b913-8365ce689378 for instance with vm_state building and task_state spawning.
May 28 03:03:13.725580 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-deleted-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:13.725850 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Neutron deleted interface 82527285-9862-47e9-92e1-5f234948dddd; detaching it from the instance and deleting it from the info cache
May 28 03:03:13.732674 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:13.734061 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-813a8be0-92b0-43b6-840b-c6b65716491c req-d07fdddb-7f5a-4ae5-890e-e854517c6402 service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Detach interface failed, port_id=82527285-9862-47e9-92e1-5f234948dddd, reason: Instance a6d1b015-c35f-4563-be6b-754693ecbe8d could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:03:13.735470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:13.747132 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:13.747352 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-a3f51ea2-4c87-49da-a163-417ce20a5efd. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:13.747551 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:13.754064 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:13.754724 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:13.857576 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Took 8.65 seconds to spawn the instance on the hypervisor.
May 28 03:03:13.857721 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:13.899688 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:14.064067 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:14.109176 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:14.111305 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-71da4e7e-ce44-4a8a-9522-c433f06f9e0c. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:14.111534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:14.155731 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b716d95a-3278-48fb-aa4a-189ea48a0f75 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:14.165779 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:03:14.166960 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:03:14.167111 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Creating image(s)
May 28 03:03:14.170365 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:03:14.170365 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Ensure instance console log exists: /opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:03:14.170365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:14.170538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:14.171261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:14.238660 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:03:14.239241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for ada45e15-d8ee-4ad0-b222-30f543ee7089 due to new event <LifecycleEvent: 1779937394.238984, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:03:14.239442 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937394.238984, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:14.239550 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Resumed (Lifecycle Event)
May 28 03:03:14.258048 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:14.379549 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Took 14.36 seconds to build instance.
May 28 03:03:14.385009 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:14.405606 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Took 1.63 seconds to deallocate network for instance.
May 28 03:03:14.487417 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:14.719970 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:14.751165 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:14.755492 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:14.821711 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully updated port: f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:14.851580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:14.896719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5cdcc7dd-b45b-4e6a-b550-93260b7a90fe tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.894s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:14.920338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:14.920338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:14.985833 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:15.228330 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7d2b10c4-599c-4623-a5e6-918897c810f4 req-1cf6eb1f-0f69-4b9f-bc94-abd754451585 service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:15.229326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:15.229485 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port 71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:15.261149 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937395.2607539, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:15.261674 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Started (Lifecycle Event)
May 28 03:03:15.519011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:15.519298 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:15.731796 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:15.775152 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:15.780167 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:15.816790 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:15.817022 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-f60a5b73-285c-455a-8503-39987d159dc0. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:15.817291 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:15.887699 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:15.887845 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:15.887969 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:15.888080 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:15.888718 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:15.888905 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state rescued and task_state None.
May 28 03:03:15.889043 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:15.889203 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:15.889597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:15.890109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:15.890290 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:15.890436 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-26d82ffd-5a6a-4389-ac94-e45c89479610 req-4a34af31-6a8d-4a36-8b61-8fd2316e5583 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state rescued and task_state None.
May 28 03:03:16.026165 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:16.127369 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully updated port: ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:16.132520 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:16.149712 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:16.196921 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-changed-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:16.199368 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Refreshing instance network info cache due to event network-changed-534ae006-09c5-4883-b913-8365ce689378. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:16.199588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] Acquiring lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:16.200205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] Acquired lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:16.200548 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Refreshing network info cache for port 534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:16.366009 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:16.371591 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [{"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:16.535138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.615s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:16.600943 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Deleted allocations for instance a6d1b015-c35f-4563-be6b-754693ecbe8d
May 28 03:03:16.647796 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Unrescuing
May 28 03:03:16.648073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:16.648257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:16.648468 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:16.706938 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:16.868870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:16.868870 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:16.869108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] Acquiring lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:16.869108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:16.869271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:16.870004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:16.870098 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] No waiting events found dispatching network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:16.871356 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93cf33b9-a5c8-4c23-b10d-75a60d66f1e7 req-1ebcae43-a53e-4e5f-910f-df2ddfded5ee service nova] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Received event network-vif-unplugged-82527285-9862-47e9-92e1-5f234948dddd for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:03:16.871756 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:16.873685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:16.874366 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance network_info: |[{"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:03:16.875846 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Start _get_guest_xml network_info=[{"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '9d34df14-e283-4742-bf07-932d80af5e80', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '60a15beb-a3bc-4d0f-8437-21699f6c76ca', 'attached_at': '', 'detached_at': '', 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'serial': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '83f447c5-e2be-4e22-9db8-acde4e7eb661', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '60a15beb-a3bc-4d0f-8437-21699f6c76ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'serial': 'c05d3409-3e4a-42de-ab33-7823c0faba4a'}, 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '49ae5df0-d7a9-4d16-88a2-e18f5c5398dd', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '60a15beb-a3bc-4d0f-8437-21699f6c76ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'serial': 'db58a6fd-90c3-4be8-8727-e5e79872375f'}, 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:16.883435 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:16.884937 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1912742111', uuid='60a15beb-a3bc-4d0f-8437-21699f6c76ca'), owner=OwnerMeta(userid='fdecdb6bfb004d4ab1ac71e4d7441b17', username='tempest-TaggedBootDevicesTest_v242-1074514621-project-member', projectid='715ade0a672744fd95d77abe2cf06e6c', projectname='tempest-TaggedBootDevicesTest_v242-1074514621'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937396.884282) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:16.890071 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:16.890512 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:16.891717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:16.892252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:16.893369 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:16.894010 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:16.894307 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:16.894462 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:16.894714 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:16.895024 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:16.895024 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:16.895639 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:16.895639 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:16.895907 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:16.896200 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:16.896347 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:16.916489 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:16.916798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:16.916952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:16.917319 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:16.917546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:16.931253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:16.931738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:16.931966 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:16.934199 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:16.935708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:16.936880 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:16.951013 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:16.951013 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:16.962574 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:16.962574 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:16.973704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682] added
May 28 03:03:16.973704 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:16.973704 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:16.973704 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:16.973704 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:16.973704 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:16.973704 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:16.974038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:16.974117 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0421(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:16.974294 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:16.986174 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682] added
May 28 03:03:16.986174 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:16.986174 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:16.986174 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:16.986174 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:16.986174 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:16.986174 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:16.991615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:16.991993 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0559(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:16.993567 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:17.153092 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:17.203131 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:17.224347 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004431990000739461 future=<Future at 0x7e4b40635e50 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:17.224347 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:17.224347 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.104753173999825 future=<Future at 0x7e4b407f4470 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:17.224347 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.104636045999996 future=<Future at 0x7e4b407f4470 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:17.253068 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:17.284016 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:17.346258 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Successfully updated port: a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:17.378396 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:17.517355 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:17.519675 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:17.614813 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae39872d-244e-44b2-9e3e-197daa5c3dc1 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "a6d1b015-c35f-4563-be6b-754693ecbe8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.709s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:17.648815 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Updated VIF entry in instance network info cache for port 534ae006-09c5-4883-b913-8365ce689378. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:03:17.649995 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Updating instance_info_cache with network_info: [{"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:17.711385 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:17.811666 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:17.851852 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:17.953436 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Updating instance_info_cache with network_info: [{"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:17.975835 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:17.977756 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:17.980647 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-a55473db-0338-440a-90f5-69820a020453. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:17.980647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:17.994120 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:17.998801 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:17.998801 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:18.017365 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:18.017365 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.026799 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.026799 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:18.026799 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-ae84a137-be40-4ec5-a4f5-587338742734. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:18.026799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:18.035806 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.046000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:18.055148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.055148 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.055148 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.055148 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.055148 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.055148 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:18.055466 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.055466 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.055466 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.055466 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.055466 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.055466 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:18.091773 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.40.100,3260]
May 28 03:03:18.091773 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.40.100,3260] successful.
May 28 03:03:18.091773 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.098730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.50.100,3260]
May 28 03:03:18.098730 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.50.100,3260] successful.
May 28 03:03:18.098730 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.104307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.113163 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:18.127652 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.127652 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.127652 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.127652 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.127652 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.127652 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.127652 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.127652 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:18.129183 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.129183 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.129183 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.129183 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.129183 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.129183 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.129183 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.129183 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:18.130568 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.198s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:18.132065 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:18.138114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.138114 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.138114 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.138114 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.138114 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.138114 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.138114 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.138114 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:18.138494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.138494 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:18.138494 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.138494 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:18.138494 np0000001589 nova-compute[98297]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:18.138494 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.138494 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:18.138494 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:18.138796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:18.138881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:18.140484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] HCTL ('9', '-', '-', 0) found on session 31 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:18.140778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:18.141582 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] HCTL ('11', '-', '-', 0) found on session 32 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:18.141685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:18.162050 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1b0a3df-a7ff-4305-93d9-a846d3d97003 req-085aa678-896b-45b1-abb0-17edce3135f0 service nova] Releasing lock "refresh_cache-ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:18.185093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching for a device in session 31 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:18.185093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:18.185093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching for a device in session 32 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:18.185093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:18.319805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8973f6f4-fd60-460f-9d91-3172050f14e4 req-2c3f49e2-25d9-4ef3-9ca9-f8634f950626 service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:18.319805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:18.319805 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:18.458404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-ada45e15-d8ee-4ad0-b222-30f543ee7089" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:18.458780 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'flavor' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:18.937692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:18.998504 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:19.007710 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:19.028510 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:19.178113 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:19.185087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:19.219498 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:19.320611 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999729699999989 future=<Future at 0x7e4b407b6ab0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:19.328180 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance destroyed successfully.
May 28 03:03:19.329504 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'numa_topology' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:19.331182 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0021815480001805554 future=<Future at 0x7e4b407f4470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:19.331335 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:19.331441 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.894238063999865 future=<Future at 0x7e4b407c1040 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:19.331521 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.89415515099995 future=<Future at 0x7e4b407c1040 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:19.331853 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779937384.3288863, 00e053f4-d22d-4a88-b4ec-ef55f263964d => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:19.332327 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] VM Stopped (Lifecycle Event)
May 28 03:03:19.590293 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:19.837892 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<ada45e15-d8ee-4ad0-b222-30f543ee7089> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:19.839980 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0b5f116a-2154-4d09-92da-ef8daa042ce4 None None] [instance: 00e053f4-d22d-4a88-b4ec-ef55f263964d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:19.929283 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:19.956555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Found WWN 3300000003b14180d for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:19.956812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:19.956988 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '3300000003b14180d', 'path': '/dev/dm-0', 'multipath_id': '3300000003b14180d'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:19.957113 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003b14180d', 'path': '/dev/dm-0', 'multipath_id': '3300000003b14180d'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:20.132932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:20.134185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:20.134185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:20.134185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:20.134185 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:20.134185 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state rescued and task_state unrescuing.
May 28 03:03:20.134185 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:20.134698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:20.134698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:20.134698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:20.134858 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:20.135154 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-71b462ec-13c5-4c06-afef-2137fb92c0f9 req-4791edbf-8082-4b5d-9842-1361182d40c6 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state rescued and task_state unrescuing.
May 28 03:03:20.297721 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:20.356574 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:20.390566 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:20.464463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:20.464739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:20.465704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:20.465704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:20.465704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:20.478726 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:20.491165 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:20.491836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:20.495887 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:20.496543 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:20.496853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:20.497006 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:20.515070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:20.515070 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:20.526034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:20.526034 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:20.540464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a] added
May 28 03:03:20.540464 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:20.540464 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:20.540464 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:20.540464 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:20.540464 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:20.540464 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:20.540778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:20.540847 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0447(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:20.541027 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:20.542187 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a] added
May 28 03:03:20.542187 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:20.542187 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:20.542187 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:20.542187 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:20.542187 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:20.542187 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:20.542722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:20.542722 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0456(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:20.542980 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:20.568753 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:20.571146 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:20.742398 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:21.068445 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:21.222803 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for ada45e15-d8ee-4ad0-b222-30f543ee7089 due to new event <LifecycleEvent: 1779937401.222016, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:03:21.223611 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937401.222016, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:21.223786 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Resumed (Lifecycle Event)
May 28 03:03:21.226249 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5e5407e2-3534-4beb-94d5-7ecdbeab5bdb tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:21.421269 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:21.541493 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:21.546158 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:21.562687 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:21.562687 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:21.569212 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:21.569212 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.578557 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [{"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:21.579666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.586512 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.593887 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.593887 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.593887 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.593887 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.593887 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.593887 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.593887 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:21.594179 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.594179 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.594179 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.594179 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.594179 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.594179 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.594179 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:21.603762 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.603762 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.603762 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.603762 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.603762 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.603762 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.603762 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:21.603933 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.603933 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.603933 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.603933 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.603933 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.603933 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.603933 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:21.638811 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.40.100,3260]
May 28 03:03:21.638811 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.40.100,3260] successful.
May 28 03:03:21.638811 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.644384 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.50.100,3260]
May 28 03:03:21.644384 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.50.100,3260] successful.
May 28 03:03:21.644384 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.650363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.654855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.666361 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.666757 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:21.666958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:21.667039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:21.668603 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] HCTL ('8', '-', '-', 0) found on session 33 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:21.668760 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.673395 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:21.673739 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:21.673996 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:21.674085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:21.674908 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] HCTL ('12', '-', '-', 0) found on session 34 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:21.675031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:21.682777 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching for a device in session 33 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:21.682977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:21.690746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching for a device in session 34 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:21.690746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:21.726562 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:21.729976 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:22.081397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:22.081916 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance network_info: |[{"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:03:22.082268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:22.084056 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:22.084801 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Start _get_guest_xml network_info=[{"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '326b4536-2622-4731-accb-cc881ff07444', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7edf7fdf-a897-456a-b47a-0e6154035b35', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'serial': 'ef60b330-4fcb-41e8-871c-edf3f5932bba'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'd1604db0-8ff9-4840-89c5-215d919c1300', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7edf7fdf-a897-456a-b47a-0e6154035b35', 'attached_at': '', 'detached_at': '', 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'serial': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9'}, 'delete_on_termination': False, 'boot_index': 1, 'volume_type': None}, {'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0bc0f2a3-8d66-471e-90a1-1b3756696ef1', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7edf7fdf-a897-456a-b47a-0e6154035b35', 'attached_at': '', 'detached_at': '', 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'serial': '8f810741-3315-4c52-9a1f-0c51ae77e7db'}, 'delete_on_termination': False, 'boot_index': 2, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:22.092426 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:22.092426 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-658837030', uuid='7edf7fdf-a897-456a-b47a-0e6154035b35'), owner=OwnerMeta(userid='dcd7536c083d44349596a82948bb40e0', username='tempest-TaggedBootDevicesTest-864280134-project-member', projectid='077e33a200944c65a8018f12fe6f499e', projectname='tempest-TaggedBootDevicesTest-864280134'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937402.091865) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:22.093604 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:22.093973 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:22.095299 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:22.098256 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:22.108790 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:22.109197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:22.109505 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:22.208944 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:22.209388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:22.209647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:22.209940 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:22.210051 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:22.210132 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state active and task_state None.
May 28 03:03:22.210222 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:22.210359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:22.210469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:22.210562 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:22.210655 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:22.210750 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-4417552e-819c-4484-9201-bd14f8b5e6d6 req-a89ff3a6-dd1c-4924-b775-34d967fc5453 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received unexpected event network-vif-plugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with vm_state active and task_state None.
May 28 03:03:22.232140 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937402.2318943, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:22.232290 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Started (Lifecycle Event)
May 28 03:03:22.253579 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:22.498877 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:22.525216 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:22.589620 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:22.734806 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:22.736878 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:22.902270 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:23.013502 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:23.013502 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:23.047768 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:23.119622 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updated VIF entry in instance network info cache for port a55473db-0338-440a-90f5-69820a020453. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:03:23.120261 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [{"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:23.515652 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Found WWN 33000000004c80b68 for multipath device dm-5 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:23.515999 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.051s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:23.516202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '33000000004c80b68', 'path': '/dev/dm-5', 'multipath_id': '33000000004c80b68'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:23.516403 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000004c80b68', 'path': '/dev/dm-5', 'multipath_id': '33000000004c80b68'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:23.517012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.408s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:23.517196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:23.522613 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:03:23.531392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:23.531907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:23.532237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:23.532450 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:23.532729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:23.533642 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:23.544352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:23.544352 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:23.553299 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:23.553299 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:23.559264 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba] added
May 28 03:03:23.559264 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:23.559264 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:23.559264 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:23.559264 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:23.559264 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:23.559264 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:23.559458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:23.559576 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:23.559746 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:23.563460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba] added
May 28 03:03:23.563460 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:23.563460 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:23.563460 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:23.563460 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:23.563460 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:23.563460 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:23.563643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:23.563807 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0302(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:23.563879 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:23.623193 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-da4c2a47-814d-44b0-8ca9-d948cd7f49d5 req-914d4cae-1faf-49d3-8316-66a806127c2f service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:23.623674 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:23.623876 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:24.023753 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:24.023990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:24.024122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:24.073613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:24.073613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:24.077245 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:03:24.077245 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Claim successful on node np0000001589
May 28 03:03:24.126167 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:24.458575 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:24.560970 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:24.567843 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:24.568880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:24.577739 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:24.577739 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:24.586521 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:24.586521 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.591066 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.598792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.611095 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.619942 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.620189 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:24.650248 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updated VIF entry in instance network info cache for port ae84a137-be40-4ec5-a4f5-587338742734. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:03:24.650839 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [{"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:24.655386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.40.100,3260]
May 28 03:03:24.655386 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.40.100,3260] successful.
May 28 03:03:24.655386 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.668593 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.677759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.50.100,3260]
May 28 03:03:24.677759 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.50.100,3260] successful.
May 28 03:03:24.677759 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.688142 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] HCTL ('15', '-', '-', 0) found on session 35 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:24.688142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:24.693320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:24.710209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching for a device in session 35 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:24.710583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.716780 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:24.717172 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:24.717689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:24.717689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:24.718435 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] HCTL ('16', '-', '-', 0) found on session 36 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:24.718435 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:24.738903 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching for a device in session 36 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:24.739125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:25.156296 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa6d1475-edf2-4ccd-a8d8-d6974cbeb2e5 req-f6f53456-065d-4cfa-a694-dcdcbca2af4f service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:25.456411 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:25.456579 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:25.533877 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:25.959008 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:26.138180 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:26.138485 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:03:26.466637 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.393s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:26.467169 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:03:26.549179 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Found WWN 3300000005c6d50c6 for multipath device dm-6 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:26.549444 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:26.549563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== connect_volume: return (4439ms) {'type': 'block', 'scsi_wwn': '3300000005c6d50c6', 'path': '/dev/dm-6', 'multipath_id': '3300000005c6d50c6'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:26.549671 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005c6d50c6', 'path': '/dev/dm-6', 'multipath_id': '3300000005c6d50c6'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:26.550314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.526s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:26.550645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:26.566017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:26.566676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:26.567407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:26.567871 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:26.568624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:26.569155 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:26.581722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:26.581722 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:26.587795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:26.587795 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:26.598827 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f] added
May 28 03:03:26.598827 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:26.598827 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:26.598827 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:26.598827 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:26.598827 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:26.598827 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:26.599794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:26.599794 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:26.599794 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:26.600609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f] added
May 28 03:03:26.600609 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:26.600609 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:26.600609 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:26.600609 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:26.600609 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:26.600609 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:26.601055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:26.601055 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:26.601055 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:26.976782 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:03:26.976922 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:03:26.977299 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:26.977552 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:27.053195 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:27.053592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:27.053592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:27.070206 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca35293e06644323b1379cbcfa028d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea07081265c14a80b849530dbb4de34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:03:27.137784 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:27.138025 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:03:27.138364 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:03:27.260509 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:27.345534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:27.352431 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.007s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:27.473088 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Successfully created port: 035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:27.478548 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:03:27.526825 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:27.599846 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:27.601558 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:27.613328 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:27.613328 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:27.615378 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:27.615378 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.627350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.632468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.649008 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.649449 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.650150 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:27.693529 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.40.100,3260]
May 28 03:03:27.693529 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.40.100,3260] successful.
May 28 03:03:27.693529 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.705067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.719792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.50.100,3260]
May 28 03:03:27.719792 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.50.100,3260] successful.
May 28 03:03:27.719792 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.723837 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.724304 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:27.724304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:27.725406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] HCTL ('17', '-', '-', 0) found on session 37 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:27.725502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:27.730894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:27.744654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching for a device in session 37 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:27.744654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.752816 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:27.753790 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:27.753790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:27.754306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] HCTL ('18', '-', '-', 0) found on session 38 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:27.754406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:27.768837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Searching for a device in session 38 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:27.768837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:27.855332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:27.855928 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:03:27.858417 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:27.981091 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:03:27.989066 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Successfully updated port: 035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:28.046873 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-changed-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:28.047156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Refreshing instance network info cache due to event network-changed-035de3fc-4c7f-44d7-bf09-c7148e66f70a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:28.047156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] Acquiring lock "refresh_cache-185fd29d-4f07-4f32-8674-c734cdccc83d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:28.047250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] Acquired lock "refresh_cache-185fd29d-4f07-4f32-8674-c734cdccc83d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:28.047388 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Refreshing network info cache for port 035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:28.138244 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:28.138471 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:03:28.226129 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00033659600012470037 future=<Future at 0x7e4b407c1040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:28.226539 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] Emitting event <LifecycleEvent: 1779937393.2256103, a6d1b015-c35f-4563-be6b-754693ecbe8d => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:28.226699 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:28.226869 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] VM Stopped (Lifecycle Event)
May 28 03:03:28.227357 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.092967775000034 future=<Future at 0x7e4b407b6ab0 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:28.227455 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.092855676999989 future=<Future at 0x7e4b407b6ab0 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:28.228072 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:28.364803 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Detaching volume 8b21e0e5-41f1-458e-b254-d46b30be8b1f
May 28 03:03:28.407811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:28.407975 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:28.410224 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:03:28.410402 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Claim successful on node np0000001589
May 28 03:03:28.414147 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Attempting to driver detach volume 8b21e0e5-41f1-458e-b254-d46b30be8b1f from mountpoint /dev/vdb
May 28 03:03:28.416887 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found disk vdb by alias ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:03:28.417724 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found disk vdb by alias ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:03:28.417852 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Attempting to detach device vdb from instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:03:28.418068 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:03:28.418068 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:28.418068 np0000001589 nova-compute[98297]:   <alias name="ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f"/>
May 28 03:03:28.418068 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:03:28.418068 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:03:28.418068 np0000001589 nova-compute[98297]:   <serial>8b21e0e5-41f1-458e-b254-d46b30be8b1f</serial>
May 28 03:03:28.418068 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:03:28.418068 np0000001589 nova-compute[98297]: </disk>
May 28 03:03:28.418068 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:03:28.422660 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully detached device vdb from instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 from the persistent domain config.
May 28 03:03:28.422803 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] (1/8): Attempting to detach device vdb with device alias ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f from instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:03:28.423051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:03:28.423051 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:28.423051 np0000001589 nova-compute[98297]:   <alias name="ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f"/>
May 28 03:03:28.423051 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:03:28.423051 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:03:28.423051 np0000001589 nova-compute[98297]:   <serial>8b21e0e5-41f1-458e-b254-d46b30be8b1f</serial>
May 28 03:03:28.423051 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:03:28.423051 np0000001589 nova-compute[98297]: </disk>
May 28 03:03:28.423051 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:03:28.490832 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-185fd29d-4f07-4f32-8674-c734cdccc83d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:28.549257 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:28.567648 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:28.626110 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:28.729575 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6a75bb7d-9200-4083-9aea-6d06e6905645 tempest-VolumesAdminNegativeTest-2114472830 tempest-VolumesAdminNegativeTest-2114472830-project-member] [instance: a6d1b015-c35f-4563-be6b-754693ecbe8d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:28.752573 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:28.958970 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937408.9585834, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:03:28.962296 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8b21e0e5-41f1-458e-b254-d46b30be8b1f for instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:03:28.962296 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully detached device vdb from instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 from the live domain config.
May 28 03:03:28.962296 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:03:28.962560 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:28.962640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:28.988878 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:03:28.989879 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:03:28.994249 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Creating image(s)
May 28 03:03:28.994249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "/opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:28.997944 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:28.997944 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:28.997944 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:28.998856 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:29.000947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:29.075439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.074s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:29.079247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:29.079247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:29.079247 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:29.080000 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:29.080522 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:29.165308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:29.169379 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:29.219896 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk 1073741824" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:29.223242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.144s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:29.223242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:29.255679 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a2b6fcc8-61b6-4e89-a177-0a95c93d783b req-2b90f31b-3bda-4d1d-b5cc-15213ce860a2 service nova] Releasing lock "refresh_cache-185fd29d-4f07-4f32-8674-c734cdccc83d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:29.256256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-185fd29d-4f07-4f32-8674-c734cdccc83d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:29.256472 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:29.302210 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:29.305349 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Checking if we can resize image /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:03:29.305349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:29.381795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:29.383784 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Cannot resize image /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:03:29.383784 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:03:29.383784 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Ensure instance console log exists: /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:03:29.383784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:29.383784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:29.383784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:29.582482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Found WWN 3300000001afcd344 for multipath device dm-9 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:29.582914 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:29.583108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== connect_volume: return (5559ms) {'type': 'block', 'scsi_wwn': '3300000001afcd344', 'path': '/dev/dm-9', 'multipath_id': '3300000001afcd344'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:29.583245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001afcd344', 'path': '/dev/dm-9', 'multipath_id': '3300000001afcd344'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:29.584183 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.531s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:29.584405 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:29.598410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:29.599410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:29.599835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:29.600037 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:29.602071 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:29.602071 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:29.610602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:29.610602 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:29.620613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:29.620613 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9] added
May 28 03:03:29.624244 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:29.624244 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0217(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:29.624244 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:29.632863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9] added
May 28 03:03:29.632863 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:29.632863 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:29.632863 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:29.632863 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:29.632863 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:29.632863 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:29.633334 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:29.633334 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:29.633481 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:29.832461 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:29.928732 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:29.928965 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:30.005240 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:30.090210 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.090465 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.091243 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:99:b1,bridge_name='br-int',has_traffic_filtering=True,id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1,network=Network(675db9f7-8c47-41aa-beeb-4a16cd42cb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3216c453-3e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.092106 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.092326 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.092718 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:05:e8,bridge_name='br-int',has_traffic_filtering=True,id=2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee0e82c-fd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.093700 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.094543 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.094543 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=f05a7921-2b12-438f-ba0c-e3246b54d45c,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf05a7921-2b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.095114 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.095332 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.095727 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b4:76,bridge_name='br-int',has_traffic_filtering=True,id=5560f8fa-1f24-462f-b908-5aa738c9240b,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5560f8fa-1f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.096354 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.096551 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.096974 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:fe,bridge_name='br-int',has_traffic_filtering=True,id=8f4823d8-e26e-4c35-8521-88219b693c40,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4823d8-e2') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.097568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.097780 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.098160 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=2b109c91-d16a-4f52-8cc6-f1327fcd5621,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b109c91-d1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.098745 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.098962 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.099409 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=83bdc31d-1f6f-4435-a9b1-0e17677f9340,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83bdc31d-1f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.100827 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lazy-loading 'pci_devices' on Instance uuid 60a15beb-a3bc-4d0f-8437-21699f6c76ca {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:30.137786 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:30.138106 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:30.141423 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Updating instance_info_cache with network_info: [{"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:30.432011 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:30.604038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <uuid>60a15beb-a3bc-4d0f-8437-21699f6c76ca</uuid>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <name>instance-0000000f</name>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:name>tempest-device-tagging-server-1912742111</nova:name>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:16</nova:creationTime>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:user uuid="fdecdb6bfb004d4ab1ac71e4d7441b17">tempest-TaggedBootDevicesTest_v242-1074514621-project-member</nova:user>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:project uuid="715ade0a672744fd95d77abe2cf06e6c">tempest-TaggedBootDevicesTest_v242-1074514621</nova:project>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:port uuid="3216c453-3e7f-455e-8c3b-d1d783b1c2a1">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:port uuid="2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:port uuid="f05a7921-2b12-438f-ba0c-e3246b54d45c">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:port uuid="5560f8fa-1f24-462f-b908-5aa738c9240b">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.91" ipVersion="4"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:port uuid="8f4823d8-e26e-4c35-8521-88219b693c40">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.164" ipVersion="4"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:port uuid="2b109c91-d16a-4f52-8cc6-f1327fcd5621">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         <nova:port uuid="83bdc31d-1f6f-4435-a9b1-0e17677f9340">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <entry name="serial">60a15beb-a3bc-4d0f-8437-21699f6c76ca</entry>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <entry name="uuid">60a15beb-a3bc-4d0f-8437-21699f6c76ca</entry>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca/disk.config"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <alias name="ua-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <serial>15a10103-9b4b-4b90-bf8a-2bfdcf0e3682</serial>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <alias name="ua-c05d3409-3e4a-42de-ab33-7823c0faba4a"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-5"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <serial>c05d3409-3e4a-42de-ab33-7823c0faba4a</serial>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <alias name="ua-db58a6fd-90c3-4be8-8727-e5e79872375f"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-9"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="vdc" bus="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <serial>db58a6fd-90c3-4be8-8727-e5e79872375f</serial>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d9:99:b1"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="tap3216c453-3e"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ad:05:e8"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="tap2ee0e82c-fd"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d6:05:a8"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="tapf05a7921-2b"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:89:b4:76"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="tap5560f8fa-1f"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:27:9d:fe"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="tap8f4823d8-e2"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:8d:e1:88"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="tap2b109c91-d1"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:db:f4:77"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <target dev="tap83bdc31d-1f"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca/console.log" append="off"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:30.604038 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Preparing to wait for external event network-vif-plugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Preparing to wait for external event network-vif-plugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Preparing to wait for external event network-vif-plugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Preparing to wait for external event network-vif-plugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Preparing to wait for external event network-vif-plugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Preparing to wait for external event network-vif-plugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Preparing to wait for external event network-vif-plugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.611859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:99:b1,bridge_name='br-int',has_traffic_filtering=True,id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1,network=Network(675db9f7-8c47-41aa-beeb-4a16cd42cb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3216c453-3e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:99:b1,bridge_name='br-int',has_traffic_filtering=True,id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1,network=Network(675db9f7-8c47-41aa-beeb-4a16cd42cb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3216c453-3e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18fe9bbc-f524-528d-9517-ff6278e2e1b6', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.613211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.614832 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.615001 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3216c453-3e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.615364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3216c453-3e, col_values=(('qos', UUID('a23a71e7-e95c-4748-95e2-f2307b9bbea4')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.615530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3216c453-3e, col_values=(('external_ids', {'iface-id': '3216c453-3e7f-455e-8c3b-d1d783b1c2a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:99:b1', 'vm-uuid': '60a15beb-a3bc-4d0f-8437-21699f6c76ca'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.616338 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.617775 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.622313 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:30.625900 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.627165 np0000001589 nova-compute[98297]: INFO os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:99:b1,bridge_name='br-int',has_traffic_filtering=True,id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1,network=Network(675db9f7-8c47-41aa-beeb-4a16cd42cb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3216c453-3e')
May 28 03:03:30.628108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:30.628389 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.629053 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:05:e8,bridge_name='br-int',has_traffic_filtering=True,id=2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee0e82c-fd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.629374 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:05:e8,bridge_name='br-int',has_traffic_filtering=True,id=2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee0e82c-fd') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:30.630307 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.631088 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.631284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:30.632012 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.632168 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dce4133e-4438-5b3f-91b0-585a9e82bea8', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.633533 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.634119 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:30.634692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:30.638147 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:30.638147 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.640666 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.641598 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.641835 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ee0e82c-fd, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.642285 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ee0e82c-fd, col_values=(('qos', UUID('ec1c6d6a-c7e5-4abc-b91c-ff20c8d1550e')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.642493 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ee0e82c-fd, col_values=(('external_ids', {'iface-id': '2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:05:e8', 'vm-uuid': '60a15beb-a3bc-4d0f-8437-21699f6c76ca'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.644539 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-185fd29d-4f07-4f32-8674-c734cdccc83d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:30.644893 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Instance network_info: |[{"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:03:30.646688 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Start _get_guest_xml network_info=[{"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:30.649171 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:30.649485 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:30.649485 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.652157 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.655047 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.659333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.663526 np0000001589 nova-compute[98297]: INFO os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:05:e8,bridge_name='br-int',has_traffic_filtering=True,id=2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee0e82c-fd')
May 28 03:03:30.664280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.665404 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:30.665597 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.666040 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=f05a7921-2b12-438f-ba0c-e3246b54d45c,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf05a7921-2b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.666339 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=f05a7921-2b12-438f-ba0c-e3246b54d45c,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf05a7921-2b') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:30.666926 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:30.668160 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.670393 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-69400073', uuid='185fd29d-4f07-4f32-8674-c734cdccc83d'), owner=OwnerMeta(userid='ca35293e06644323b1379cbcfa028d87', username='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member', projectid='ea07081265c14a80b849530dbb4de34a', projectname='tempest-ServerBootFromVolumeStableRescueTest-1646172629'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937410.6678624) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:30.670641 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.670860 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:30.671899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.672180 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bce50ea7-bae5-5ec6-8bcc-e0ee7c2e73d6', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.672710 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:30.673014 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.673544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:30.674460 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.682855 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:30.682855 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:30.682855 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:30.682855 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:30.682855 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:30.682855 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:30.682855 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:30.683968 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:30.684278 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:30.684978 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.685243 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.686037 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:30.686982 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.687126 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.687421 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:30.688112 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:30.688388 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.689086 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:30.689086 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:30.689086 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:30.689263 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf05a7921-2b, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.689613 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf05a7921-2b, col_values=(('qos', UUID('f95d68a2-c0cb-4a63-918e-d1bfa9573662')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.689802 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf05a7921-2b, col_values=(('external_ids', {'iface-id': 'f05a7921-2b12-438f-ba0c-e3246b54d45c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:05:a8', 'vm-uuid': '60a15beb-a3bc-4d0f-8437-21699f6c76ca'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.697331 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.703761 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-69400073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-69400073',id=18,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-w849yn0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:28Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=185fd29d-4f07-4f32-8674-c734cdccc83d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:30.703761 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.704543 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:18:63,bridge_name='br-int',has_traffic_filtering=True,id=035de3fc-4c7f-44d7-bf09-c7148e66f70a,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035de3fc-4c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.705050 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.706250 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'pci_devices' on Instance uuid 185fd29d-4f07-4f32-8674-c734cdccc83d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:30.706684 np0000001589 nova-compute[98297]: INFO os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=f05a7921-2b12-438f-ba0c-e3246b54d45c,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf05a7921-2b')
May 28 03:03:30.711287 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:30.711287 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.711287 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b4:76,bridge_name='br-int',has_traffic_filtering=True,id=5560f8fa-1f24-462f-b908-5aa738c9240b,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5560f8fa-1f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.711287 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b4:76,bridge_name='br-int',has_traffic_filtering=True,id=5560f8fa-1f24-462f-b908-5aa738c9240b,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5560f8fa-1f') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:30.714825 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.714825 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.714825 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:30.716175 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.716432 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e949680-5353-58ca-aa59-bab9d170573f', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.718334 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.718334 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.729483 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.732020 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.732281 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5560f8fa-1f, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.732644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5560f8fa-1f, col_values=(('qos', UUID('b47fa71d-74a9-447f-9012-7c5d68f1fef2')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.732816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5560f8fa-1f, col_values=(('external_ids', {'iface-id': '5560f8fa-1f24-462f-b908-5aa738c9240b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:b4:76', 'vm-uuid': '60a15beb-a3bc-4d0f-8437-21699f6c76ca'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.734833 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.735851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.739021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.40.100,3260]
May 28 03:03:30.739021 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.40.100,3260] successful.
May 28 03:03:30.739021 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.750931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.755809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.756954 np0000001589 nova-compute[98297]: INFO os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b4:76,bridge_name='br-int',has_traffic_filtering=True,id=5560f8fa-1f24-462f-b908-5aa738c9240b,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5560f8fa-1f')
May 28 03:03:30.757883 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:30.758121 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.758671 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:fe,bridge_name='br-int',has_traffic_filtering=True,id=8f4823d8-e26e-4c35-8521-88219b693c40,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4823d8-e2') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.758875 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:fe,bridge_name='br-int',has_traffic_filtering=True,id=8f4823d8-e26e-4c35-8521-88219b693c40,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4823d8-e2') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:30.759596 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.759829 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.760090 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:30.760837 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.761037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9107eb92-513f-5c0c-9598-c0e9acdfbe43', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.761607 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.762312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.50.100,3260]
May 28 03:03:30.762312 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.50.100,3260] successful.
May 28 03:03:30.762312 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.762639 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.772039 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.772404 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:30.772660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:30.772660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:30.774656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] HCTL ('19', '-', '-', 0) found on session 39 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:30.774801 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:30.778299 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:30.781679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.784718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.785022 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f4823d8-e2, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.785546 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f4823d8-e2, col_values=(('qos', UUID('2680110a-cac4-4f3e-8776-800fe0142661')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.785612 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f4823d8-e2, col_values=(('external_ids', {'iface-id': '8f4823d8-e26e-4c35-8521-88219b693c40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:9d:fe', 'vm-uuid': '60a15beb-a3bc-4d0f-8437-21699f6c76ca'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.791600 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.791600 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.791600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching for a device in session 39 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:30.791600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.801542 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:30.801857 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:30.802129 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.201s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:30.802129 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:30.803495 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] HCTL ('20', '-', '-', 0) found on session 40 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:30.803623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:30.810329 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.811472 np0000001589 nova-compute[98297]: INFO os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:fe,bridge_name='br-int',has_traffic_filtering=True,id=8f4823d8-e26e-4c35-8521-88219b693c40,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4823d8-e2')
May 28 03:03:30.812300 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:30.812501 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.812992 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=2b109c91-d16a-4f52-8cc6-f1327fcd5621,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b109c91-d1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.813219 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=2b109c91-d16a-4f52-8cc6-f1327fcd5621,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b109c91-d1') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:30.813529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.813730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.813974 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:30.815083 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.815282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e78e92d9-796a-5498-9526-7b3bd3e50d3f', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.815929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.816777 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.821741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching for a device in session 40 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:30.821741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:30.839101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.841707 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.841977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b109c91-d1, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.842358 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b109c91-d1, col_values=(('qos', UUID('84d94f4c-9da3-41c0-b823-bac22fd898f5')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.842529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b109c91-d1, col_values=(('external_ids', {'iface-id': '2b109c91-d16a-4f52-8cc6-f1327fcd5621', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:e1:88', 'vm-uuid': '60a15beb-a3bc-4d0f-8437-21699f6c76ca'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.843448 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.845174 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.872019 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.872596 np0000001589 nova-compute[98297]: INFO os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=2b109c91-d16a-4f52-8cc6-f1327fcd5621,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b109c91-d1')
May 28 03:03:30.873343 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:30.873487 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:30.873934 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=83bdc31d-1f6f-4435-a9b1-0e17677f9340,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83bdc31d-1f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:30.874140 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=83bdc31d-1f6f-4435-a9b1-0e17677f9340,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83bdc31d-1f') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:30.874532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.874797 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.875010 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:30.875790 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.876041 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fd05066-c7a5-55eb-9e4b-1a63653edb21', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.876881 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.877876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.903693 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.909322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.909322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83bdc31d-1f, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.909322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83bdc31d-1f, col_values=(('qos', UUID('3c6baf44-f60c-4f08-9a81-a0f3208f53e8')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.909480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83bdc31d-1f, col_values=(('external_ids', {'iface-id': '83bdc31d-1f6f-4435-a9b1-0e17677f9340', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:f4:77', 'vm-uuid': '60a15beb-a3bc-4d0f-8437-21699f6c76ca'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:30.912202 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:30.941249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.533s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.942255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.293s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:30.942492 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:30.943253 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:03:30.947183 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:30.948686 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:03:30.949306 np0000001589 nova-compute[98297]: INFO os_vif [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=83bdc31d-1f6f-4435-a9b1-0e17677f9340,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83bdc31d-1f')
May 28 03:03:31.216485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <uuid>185fd29d-4f07-4f32-8674-c734cdccc83d</uuid>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <name>instance-00000012</name>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-69400073</nova:name>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:30</nova:creationTime>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:user uuid="ca35293e06644323b1379cbcfa028d87">tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member</nova:user>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:project uuid="ea07081265c14a80b849530dbb4de34a">tempest-ServerBootFromVolumeStableRescueTest-1646172629</nova:project>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         <nova:port uuid="035de3fc-4c7f-44d7-bf09-c7148e66f70a">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <entry name="serial">185fd29d-4f07-4f32-8674-c734cdccc83d</entry>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <entry name="uuid">185fd29d-4f07-4f32-8674-c734cdccc83d</entry>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk.config"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:82:18:63"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <target dev="tap035de3fc-4c"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/console.log" append="off"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:31.216485 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:31.218213 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Preparing to wait for external event network-vif-plugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:31.218213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:31.218213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:31.218213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:31.218213 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-69400073',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-69400073',id=18,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-w849yn0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:28Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=185fd29d-4f07-4f32-8674-c734cdccc83d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:31.218213 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:31.218213 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:18:63,bridge_name='br-int',has_traffic_filtering=True,id=035de3fc-4c7f-44d7-bf09-c7148e66f70a,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035de3fc-4c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:31.218589 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:18:63,bridge_name='br-int',has_traffic_filtering=True,id=035de3fc-4c7f-44d7-bf09-c7148e66f70a,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035de3fc-4c') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:31.220759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:31.220759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:31.220759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:31.220985 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:31.221207 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '985ab087-f093-50cd-8e36-7499af5b9ba0', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:31.222864 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:31.225735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:31.257538 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:31.259713 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:31.259713 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap035de3fc-4c, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:31.259835 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap035de3fc-4c, col_values=(('qos', UUID('6716d05f-ca84-482d-b372-2891708e50f7')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:31.260039 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap035de3fc-4c, col_values=(('external_ids', {'iface-id': '035de3fc-4c7f-44d7-bf09-c7148e66f70a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:18:63', 'vm-uuid': '185fd29d-4f07-4f32-8674-c734cdccc83d'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:31.260676 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:31.262480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:31.299258 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:31.301000 np0000001589 nova-compute[98297]: INFO os_vif [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:18:63,bridge_name='br-int',has_traffic_filtering=True,id=035de3fc-4c7f-44d7-bf09-c7148e66f70a,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035de3fc-4c')
May 28 03:03:31.452666 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:03:31.453009 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:03:31.453390 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:31.453733 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:31.549204 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84aa869713da4347914ce6054de5ea1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470ae60a73f43d183ba78fe4ed0d29b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:03:31.600467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:31.956005 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:03:31.979415 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Successfully created port: f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:31.983350 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:03:31.984641 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.063486 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.063919 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.141630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.077s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.144985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.242237 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.242744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.323493 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.327091 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Periodic task is updating the host stat, it is trying to get disk instance-0000000f, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca/disk.config'
May 28 03:03:32.328597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.413885 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.414404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.459337 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:03:32.474055 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:32.474507 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:32.474669 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] No VIF found with MAC fa:16:3e:d9:99:b1, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:32.475299 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] No VIF found with MAC fa:16:3e:27:9d:fe, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:32.476356 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Using config drive
May 28 03:03:32.501856 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Successfully updated port: f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:32.509093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.511430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.530166 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:32.551258 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:32.551456 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing instance network info cache due to event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:32.551761 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] Acquiring lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:32.551938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] Acquired lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:32.552125 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing network info cache for port f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:32.590872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.591316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.614774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Found WWN 3300000001b387ef0 for multipath device dm-10 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:32.615649 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:32.615867 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== connect_volume: return (5562ms) {'type': 'block', 'scsi_wwn': '3300000001b387ef0', 'path': '/dev/dm-10', 'multipath_id': '3300000001b387ef0'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:32.616124 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001b387ef0', 'path': '/dev/dm-10', 'multipath_id': '3300000001b387ef0'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:32.619450 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.657s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:32.620062 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b21e0e5-41f1-458e-b254-d46b30be8b1f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:03:32.620306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:32.655524 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [25] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:32.656000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:32.656000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:03:32.656464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '25')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:03:32.657848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f', '26')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:03:32.659246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b406998a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:03:32.659542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Removing multipathed devices sde, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:03:32.659830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flush multipath device 330000000be19de31 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:03:32.672394 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.674193 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:32.675162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:32.693009 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:03:32.707801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.033s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:32.709575 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=12754MB free_disk=74.37594985961914GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:03:32.709575 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:32.709575 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:32.727732 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:03:32.764501 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:03:32.764631 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] SCSI volumes sde, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:03:32.766025 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:03:32.777430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:03:32.777681 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:03:32.788972 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:32.816272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:32.816447 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:32.816570 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No VIF found with MAC fa:16:3e:82:18:63, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:32.817098 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Using config drive
May 28 03:03:32.825029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260]
May 28 03:03:32.825029 np0000001589 nova-compute[98297]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.40.100,3260] successful.
May 28 03:03:32.825029 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:32.845141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:32.855655 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:32.890937 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260]
May 28 03:03:32.890937 np0000001589 nova-compute[98297]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-8b21e0e5-41f1-458e-b254-d46b30be8b1f, portal: 192.168.50.100,3260] successful.
May 28 03:03:32.890937 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:32.909724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:32.910204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:32.910429 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== disconnect_volume: return (3947ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:32.910619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:03:32.984612 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:33.004990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:33.054475 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:33.113745 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Creating config drive at /opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca/disk.config
May 28 03:03:33.117462 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptqnvjk3p {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:33.127979 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:33.134192 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:33.137363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:33.137669 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:33.158646 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptqnvjk3p" returned: 0 in 0.041s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:33.258508 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:33.322051 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:33.423065 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Creating config drive at /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk.config
May 28 03:03:33.426325 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6qr297be {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:33.464237 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:33.469037 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:03:33.470278 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:03:33.470434 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Creating image(s)
May 28 03:03:33.470950 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:33.471177 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:33.471724 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:33.472238 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:33.474898 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:33.475412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6qr297be" returned: 0 in 0.049s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:33.476257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:33.577284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:33.577851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:33.578476 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:33.578984 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:33.584248 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:33.584790 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:33.599378 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:33.654799 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:33.656900 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:33.676756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:33.677161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:33.726142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk 1073741824" returned: 0 in 0.049s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:33.727083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:33.727171 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:33.764637 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ae3ca85-226f-414a-9f5b-00ca30b0adcd req-f46af2cf-ee3e-4beb-b3ce-4aee2c4b83ca service nova] Releasing lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:33.764637 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquired lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:33.764637 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:33.793394 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.793554 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.793604 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ad211867-f4ec-4773-bca9-5383cde1e916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.793684 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ada45e15-d8ee-4ad0-b222-30f543ee7089 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.794064 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 60a15beb-a3bc-4d0f-8437-21699f6c76ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.794158 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.794271 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7edf7fdf-a897-456a-b47a-0e6154035b35 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.794357 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 185fd29d-4f07-4f32-8674-c734cdccc83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.794442 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:03:33.794649 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:03:33.794774 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:03:32 up 31 min,  2 users,  load average: 8.93, 5.60, 2.73\n', 'num_instances': '9', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '9', 'num_proj_4d2ef1b6a03d428d94b2072c01964b49': '1', 'io_workload': '4', 'num_proj_989151e14dc44db3b75763b654bb2199': '1', 'num_proj_ea07081265c14a80b849530dbb4de34a': '3', 'num_vm_building': '4', 'num_task_spawning': '3', 'num_proj_715ade0a672744fd95d77abe2cf06e6c': '1', 'num_proj_e00f74b8638345979e76606cba0149ce': '1', 'num_proj_077e33a200944c65a8018f12fe6f499e': '1', 'num_task_block_device_mapping': '1', 'num_proj_c470ae60a73f43d183ba78fe4ed0d29b': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:03:33.828853 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:33.830737 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:03:33.830737 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:33.849481 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:33.901243 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:33.930352 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:33.930352 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Cannot resize image /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:03:33.930352 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:03:33.930352 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Ensure instance console log exists: /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:03:33.930352 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:33.930634 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:33.930787 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:33.970355 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.023142 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.026498 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.073737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.076626 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.112759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.164157 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.213803 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:34.241161 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a62d137f-2885-4581-8d97-414278c269ab req-fa61ffff-b78e-412f-9cf3-b08f5443441c service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:34.241347 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a62d137f-2885-4581-8d97-414278c269ab req-fa61ffff-b78e-412f-9cf3-b08f5443441c service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:34.241518 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a62d137f-2885-4581-8d97-414278c269ab req-fa61ffff-b78e-412f-9cf3-b08f5443441c service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:34.241613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a62d137f-2885-4581-8d97-414278c269ab req-fa61ffff-b78e-412f-9cf3-b08f5443441c service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:34.242132 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a62d137f-2885-4581-8d97-414278c269ab req-fa61ffff-b78e-412f-9cf3-b08f5443441c service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Processing event network-vif-plugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:34.290151 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.339876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.364073 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.370360 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:34.370607 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:34.397134 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:34.404273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.454172 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.479807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef967371-9a6a-48e7-9511-c5004e5a3075 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.624s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:34.481443 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.266s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:34.481443 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:34.488045 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98297) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 03:03:34.488753 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:34.502583 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.543586 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.546535 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.553860 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.561841 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.566257 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.598574 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.611088 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.626757 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:34.629630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.633783 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:34.635198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:34.635198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:34.635198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:34.635198 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Processing event network-vif-plugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:34.635198 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:34.635393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:34.635473 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:34.635558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:34.635712 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No event matching network-vif-plugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 in dict_keys([('network-vif-plugged', 'f05a7921-2b12-438f-ba0c-e3246b54d45c'), ('network-vif-plugged', '5560f8fa-1f24-462f-b908-5aa738c9240b'), ('network-vif-plugged', '8f4823d8-e26e-4c35-8521-88219b693c40'), ('network-vif-plugged', '2b109c91-d16a-4f52-8cc6-f1327fcd5621'), ('network-vif-plugged', '83bdc31d-1f6f-4435-a9b1-0e17677f9340')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:34.635860 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received unexpected event network-vif-plugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 for instance with vm_state building and task_state spawning.
May 28 03:03:34.636015 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:34.636161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:34.636586 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:34.636779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:34.637026 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Processing event network-vif-plugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:34.637125 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:34.637241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:34.638063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:34.638063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:34.638063 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No event matching network-vif-plugged-f05a7921-2b12-438f-ba0c-e3246b54d45c in dict_keys([('network-vif-plugged', '5560f8fa-1f24-462f-b908-5aa738c9240b'), ('network-vif-plugged', '8f4823d8-e26e-4c35-8521-88219b693c40'), ('network-vif-plugged', '2b109c91-d16a-4f52-8cc6-f1327fcd5621'), ('network-vif-plugged', '83bdc31d-1f6f-4435-a9b1-0e17677f9340')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:34.638063 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a4cb6b1e-c87c-4f8f-ae4f-6205ddabbf34 req-0a197544-c917-48bd-891f-ae0407967419 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received unexpected event network-vif-plugged-f05a7921-2b12-438f-ba0c-e3246b54d45c for instance with vm_state building and task_state spawning.
May 28 03:03:34.715072 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.729778 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.818077 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.819243 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.841388 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.873464 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.878961 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:34.885185 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.896545 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:34.903528 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:34.959180 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.097288 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.098209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.181927 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fd271964-bc87-4d2d-be6d-c67a22e27a46 req-d20cf421-98d4-42cd-8c36-0ed348cbd694 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:35.182279 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd271964-bc87-4d2d-be6d-c67a22e27a46 req-d20cf421-98d4-42cd-8c36-0ed348cbd694 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:35.182279 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd271964-bc87-4d2d-be6d-c67a22e27a46 req-d20cf421-98d4-42cd-8c36-0ed348cbd694 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:35.182457 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd271964-bc87-4d2d-be6d-c67a22e27a46 req-d20cf421-98d4-42cd-8c36-0ed348cbd694 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:35.184573 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fd271964-bc87-4d2d-be6d-c67a22e27a46 req-d20cf421-98d4-42cd-8c36-0ed348cbd694 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Processing event network-vif-plugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:35.298658 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.393848 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:03:35.394051 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.685s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:35.395438 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:03:35.399101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Releasing lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:35.399465 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance network_info: |[{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:03:35.401781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Start _get_guest_xml network_info=[{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:35.408383 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:35.408383 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1883072808', uuid='2f113470-8b6b-4ddc-b8c8-7f3cfa95803f'), owner=OwnerMeta(userid='84aa869713da4347914ce6054de5ea1e', username='tempest-AttachVolumeShelveTestJSON-653410335-project-member', projectid='c470ae60a73f43d183ba78fe4ed0d29b', projectname='tempest-AttachVolumeShelveTestJSON-653410335'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937415.407915) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:35.410777 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:35.410777 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:35.415243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:35.434541 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1883072808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1883072808',id=19,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvX0yrsEjRQhKUbSQ0Yc3XjjtKhz/ncFm0Sil9E7SkHBYBK2NYUZQUu5nNL7aJJoGiJCfA7/qOELTS3lioIxM8ke4WsLvemWlzkT5i0Ad/EzJNrjkuhp15FoZFMIFek2Q==',key_name='tempest-keypair-1874979258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-2kvbn7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=2f113470-8b6b-4ddc-b8c8-7f3cfa95803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:35.434921 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:35.436698 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:35.436698 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:35.456795 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.459560 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.524640 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.528893 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.558217 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.633517 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937415.633101, 185fd29d-4f07-4f32-8674-c734cdccc83d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:35.634600 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] VM Started (Lifecycle Event)
May 28 03:03:35.783893 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.790519 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.793643 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.820813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.823672 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance destroyed successfully.
May 28 03:03:35.824378 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'numa_topology' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:35.940594 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <uuid>2f113470-8b6b-4ddc-b8c8-7f3cfa95803f</uuid>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <name>instance-00000013</name>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1883072808</nova:name>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:35</nova:creationTime>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:user uuid="84aa869713da4347914ce6054de5ea1e">tempest-AttachVolumeShelveTestJSON-653410335-project-member</nova:user>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:project uuid="c470ae60a73f43d183ba78fe4ed0d29b">tempest-AttachVolumeShelveTestJSON-653410335</nova:project>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         <nova:port uuid="f680b933-10c8-4f0f-86e7-65aa46fd953d">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <entry name="serial">2f113470-8b6b-4ddc-b8c8-7f3cfa95803f</entry>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <entry name="uuid">2f113470-8b6b-4ddc-b8c8-7f3cfa95803f</entry>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:de:6d:95"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <target dev="tapf680b933-10"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/console.log" append="off"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:35.940594 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Preparing to wait for external event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1883072808',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1883072808',id=19,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvX0yrsEjRQhKUbSQ0Yc3XjjtKhz/ncFm0Sil9E7SkHBYBK2NYUZQUu5nNL7aJJoGiJCfA7/qOELTS3lioIxM8ke4WsLvemWlzkT5i0Ad/EzJNrjkuhp15FoZFMIFek2Q==',key_name='tempest-keypair-1874979258',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-2kvbn7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=2f113470-8b6b-4ddc-b8c8-7f3cfa95803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:35.943673 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.944218 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:35.944346 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:35.945585 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.945848 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f160ef6d-03ef-55d3-83ca-4be32b0eb2e2', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:35.946903 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.947730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:35.952786 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.956718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.956938 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf680b933-10, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:35.957286 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf680b933-10, col_values=(('qos', UUID('bc3607d1-681b-4b2c-9fe0-9ce3d1868557')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:35.957500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf680b933-10, col_values=(('external_ids', {'iface-id': 'f680b933-10c8-4f0f-86e7-65aa46fd953d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:6d:95', 'vm-uuid': '2f113470-8b6b-4ddc-b8c8-7f3cfa95803f'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:35.958396 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.960287 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:35.969993 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:35.970726 np0000001589 nova-compute[98297]: INFO os_vif [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10')
May 28 03:03:36.055496 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:36.066039 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:36.081289 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:36.113795 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:36.137382 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:36.138804 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937416.1385927, 185fd29d-4f07-4f32-8674-c734cdccc83d => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:36.138948 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] VM Paused (Lifecycle Event)
May 28 03:03:36.311990 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.313167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.315300 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.315840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.317336 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No event matching network-vif-plugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee in dict_keys([('network-vif-plugged', '5560f8fa-1f24-462f-b908-5aa738c9240b'), ('network-vif-plugged', '8f4823d8-e26e-4c35-8521-88219b693c40'), ('network-vif-plugged', '2b109c91-d16a-4f52-8cc6-f1327fcd5621')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:36.318036 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received unexpected event network-vif-plugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee for instance with vm_state building and task_state spawning.
May 28 03:03:36.318635 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.319861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.320058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.320361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.321243 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Processing event network-vif-plugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:36.321900 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.322331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.322551 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.322730 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.323119 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No event matching network-vif-plugged-5560f8fa-1f24-462f-b908-5aa738c9240b in dict_keys([('network-vif-plugged', '8f4823d8-e26e-4c35-8521-88219b693c40'), ('network-vif-plugged', '2b109c91-d16a-4f52-8cc6-f1327fcd5621')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:36.324122 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received unexpected event network-vif-plugged-5560f8fa-1f24-462f-b908-5aa738c9240b for instance with vm_state building and task_state spawning.
May 28 03:03:36.326407 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.327389 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.328200 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.328521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.330085 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Processing event network-vif-plugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:36.330345 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.332119 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:36.335888 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.336141 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:36.338751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.339596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.341526 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No event matching network-vif-plugged-8f4823d8-e26e-4c35-8521-88219b693c40 in dict_keys([('network-vif-plugged', '2b109c91-d16a-4f52-8cc6-f1327fcd5621')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:36.341526 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received unexpected event network-vif-plugged-8f4823d8-e26e-4c35-8521-88219b693c40 for instance with vm_state building and task_state spawning.
May 28 03:03:36.341526 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.341526 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.341726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.342022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.342798 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Processing event network-vif-plugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:36.343630 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.345498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.346347 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:03:36.350479 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.350479 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.350479 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-plugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:36.351453 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-dbac0f86-141f-4cdc-9a3a-7287a322bc63 req-346e18ad-be7b-4cf3-b583-7121c1265aec service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received unexpected event network-vif-plugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 for instance with vm_state building and task_state spawning.
May 28 03:03:36.353295 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:03:36.358321 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance spawned successfully.
May 28 03:03:36.360149 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:03:36.391985 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:36.391985 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:36.391985 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:36.391985 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:03:36.391985 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.75 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:03:36.641116 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:36.646004 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:36.700742 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-vif-plugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.700926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.701076 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.701183 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.701333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Processing event network-vif-plugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:36.701473 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-vif-plugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:36.701580 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:36.701692 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:36.702856 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.703004 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] No waiting events found dispatching network-vif-plugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:36.703120 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8e2ce84f-839e-4702-8401-f0b28e10bf91 req-8f8fcf4c-d17f-4d3c-bc52-ad3c8d6083eb service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received unexpected event network-vif-plugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a for instance with vm_state building and task_state spawning.
May 28 03:03:36.703758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:03:36.706622 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:03:36.711292 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Instance spawned successfully.
May 28 03:03:36.711737 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:03:36.868385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3ceb51f2-b070-4130-92b3-4f549ca4eed1 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.388s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:36.871654 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:36.872082 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:36.872550 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:36.872941 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:36.873206 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:36.873545 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:37.150455 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:03:37.150850 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937417.1504567, 60a15beb-a3bc-4d0f-8437-21699f6c76ca => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:37.150850 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] VM Started (Lifecycle Event)
May 28 03:03:37.218791 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:37.219200 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:37.219363 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:37.219760 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:37.220036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:37.220399 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:37.263979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-plugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:37.265034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:37.265034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:37.265034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:37.265034 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-plugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:37.265275 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received unexpected event network-vif-plugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 for instance with vm_state building and task_state spawning.
May 28 03:03:37.265908 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:37.265908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:37.265908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:37.266048 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:37.266255 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:37.269627 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state None.
May 28 03:03:37.269917 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:37.270320 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:37.270320 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:37.270439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:37.270613 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:37.270761 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c450b7e7-7c8e-4f16-bb6c-e61d231d6055 req-bd70b576-b335-482f-92f5-2630824f04c6 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state None.
May 28 03:03:37.380508 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Took 31.89 seconds to spawn the instance on the hypervisor.
May 28 03:03:37.380666 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:37.488241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:37.488401 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:37.488550 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No VIF found with MAC fa:16:3e:de:6d:95, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:37.488889 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Using config drive
May 28 03:03:37.534064 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:37.654588 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:37.656726 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:37.730001 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Took 8.74 seconds to spawn the instance on the hypervisor.
May 28 03:03:37.730192 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:37.890440 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Took 43.80 seconds to build instance.
May 28 03:03:37.996680 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:38.152632 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Creating config drive at /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config
May 28 03:03:38.158238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8altbpom {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:38.171914 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937418.1708775, 60a15beb-a3bc-4d0f-8437-21699f6c76ca => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:38.172155 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] VM Paused (Lifecycle Event)
May 28 03:03:38.211271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8altbpom" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:38.242561 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 5.105s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:38.243444 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:38.246603 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Took 14.22 seconds to build instance.
May 28 03:03:38.262571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:38.263855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:38.264456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:38.264871 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:38.265153 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:38.265364 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:38.280943 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:38.280943 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:38.292081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db] added
May 28 03:03:38.292081 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:38.292081 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:38.292081 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:38.292081 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:38.292081 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:38.292081 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:38.292291 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:38.292435 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:38.292579 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:38.293053 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:38.293053 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:38.302835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db] added
May 28 03:03:38.302835 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:38.302835 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:38.302835 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:38.302835 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:38.302835 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:38.302835 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:38.303108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:38.303166 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0378(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:38.303422 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:38.371133 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:38.392086 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.313s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:38.679422 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:38.682385 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999713068999881 future=<Future at 0x7e4b40609dc0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:38.682769 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999496497999871 future=<Future at 0x7e4b40609dc0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:38.682769 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999397293999891 future=<Future at 0x7e4b40609dc0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:38.685030 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937418.68482, 60a15beb-a3bc-4d0f-8437-21699f6c76ca => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:38.685166 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] VM Resumed (Lifecycle Event)
May 28 03:03:38.714165 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:38.746793 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9d798b40-2e77-4040-9f27-4308a2622063 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.734s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:38.748530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:38.756837 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:38.844497 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:38.878313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:38.878391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquired lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:38.879452 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:38.879452 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'info_cache' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:39.006485 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0b6438d1-059c-4be7-921a-523e51779665 req-7cf8870a-be53-410f-b3de-c232a778585f service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:39.007624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0b6438d1-059c-4be7-921a-523e51779665 req-7cf8870a-be53-410f-b3de-c232a778585f service nova] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:39.010179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0b6438d1-059c-4be7-921a-523e51779665 req-7cf8870a-be53-410f-b3de-c232a778585f service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:39.010347 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0b6438d1-059c-4be7-921a-523e51779665 req-7cf8870a-be53-410f-b3de-c232a778585f service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:39.011858 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0b6438d1-059c-4be7-921a-523e51779665 req-7cf8870a-be53-410f-b3de-c232a778585f service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Processing event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:39.155195 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:39.162322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:39.166482 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:39.187635 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:39.193710 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:39.195485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:39.200656 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:39.293160 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:39.304565 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:39.315943 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:39.315943 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:39.328304 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:39.328304 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.334370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.346651 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.361466 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.361948 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.372321 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:39.384969 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:39.442965 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.40.100,3260]
May 28 03:03:39.442965 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.40.100,3260] successful.
May 28 03:03:39.442965 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.450459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.50.100,3260]
May 28 03:03:39.450459 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.50.100,3260] successful.
May 28 03:03:39.450459 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.474144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.475578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.506026 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.507003 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:39.508249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:39.508249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:39.512275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] HCTL ('23', '-', '-', 0) found on session 45 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:39.513488 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:39.543560 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching for a device in session 45 and hctl ['23', '*', '*', 0] yield: sdq {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:39.543637 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.549870 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2e8b47d-a61e-4792-b1df-935c83d224ca (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:39.550319 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:39.550761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.286s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:39.550761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:39.552348 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] HCTL ('22', '-', '-', 0) found on session 44 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:39.552453 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:39.590389 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Searching for a device in session 44 and hctl ['22', '*', '*', 0] yield: sdr {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:39.590389 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:39.697109 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937419.6967583, 185fd29d-4f07-4f32-8674-c734cdccc83d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:39.697318 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] VM Resumed (Lifecycle Event)
May 28 03:03:39.876033 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:03:39.881355 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:03:39.883977 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance spawned successfully.
May 28 03:03:39.884625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:03:39.887656 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:40.081588 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:40.200434 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:40.202285 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: image_snapshot, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:40.265288 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:40.313470 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:40.385248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-changed-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:40.385248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing instance network info cache due to event network-changed-3216c453-3e7f-455e-8c3b-d1d783b1c2a1. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:40.388398 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] Acquiring lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:40.388398 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] Acquired lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:40.388398 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Refreshing network info cache for port 3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:40.395607 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:40.397256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:40.397811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:40.398959 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:40.399614 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:40.400258 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:40.602807 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] instance snapshotting
May 28 03:03:40.655424 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updating instance_info_cache with network_info: [{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:40.705058 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] During sync_power_state the instance has a pending task (image_snapshot). Skip.
May 28 03:03:40.705390 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937420.7051659, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:40.705525 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Started (Lifecycle Event)
May 28 03:03:40.757641 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Beginning live snapshot process
May 28 03:03:40.891721 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:40.909794 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Took 7.44 seconds to spawn the instance on the hypervisor.
May 28 03:03:40.910055 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:40.972995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:41.104659 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dcf0bcde-44cf-45aa-99a9-92d233c017c4 req-3d134554-987f-4769-a22c-84a96b0303ad service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:41.104934 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dcf0bcde-44cf-45aa-99a9-92d233c017c4 req-3d134554-987f-4769-a22c-84a96b0303ad service nova] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:41.105792 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dcf0bcde-44cf-45aa-99a9-92d233c017c4 req-3d134554-987f-4769-a22c-84a96b0303ad service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:41.105990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dcf0bcde-44cf-45aa-99a9-92d233c017c4 req-3d134554-987f-4769-a22c-84a96b0303ad service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:41.106187 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dcf0bcde-44cf-45aa-99a9-92d233c017c4 req-3d134554-987f-4769-a22c-84a96b0303ad service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] No waiting events found dispatching network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:41.106543 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-dcf0bcde-44cf-45aa-99a9-92d233c017c4 req-3d134554-987f-4769-a22c-84a96b0303ad service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received unexpected event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d for instance with vm_state active and task_state None.
May 28 03:03:41.163184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Releasing lock "refresh_cache-e5117e69-981a-42a7-9fdb-c5fb550fe5b9" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:41.210252 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:41.211611 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:41.286026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Found WWN 3300000002af3bfdf for multipath device dm-11 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:41.286382 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:41.286609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== connect_volume: return (8148ms) {'type': 'block', 'scsi_wwn': '3300000002af3bfdf', 'path': '/dev/dm-11', 'multipath_id': '3300000002af3bfdf'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:41.286804 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002af3bfdf', 'path': '/dev/dm-11', 'multipath_id': '3300000002af3bfdf'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:41.346388 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:41.426093 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Took 13.06 seconds to build instance.
May 28 03:03:41.529621 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updated VIF entry in instance network info cache for port 3216c453-3e7f-455e-8c3b-d1d783b1c2a1. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:03:41.530339 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [{"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:41.715216 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937421.7149355, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:41.715385 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Paused (Lifecycle Event)
May 28 03:03:41.801430 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:41.801694 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:41.802367 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:17:80,bridge_name='br-int',has_traffic_filtering=True,id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e,network=Network(22f48e63-5082-4016-ab50-7465732f4540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e99d894-6c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:41.803187 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:41.804464 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:41.805146 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:47:e6,bridge_name='br-int',has_traffic_filtering=True,id=6f9d30b5-ddb6-4742-a71e-4586b2896fd7,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f9d30b5-dd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:41.808592 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:41.808791 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:41.809699 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:a7:00,bridge_name='br-int',has_traffic_filtering=True,id=71da4e7e-ce44-4a8a-9522-c433f06f9e0c,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71da4e7e-ce') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:41.811340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:41.811481 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:41.811890 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=a3f51ea2-4c87-49da-a163-417ce20a5efd,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f51ea2-4c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:41.812601 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:41.812737 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:41.813383 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e7:d4,bridge_name='br-int',has_traffic_filtering=True,id=f60a5b73-285c-455a-8503-39987d159dc0,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60a5b73-28') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:41.813984 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:41.813984 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:41.814753 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a1:bc,bridge_name='br-int',has_traffic_filtering=True,id=ae84a137-be40-4ec5-a4f5-587338742734,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae84a137-be') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:41.820503 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:41.820503 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:41.820503 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:de,bridge_name='br-int',has_traffic_filtering=True,id=a55473db-0338-440a-90f5-69820a020453,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55473db-03') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:41.820761 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lazy-loading 'pci_devices' on Instance uuid 7edf7fdf-a897-456a-b47a-0e6154035b35 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:41.929194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.577s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.034692 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-90e111c6-f71d-4a0c-96c8-6a3e660a2f6c req-5dca5a54-e7eb-4cc5-944b-29b19b84509c service nova] Releasing lock "refresh_cache-60a15beb-a3bc-4d0f-8437-21699f6c76ca" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:42.177127 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance destroyed successfully.
May 28 03:03:42.177500 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'numa_topology' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:42.217690 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:42.219483 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937422.2192562, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:42.219716 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Resumed (Lifecycle Event)
May 28 03:03:42.286087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:42.352747 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <uuid>7edf7fdf-a897-456a-b47a-0e6154035b35</uuid>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <name>instance-00000011</name>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:name>tempest-device-tagging-server-658837030</nova:name>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:22</nova:creationTime>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:user uuid="dcd7536c083d44349596a82948bb40e0">tempest-TaggedBootDevicesTest-864280134-project-member</nova:user>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:project uuid="077e33a200944c65a8018f12fe6f499e">tempest-TaggedBootDevicesTest-864280134</nova:project>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:port uuid="3e99d894-6ccc-435b-8aaa-b5a9ccc0393e">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:port uuid="6f9d30b5-ddb6-4742-a71e-4586b2896fd7">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:port uuid="71da4e7e-ce44-4a8a-9522-c433f06f9e0c">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:port uuid="a3f51ea2-4c87-49da-a163-417ce20a5efd">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.237" ipVersion="4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:port uuid="f60a5b73-285c-455a-8503-39987d159dc0">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.1.105" ipVersion="4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:port uuid="ae84a137-be40-4ec5-a4f5-587338742734">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         <nova:port uuid="a55473db-0338-440a-90f5-69820a020453">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <entry name="serial">7edf7fdf-a897-456a-b47a-0e6154035b35</entry>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <entry name="uuid">7edf7fdf-a897-456a-b47a-0e6154035b35</entry>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35/disk.config"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <alias name="ua-ef60b330-4fcb-41e8-871c-edf3f5932bba"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-6"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <serial>ef60b330-4fcb-41e8-871c-edf3f5932bba</serial>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <alias name="ua-aac98498-ef87-4ea4-8b0a-47d9eef04ca9"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-10"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <serial>aac98498-ef87-4ea4-8b0a-47d9eef04ca9</serial>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <alias name="ua-8f810741-3315-4c52-9a1f-0c51ae77e7db"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-11"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="vdc" bus="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <serial>8f810741-3315-4c52-9a1f-0c51ae77e7db</serial>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:04:17:80"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="tap3e99d894-6c"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:c0:47:e6"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="tap6f9d30b5-dd"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:db:a7:00"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="tap71da4e7e-ce"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:c5:af:a3"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="tapa3f51ea2-4c"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:bc:e7:d4"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="tapf60a5b73-28"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:0e:a1:bc"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="tapae84a137-be"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:17:bc:de"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <target dev="tapa55473db-03"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35/console.log" append="off"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:42.352747 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Preparing to wait for external event network-vif-plugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Preparing to wait for external event network-vif-plugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Preparing to wait for external event network-vif-plugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Preparing to wait for external event network-vif-plugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Preparing to wait for external event network-vif-plugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Preparing to wait for external event network-vif-plugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Preparing to wait for external event network-vif-plugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:42.361946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:42.362705 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:42.362705 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:42.362705 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:17:80,bridge_name='br-int',has_traffic_filtering=True,id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e,network=Network(22f48e63-5082-4016-ab50-7465732f4540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e99d894-6c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:42.362705 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:17:80,bridge_name='br-int',has_traffic_filtering=True,id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e,network=Network(22f48e63-5082-4016-ab50-7465732f4540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e99d894-6c') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:42.364012 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.365316 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.366614 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:42.368915 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.368915 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f350f3b8-e10e-5bfd-a343-e0ce176c9061', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.381455 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.381455 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.393085 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.396336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.396336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e99d894-6c, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.396336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e99d894-6c, col_values=(('qos', UUID('215b0ef9-2a22-4315-9647-b9d2b8464f4d')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.396336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e99d894-6c, col_values=(('external_ids', {'iface-id': '3e99d894-6ccc-435b-8aaa-b5a9ccc0393e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:17:80', 'vm-uuid': '7edf7fdf-a897-456a-b47a-0e6154035b35'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.397060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.398520 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.412199 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.413834 np0000001589 nova-compute[98297]: INFO os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:17:80,bridge_name='br-int',has_traffic_filtering=True,id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e,network=Network(22f48e63-5082-4016-ab50-7465732f4540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e99d894-6c')
May 28 03:03:42.414789 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:42.415087 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:42.415663 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:47:e6,bridge_name='br-int',has_traffic_filtering=True,id=6f9d30b5-ddb6-4742-a71e-4586b2896fd7,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f9d30b5-dd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:42.415910 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:47:e6,bridge_name='br-int',has_traffic_filtering=True,id=6f9d30b5-ddb6-4742-a71e-4586b2896fd7,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f9d30b5-dd') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:42.417243 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.417721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:42.418263 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.418263 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:42.418540 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:42.419442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.419681 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb2a8d0f-e258-52e2-ba06-c8efa19942e1', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.433654 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.435601 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.446694 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.448909 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.450209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f9d30b5-dd, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.450209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f9d30b5-dd, col_values=(('qos', UUID('335f327c-3eae-40c2-badc-3801268bb913')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.450209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f9d30b5-dd, col_values=(('external_ids', {'iface-id': '6f9d30b5-ddb6-4742-a71e-4586b2896fd7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:47:e6', 'vm-uuid': '7edf7fdf-a897-456a-b47a-0e6154035b35'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.451958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.451958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.466221 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.466968 np0000001589 nova-compute[98297]: INFO os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:47:e6,bridge_name='br-int',has_traffic_filtering=True,id=6f9d30b5-ddb6-4742-a71e-4586b2896fd7,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f9d30b5-dd')
May 28 03:03:42.468025 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:42.468249 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:42.468906 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:a7:00,bridge_name='br-int',has_traffic_filtering=True,id=71da4e7e-ce44-4a8a-9522-c433f06f9e0c,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71da4e7e-ce') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:42.469378 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a7:00,bridge_name='br-int',has_traffic_filtering=True,id=71da4e7e-ce44-4a8a-9522-c433f06f9e0c,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71da4e7e-ce') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:42.469659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.469978 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.470277 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:42.471440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.471635 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd285e931-f116-5622-a73f-ca214a6f28f7', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.472312 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.472959 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.487392 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.489975 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.491416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71da4e7e-ce, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.491416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71da4e7e-ce, col_values=(('qos', UUID('26234332-494d-4eea-b23b-a8ea2533e3ba')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.491416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71da4e7e-ce, col_values=(('external_ids', {'iface-id': '71da4e7e-ce44-4a8a-9522-c433f06f9e0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:a7:00', 'vm-uuid': '7edf7fdf-a897-456a-b47a-0e6154035b35'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.491977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.493737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.499069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json -f qcow2" returned: 0 in 0.080s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:42.499900 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:42.505881 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:03:42.506419 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:42.523308 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.525508 np0000001589 nova-compute[98297]: INFO os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a7:00,bridge_name='br-int',has_traffic_filtering=True,id=71da4e7e-ce44-4a8a-9522-c433f06f9e0c,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71da4e7e-ce')
May 28 03:03:42.527015 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:42.527247 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:42.528216 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=a3f51ea2-4c87-49da-a163-417ce20a5efd,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f51ea2-4c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:42.528507 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=a3f51ea2-4c87-49da-a163-417ce20a5efd,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f51ea2-4c') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:42.529653 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.529653 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.529653 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:42.531663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.531663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15960405-c4e4-55a5-809a-9dd8fac37860', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.532690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.533256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.553523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.555148 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.558707 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3f51ea2-4c, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.560085 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3f51ea2-4c, col_values=(('qos', UUID('014efff9-13ea-416c-913c-7ce598adf0dc')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.560085 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3f51ea2-4c, col_values=(('external_ids', {'iface-id': 'a3f51ea2-4c87-49da-a163-417ce20a5efd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:af:a3', 'vm-uuid': '7edf7fdf-a897-456a-b47a-0e6154035b35'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.560683 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.562119 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.582531 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.583897 np0000001589 nova-compute[98297]: INFO os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=a3f51ea2-4c87-49da-a163-417ce20a5efd,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f51ea2-4c')
May 28 03:03:42.584799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:42.585001 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:42.585435 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e7:d4,bridge_name='br-int',has_traffic_filtering=True,id=f60a5b73-285c-455a-8503-39987d159dc0,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60a5b73-28') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:42.585665 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e7:d4,bridge_name='br-int',has_traffic_filtering=True,id=f60a5b73-285c-455a-8503-39987d159dc0,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60a5b73-28') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:42.586552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.586552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.586552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:42.588532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.589293 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be1acf25-b76a-521c-a387-67b17d5bb163', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.590772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.590772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.591130 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:42.591654 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoeva7nrm/bec77df6f0264cd18c3cf16bba56dd56.delta 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:42.616375 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.624504 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.624504 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf60a5b73-28, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.624504 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf60a5b73-28, col_values=(('qos', UUID('e22616ac-35c0-4225-8567-2f8fbefe731f')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.624504 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf60a5b73-28, col_values=(('external_ids', {'iface-id': 'f60a5b73-285c-455a-8503-39987d159dc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:e7:d4', 'vm-uuid': '7edf7fdf-a897-456a-b47a-0e6154035b35'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.625095 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.626449 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.639338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoeva7nrm/bec77df6f0264cd18c3cf16bba56dd56.delta 1073741824" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:42.639924 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 03:03:42.656655 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.657156 np0000001589 nova-compute[98297]: INFO os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e7:d4,bridge_name='br-int',has_traffic_filtering=True,id=f60a5b73-285c-455a-8503-39987d159dc0,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60a5b73-28')
May 28 03:03:42.658172 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:42.658365 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:42.659162 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a1:bc,bridge_name='br-int',has_traffic_filtering=True,id=ae84a137-be40-4ec5-a4f5-587338742734,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae84a137-be') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:42.659587 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a1:bc,bridge_name='br-int',has_traffic_filtering=True,id=ae84a137-be40-4ec5-a4f5-587338742734,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae84a137-be') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:42.659964 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.660268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.660544 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:42.661761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.661988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afdb07f5-ea69-59de-8dfa-5f7790d4fe0b', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.662764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.663462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.681357 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:42.681357 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'resources' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:42.695618 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.700273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.700273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae84a137-be, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.700273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae84a137-be, col_values=(('qos', UUID('c1a6f2d0-2b35-4a98-8441-8aef0112b9a9')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.700273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae84a137-be, col_values=(('external_ids', {'iface-id': 'ae84a137-be40-4ec5-a4f5-587338742734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a1:bc', 'vm-uuid': '7edf7fdf-a897-456a-b47a-0e6154035b35'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.701031 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.704491 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.723191 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:42.733412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:42.745571 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.745938 np0000001589 nova-compute[98297]: INFO os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a1:bc,bridge_name='br-int',has_traffic_filtering=True,id=ae84a137-be40-4ec5-a4f5-587338742734,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae84a137-be')
May 28 03:03:42.746538 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:42.746698 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:42.747138 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:de,bridge_name='br-int',has_traffic_filtering=True,id=a55473db-0338-440a-90f5-69820a020453,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55473db-03') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:42.747348 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:de,bridge_name='br-int',has_traffic_filtering=True,id=a55473db-0338-440a-90f5-69820a020453,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55473db-03') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:42.750127 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.750127 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.750970 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:42.751475 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.751619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fff8b9c7-b541-5e70-b86f-9af4e0f6fd3d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.753798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.753874 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.788144 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.795690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.795690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa55473db-03, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.795892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa55473db-03, col_values=(('qos', UUID('304e4ae9-c6d5-48fa-8656-9b32d39bbf75')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.796086 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa55473db-03, col_values=(('external_ids', {'iface-id': 'a55473db-0338-440a-90f5-69820a020453', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:bc:de', 'vm-uuid': '7edf7fdf-a897-456a-b47a-0e6154035b35'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:42.800250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.800250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:42.841182 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:42.842407 np0000001589 nova-compute[98297]: INFO os_vif [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:de,bridge_name='br-int',has_traffic_filtering=True,id=a55473db-0338-440a-90f5-69820a020453,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55473db-03')
May 28 03:03:42.918998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98297) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 03:03:42.922692 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 03:03:42.979584 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:03:42.979930 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoeva7nrm/bec77df6f0264cd18c3cf16bba56dd56.delta /opt/stack/data/nova/instances/snapshots/tmpoeva7nrm/bec77df6f0264cd18c3cf16bba56dd56 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:43.093437 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoeva7nrm/bec77df6f0264cd18c3cf16bba56dd56.delta /opt/stack/data/nova/instances/snapshots/tmpoeva7nrm/bec77df6f0264cd18c3cf16bba56dd56" returned: 0 in 0.113s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:43.094278 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Snapshot extracted, beginning image upload
May 28 03:03:43.165363 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:43.165496 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing instance network info cache due to event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:43.165778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] Acquiring lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:43.165938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] Acquired lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:43.166141 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing network info cache for port f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:43.185545 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:43.187784 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:03:43.191014 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:43.194594 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:43.197246 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:03:43.205795 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:43.206201 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa451f1e5-e9, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:43.208873 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:43.209887 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:43.249097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:43.255620 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:43.255751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6b14325-4ca7-4884-9c07-9bf3deb6347e) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:43.257663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:43.299426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:43.305692 np0000001589 nova-compute[98297]: INFO os_vif [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9')
May 28 03:03:43.317082 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Start _get_guest_xml network_info=[{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:43.321941 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:43.323589 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-2011301087', uuid='e5117e69-981a-42a7-9fdb-c5fb550fe5b9'), owner=OwnerMeta(userid='41af6183ea4b4a668518493baf359999', username='tempest-AttachVolumeTestJSON-695798121-project-member', projectid='989151e14dc44db3b75763b654bb2199', projectname='tempest-AttachVolumeTestJSON-695798121'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937423.3230903) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:43.324440 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:43.324759 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:43.325525 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:43.325693 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:43.326561 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:43.326828 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:43.326968 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:43.327010 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:43.327168 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:43.327274 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:43.327378 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:43.327513 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:43.327607 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:43.327705 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:43.327856 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:43.328004 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:43.328145 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:43.670839 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:43.830061 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:43.847854 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:43.848090 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:43.848575 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:43.849555 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'pci_devices' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:44.154874 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:44.238321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:44.238550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:44.312342 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updated VIF entry in instance network info cache for port f680b933-10c8-4f0f-86e7-65aa46fd953d. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:03:44.312843 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:44.352024 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:44.353342 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <uuid>e5117e69-981a-42a7-9fdb-c5fb550fe5b9</uuid>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <name>instance-0000000b</name>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeTestJSON-server-2011301087</nova:name>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:43</nova:creationTime>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:user uuid="41af6183ea4b4a668518493baf359999">tempest-AttachVolumeTestJSON-695798121-project-member</nova:user>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:project uuid="989151e14dc44db3b75763b654bb2199">tempest-AttachVolumeTestJSON-695798121</nova:project>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         <nova:port uuid="a451f1e5-e9e1-4ab0-a842-5a7e598465b1">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <entry name="serial">e5117e69-981a-42a7-9fdb-c5fb550fe5b9</entry>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <entry name="uuid">e5117e69-981a-42a7-9fdb-c5fb550fe5b9</entry>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk.config"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:e1:0d:00"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <target dev="tapa451f1e5-e9"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/console.log" append="off"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:44.353342 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:44.355931 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:44.383335 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:44.385248 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:44.385248 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] No VIF found with MAC fa:16:3e:04:17:80, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:44.385248 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] No VIF found with MAC fa:16:3e:bc:e7:d4, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:44.385923 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Using config drive
May 28 03:03:44.452240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:44.453392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:44.552251 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:44.555677 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:44.740285 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:03:44.815088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a96f96f4-03de-45d3-b669-693383715275 req-0c60135d-6b52-4a32-9801-30bba4ff3cee service nova] Releasing lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:44.898766 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:45.064250 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:45.064250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:45.087299 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Creating config drive at /opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35/disk.config
May 28 03:03:45.092120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd0sgd8rv {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:45.146089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd0sgd8rv" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:45.149306 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:45.149808 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:03:45.150083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:45.264074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:03:45.264573 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Cannot resize image /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:03:45.264847 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'migration_context' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:45.309463 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:45.309700 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:45.312960 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:03:45.313272 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Claim successful on node np0000001589
May 28 03:03:45.727251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.770711 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Object Instance<e5117e69-981a-42a7-9fdb-c5fb550fe5b9> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:03:45.770711 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:45.770711 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:45.771278 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:45.772270 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:45.774994 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.775439 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:45.775798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:45.784002 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.784126 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.785070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a6190f7-b6cf-50fa-aac0-e7000630422d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:45.787405 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.788789 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:45.820761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.824955 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.825190 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa451f1e5-e9, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:45.825612 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa451f1e5-e9, col_values=(('qos', UUID('62da28dc-690f-437e-a945-67617dc032c8')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:45.828660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa451f1e5-e9, col_values=(('external_ids', {'iface-id': 'a451f1e5-e9e1-4ab0-a842-5a7e598465b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:0d:00', 'vm-uuid': 'e5117e69-981a-42a7-9fdb-c5fb550fe5b9'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:45.828660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.828660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:45.870486 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.927724 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Snapshot image upload complete
May 28 03:03:45.927970 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e2152b84-101b-487b-a122-1f904b7b1f12 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Took 5.32 seconds to snapshot the instance on the hypervisor.
May 28 03:03:45.970510 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:45.973450 np0000001589 nova-compute[98297]: INFO os_vif [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9')
May 28 03:03:45.999900 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.009665 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.033493 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ffa99df0-262f-4977-a3e4-bf5bfd0e1316 req-b8adb8e1-82d5-4403-99cf-304ed03aeef1 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:46.033707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ffa99df0-262f-4977-a3e4-bf5bfd0e1316 req-b8adb8e1-82d5-4403-99cf-304ed03aeef1 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:46.033794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ffa99df0-262f-4977-a3e4-bf5bfd0e1316 req-b8adb8e1-82d5-4403-99cf-304ed03aeef1 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:46.033913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ffa99df0-262f-4977-a3e4-bf5bfd0e1316 req-b8adb8e1-82d5-4403-99cf-304ed03aeef1 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:46.034081 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ffa99df0-262f-4977-a3e4-bf5bfd0e1316 req-b8adb8e1-82d5-4403-99cf-304ed03aeef1 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Processing event network-vif-plugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:46.034725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.056468 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.096339 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.147558 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.150740 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.182923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.205715 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.256631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.257173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.285208 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.314070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.374916 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.393305 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7a4373d8-3a45-4313-a8aa-5fdcc57e5c4b req-f970e1ce-3db5-4a31-b91a-eb053ee3f689 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:46.393666 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7a4373d8-3a45-4313-a8aa-5fdcc57e5c4b req-f970e1ce-3db5-4a31-b91a-eb053ee3f689 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:46.394022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7a4373d8-3a45-4313-a8aa-5fdcc57e5c4b req-f970e1ce-3db5-4a31-b91a-eb053ee3f689 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:46.394324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7a4373d8-3a45-4313-a8aa-5fdcc57e5c4b req-f970e1ce-3db5-4a31-b91a-eb053ee3f689 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:46.394584 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7a4373d8-3a45-4313-a8aa-5fdcc57e5c4b req-f970e1ce-3db5-4a31-b91a-eb053ee3f689 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Processing event network-vif-plugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:46.541327 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.688049 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.785533 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.794944 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.803218 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.808715 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.838851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.855470 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.865822 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.891505 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.901791 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:46.932059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.033592 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:47.033850 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:47.051609 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.105421 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8dac8d1-0d66-4046-89be-3731ca07d045 req-16e9a949-5e47-4c62-863f-51df06460ade service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:47.106237 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8dac8d1-0d66-4046-89be-3731ca07d045 req-16e9a949-5e47-4c62-863f-51df06460ade service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:47.106237 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8dac8d1-0d66-4046-89be-3731ca07d045 req-16e9a949-5e47-4c62-863f-51df06460ade service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:47.106349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a8dac8d1-0d66-4046-89be-3731ca07d045 req-16e9a949-5e47-4c62-863f-51df06460ade service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:47.106529 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a8dac8d1-0d66-4046-89be-3731ca07d045 req-16e9a949-5e47-4c62-863f-51df06460ade service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:47.106695 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a8dac8d1-0d66-4046-89be-3731ca07d045 req-16e9a949-5e47-4c62-863f-51df06460ade service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state powering-on.
May 28 03:03:47.128968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.158158 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.158358 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.335570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.338469 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.519380 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.520059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.538831 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:47.560083 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.880936 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.884398 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.888009 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.913935 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:47.993965 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for e5117e69-981a-42a7-9fdb-c5fb550fe5b9 due to new event <LifecycleEvent: 1779937427.993618, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:03:47.994452 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:03:47.994641 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937427.993618, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:47.995068 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Resumed (Lifecycle Event)
May 28 03:03:48.002257 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance rebooted successfully.
May 28 03:03:48.046512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.737s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.049307 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No event matching network-vif-plugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e in dict_keys([('network-vif-plugged', '6f9d30b5-ddb6-4742-a71e-4586b2896fd7'), ('network-vif-plugged', 'a3f51ea2-4c87-49da-a163-417ce20a5efd'), ('network-vif-plugged', 'f60a5b73-285c-455a-8503-39987d159dc0'), ('network-vif-plugged', 'ae84a137-be40-4ec5-a4f5-587338742734'), ('network-vif-plugged', 'a55473db-0338-440a-90f5-69820a020453')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received unexpected event network-vif-plugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e for instance with vm_state building and task_state spawning.
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Processing event network-vif-plugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:48.131269 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.131860 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.131860 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.131860 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.131959 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No event matching network-vif-plugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 in dict_keys([('network-vif-plugged', 'a3f51ea2-4c87-49da-a163-417ce20a5efd'), ('network-vif-plugged', 'f60a5b73-285c-455a-8503-39987d159dc0'), ('network-vif-plugged', 'ae84a137-be40-4ec5-a4f5-587338742734'), ('network-vif-plugged', 'a55473db-0338-440a-90f5-69820a020453')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received unexpected event network-vif-plugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 for instance with vm_state building and task_state spawning.
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Processing event network-vif-plugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No event matching network-vif-plugged-a3f51ea2-4c87-49da-a163-417ce20a5efd in dict_keys([('network-vif-plugged', 'f60a5b73-285c-455a-8503-39987d159dc0'), ('network-vif-plugged', 'ae84a137-be40-4ec5-a4f5-587338742734'), ('network-vif-plugged', 'a55473db-0338-440a-90f5-69820a020453')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received unexpected event network-vif-plugged-a3f51ea2-4c87-49da-a163-417ce20a5efd for instance with vm_state building and task_state spawning.
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Processing event network-vif-plugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No event matching network-vif-plugged-f60a5b73-285c-455a-8503-39987d159dc0 in dict_keys([('network-vif-plugged', 'ae84a137-be40-4ec5-a4f5-587338742734'), ('network-vif-plugged', 'a55473db-0338-440a-90f5-69820a020453')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:48.137547 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6108e2ff-1f86-4cd0-8024-895d0848528e req-3580afc2-592e-4df3-869d-bb5159a0ea64 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received unexpected event network-vif-plugged-f60a5b73-285c-455a-8503-39987d159dc0 for instance with vm_state building and task_state spawning.
May 28 03:03:48.346356 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:48.348247 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:48.351370 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:48.374888 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:48.375400 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:48.398023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.398180 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.486904 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.487070 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.487238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.487359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.487532 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No event matching network-vif-plugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c in dict_keys([('network-vif-plugged', 'ae84a137-be40-4ec5-a4f5-587338742734'), ('network-vif-plugged', 'a55473db-0338-440a-90f5-69820a020453')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:48.487624 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received unexpected event network-vif-plugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c for instance with vm_state building and task_state spawning.
May 28 03:03:48.487729 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.488101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.488248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.488411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.488479 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Processing event network-vif-plugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:48.488609 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.488802 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.488914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.489015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.489157 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No event matching network-vif-plugged-ae84a137-be40-4ec5-a4f5-587338742734 in dict_keys([('network-vif-plugged', 'a55473db-0338-440a-90f5-69820a020453')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:03:48.489313 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received unexpected event network-vif-plugged-ae84a137-be40-4ec5-a4f5-587338742734 for instance with vm_state building and task_state spawning.
May 28 03:03:48.489430 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.490087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.490087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.490087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.490087 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Processing event network-vif-plugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:03:48.490087 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-plugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:48.490087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:48.490498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:48.490498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:48.490875 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:03:48.490949 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-plugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:48.491010 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7539f584-7201-4103-92c5-46cd7a1d8e37 req-6dc5adee-78ba-428e-83d4-c1cb444d00a4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received unexpected event network-vif-plugged-a55473db-0338-440a-90f5-69820a020453 for instance with vm_state building and task_state spawning.
May 28 03:03:48.495841 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:03:48.497275 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:48.497912 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance spawned successfully.
May 28 03:03:48.498199 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:03:48.500334 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:48.555076 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:03:48.555309 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:03:48.555607 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:48.555867 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:48.645446 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2776d33c40e0490eb87787c8dafc8066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d2ef1b6a03d428d94b2072c01964b49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:03:48.681007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:48.682093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:48.901288 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:03:49.003480 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 03:03:49.003999 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937429.0036094, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:49.003999 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Started (Lifecycle Event)
May 28 03:03:49.008349 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:49.008473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:49.009203 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:49.009203 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:49.009913 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:49.009913 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:03:49.058581 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:03:49.181840 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acbf82e3-0d48-46fd-b829-b9f7298362be req-1f002d5e-b774-402e-b0bc-ea8fd642ecf7 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:49.184945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acbf82e3-0d48-46fd-b829-b9f7298362be req-1f002d5e-b774-402e-b0bc-ea8fd642ecf7 service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:49.184945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acbf82e3-0d48-46fd-b829-b9f7298362be req-1f002d5e-b774-402e-b0bc-ea8fd642ecf7 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:49.184945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acbf82e3-0d48-46fd-b829-b9f7298362be req-1f002d5e-b774-402e-b0bc-ea8fd642ecf7 service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:49.184945 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acbf82e3-0d48-46fd-b829-b9f7298362be req-1f002d5e-b774-402e-b0bc-ea8fd642ecf7 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:03:49.184945 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-acbf82e3-0d48-46fd-b829-b9f7298362be req-1f002d5e-b774-402e-b0bc-ea8fd642ecf7 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received unexpected event network-vif-plugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with vm_state stopped and task_state powering-on.
May 28 03:03:49.310537 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Successfully created port: 655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:49.475603 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:49.476108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:49.479293 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:03:49.479474 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Claim successful on node np0000001589
May 28 03:03:49.506278 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:49.508991 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:49.520190 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Took 35.35 seconds to spawn the instance on the hypervisor.
May 28 03:03:49.526034 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:49.526557 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:49.526557 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No VIF found with MAC fa:16:3e:e1:0d:00, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:49.526984 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-bf757bb3-1c78-4384-9bf7-f03b28c70bf8 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:49.527154 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:49.567263 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:03:49.885046 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Successfully updated port: 655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:50.014195 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 03:03:50.014400 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937430.0140781, 7edf7fdf-a897-456a-b47a-0e6154035b35 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:50.014502 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] VM Started (Lifecycle Event)
May 28 03:03:50.046801 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Took 48.62 seconds to build instance.
May 28 03:03:50.075549 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Booting with volume 27cefffc-a717-431f-8c2e-14173adab86d at /dev/vda
May 28 03:03:50.121647 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:50.136659 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:50.165198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:50.200291 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-changed-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:50.200792 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Refreshing instance network info cache due to event network-changed-655008ea-4b6e-4f49-8d26-86c4c4aff849. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:50.201076 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] Acquiring lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:50.201167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] Acquired lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:50.201337 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Refreshing network info cache for port 655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:50.206556 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:50.207250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:50.220251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:50.221105 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe2a:f30e', 'fe80::e88a:9dff:fe29:20d6', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fed9:99b1', 'fe80::fcc7:c8ff:feee:2faf', 'fe80::fc16:3eff:fead:5e8', 'fe80::fc16:3eff:fed6:5a8', 'fe80::485f:25ff:fef3:b63f', 'fe80::fc16:3eff:fe89:b476', 'fe80::fc16:3eff:fe82:1863', 'fe80::fc16:3eff:fe27:9dfe', 'fe80::fc16:3eff:fe8d:e188', 'fe80::fc16:3eff:fedb:f477', 'fe80::24dc:ebff:fe91:c5bb', 'fe80::fc16:3eff:fede:6d95', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe04:1780', 'fe80::fc16:3eff:fec0:47e6', 'fe80::98b5:c5ff:fe0e:a7a8', 'fe80::fc16:3eff:fedb:a700', 'fe80::fc16:3eff:fec5:afa3', 'fe80::fc16:3eff:febc:e7d4', 'fe80::8008:42ff:fec4:9cf4', 'fe80::fc16:3eff:fe0e:a1bc', 'fe80::fc16:3eff:fee1:d00', 'fe80::fc16:3eff:fe17:bcde', 'fe80::9c1c:d6ff:fec9:3328', 'fe80::f8a7:3dff:fea5:b4c6'] 
May 28 03:03:50.221460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:50.221750 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:50.222060 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:50.222396 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating existing volume attachment record: 87ab802a-e723-4f55-b830-e76175275e2a {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:50.389017 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:50.519026 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:50.524317 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:50.548954 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.134s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:50.703611 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:50.809215 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:50.828707 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:51.031426 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937431.031119, 7edf7fdf-a897-456a-b47a-0e6154035b35 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:51.031578 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] VM Paused (Lifecycle Event)
May 28 03:03:51.061243 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:51.191468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:03:51.191744 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:03:51.534296 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:51.538682 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937431.538326, 7edf7fdf-a897-456a-b47a-0e6154035b35 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:03:51.539038 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] VM Resumed (Lifecycle Event)
May 28 03:03:51.563615 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-31b49d28-2403-4dba-9b17-ce47d662fbeb req-5add2859-d663-437d-a980-2dafb26b6a8b service nova] Releasing lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:51.564692 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquired lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:51.566253 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:51.694778 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:03:51.751829 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:03:52.041434 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:03:52.043014 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:03:52.127053 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:52.204218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.728s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:52.204686 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:03:52.296027 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-changed-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:52.296405 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing instance network info cache due to event network-changed-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:52.296405 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] Acquiring lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:52.296583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] Acquired lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:52.296583 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Refreshing network info cache for port 3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:52.312922 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:52.333803 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:03:52.335536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:03:52.335536 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Creating image(s)
May 28 03:03:52.336450 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:03:52.336450 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Ensure instance console log exists: /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:03:52.337660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:52.337660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:52.337660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:52.341864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:52.342019 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:52.450564 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating instance_info_cache with network_info: [{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:52.564816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:52.714037 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:03:52.719424 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:03:52.720009 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:52.722397 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:52.799145 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:52.838154 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca35293e06644323b1379cbcfa028d87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea07081265c14a80b849530dbb4de34a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:03:52.846192 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'flavor' on Instance uuid ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:52.953075 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Releasing lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:52.954561 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance network_info: |[{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:03:52.954561 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Start _get_guest_xml network_info=[{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '87ab802a-e723-4f55-b830-e76175275e2a', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '9d7ee143-ce2c-4b61-952a-87eab2cf22bb', 'attached_at': '', 'detached_at': '', 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'serial': '27cefffc-a717-431f-8c2e-14173adab86d'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:03:52.955854 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:03:52.956955 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-562629376', uuid='9d7ee143-ce2c-4b61-952a-87eab2cf22bb'), owner=OwnerMeta(userid='2776d33c40e0490eb87787c8dafc8066', username='tempest-ServerActionsTestOtherA-1968473744-project-member', projectid='4d2ef1b6a03d428d94b2072c01964b49', projectname='tempest-ServerActionsTestOtherA-1968473744'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937432.9566271) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:03:52.958512 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:03:52.958743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:03:52.959459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:03:52.959632 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:03:52.960456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:03:52.960929 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:03:52.961167 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:03:52.961397 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:03:52.961532 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:03:52.961631 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:03:52.961770 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:03:52.961948 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:03:52.962078 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:03:52.962216 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:03:52.962362 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:03:52.962521 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:03:52.976206 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:52.976649 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:52.978306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:53.166917 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:53.224044 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:03:53.352358 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Ignoring supplied device name: /dev/vdb
May 28 03:03:53.381916 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Successfully created port: f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:03:53.390595 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updated VIF entry in instance network info cache for port 3e99d894-6ccc-435b-8aaa-b5a9ccc0393e. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:03:53.391497 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [{"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:53.682522 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00039463600000999577 future=<Future at 0x7e4b40609dc0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:53.683055 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:03:53.730631 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:03:53.733855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.757s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:53.734724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:53.751524 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:53.752976 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:53.753061 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:53.753285 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:53.753998 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:53.753998 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:53.767275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:53.767275 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:53.777570 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:53.777570 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:53.786766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d] added
May 28 03:03:53.786766 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:53.786766 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:53.786766 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:53.786766 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:53.786766 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:53.786766 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:53.787808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:53.787808 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:53.787808 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:53.790019 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d] added
May 28 03:03:53.790019 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:53.790019 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:53.790019 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:53.790019 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:53.790019 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:53.790019 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:53.790490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:53.790490 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0371(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:53.790490 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:53.854912 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:53.894473 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a84f3d17-6e63-4621-944f-62e5997ab209 req-9590dee3-7491-4c95-a1d1-28277286aaeb service nova] Releasing lock "refresh_cache-7edf7fdf-a897-456a-b47a-0e6154035b35" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:53.979876 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Successfully updated port: f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:03:54.235678 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Booting with volume-backed-image f91efa2d-3177-46c9-add1-8d87d786068d at /dev/vda
May 28 03:03:54.393264 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-changed-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:03:54.393264 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Refreshing instance network info cache due to event network-changed-f9adc971-3eb4-406b-a255-ec3252953d28. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:03:54.393264 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] Acquiring lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:54.393264 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] Acquired lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:54.393264 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Refreshing network info cache for port f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:03:54.481892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:03:54.789047 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:54.791741 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:54.822357 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:54.822357 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:54.825819 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:54.825819 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:54.838750 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:54.848019 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:54.861609 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:54.862000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:54.881802 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:54.882411 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:54.895605 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:54.949939 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:54.950327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:54.950327 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Attaching volume 3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 to /dev/vdb
May 28 03:03:54.960560 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260]
May 28 03:03:54.960560 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260] successful.
May 28 03:03:54.960560 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:54.978205 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260]
May 28 03:03:54.978205 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260] successful.
May 28 03:03:54.978205 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:54.988220 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:54.995845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.019253 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.019927 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.266s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:55.019927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:55.021637 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('10', '-', '-', 0) found on session 47 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:55.021807 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.035005 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:55.035849 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:55.035849 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.283s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:55.036413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:55.046781 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:55.048359 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:55.052256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 47 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:55.052671 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:55.055299 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('21', '-', '-', 0) found on session 48 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:55.055299 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:55.069641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:55.085218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 48 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:55.085218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:55.104030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:55.147157 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:55.147521 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:55.159901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:55.163049 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe2a:f30e', 'fe80::e88a:9dff:fe29:20d6', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fed9:99b1', 'fe80::fcc7:c8ff:feee:2faf', 'fe80::fc16:3eff:fead:5e8', 'fe80::fc16:3eff:fed6:5a8', 'fe80::485f:25ff:fef3:b63f', 'fe80::fc16:3eff:fe89:b476', 'fe80::fc16:3eff:fe82:1863', 'fe80::fc16:3eff:fe27:9dfe', 'fe80::fc16:3eff:fe8d:e188', 'fe80::fc16:3eff:fedb:f477', 'fe80::24dc:ebff:fe91:c5bb', 'fe80::fc16:3eff:fede:6d95', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe04:1780', 'fe80::fc16:3eff:fec0:47e6', 'fe80::98b5:c5ff:fe0e:a7a8', 'fe80::fc16:3eff:fedb:a700', 'fe80::fc16:3eff:fec5:afa3', 'fe80::fc16:3eff:febc:e7d4', 'fe80::8008:42ff:fec4:9cf4', 'fe80::fc16:3eff:fe0e:a1bc', 'fe80::fc16:3eff:fee1:d00', 'fe80::fc16:3eff:fe17:bcde', 'fe80::9c1c:d6ff:fec9:3328', 'fe80::f8a7:3dff:fea5:b4c6'] 
May 28 03:03:55.163049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:55.163049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:55.163049 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:55.163049 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Updating existing volume attachment record: e35bcd98-ba0d-4faf-8328-b5a7775f2afb {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:55.269578 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:55.732672 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:03:55.733031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:55.733168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:55.754649 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:03:55.775842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eed2219a-dde9-4f1f-8ff3-04e295ba7367 req-b9c70316-4dca-4a7e-a719-133716822cc0 service nova] Releasing lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:55.776627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:03:55.776627 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:03:55.832885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:56.345586 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:03:56.498336 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:03:56.663388 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Updating instance_info_cache with network_info: [{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:03:56.779718 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Found WWN 33000000077063afb for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:56.781320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:56.782085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== connect_volume: return (3805ms) {'type': 'block', 'scsi_wwn': '33000000077063afb', 'path': '/dev/dm-1', 'multipath_id': '33000000077063afb'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:56.782271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000077063afb', 'path': '/dev/dm-1', 'multipath_id': '33000000077063afb'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:56.783728 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.050s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:56.786078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:03:56.808907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:56.809802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:03:56.810586 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:56.811097 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:03:56.811346 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:56.811587 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:56.828030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:56.828030 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:56.838743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:03:56.838743 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:56.848482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83] added
May 28 03:03:56.848482 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:56.848482 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:56.848482 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:56.848482 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:56.848482 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:56.848482 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:56.848886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:56.848939 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:56.849385 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83] added
May 28 03:03:56.854101 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:03:56.854101 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0428(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:03:56.854101 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:03:57.165656 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:03:57.165844 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance network_info: |[{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:03:57.299852 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-562629376',display_name='tempest-ServerActionsTestOtherA-server-562629376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-562629376',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-vldvpmto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=9d7ee143-ce2c-4b61-952a-87eab2cf22bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:03:57.300133 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:57.301035 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:57.301959 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d7ee143-ce2c-4b61-952a-87eab2cf22bb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:57.568542 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.769293 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:03:57.781951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:03:57.804263 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:03:57.819614 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] End _get_guest_xml xml=<domain type="qemu">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <uuid>9d7ee143-ce2c-4b61-952a-87eab2cf22bb</uuid>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <name>instance-00000014</name>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsTestOtherA-server-562629376</nova:name>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:03:52</nova:creationTime>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:user uuid="2776d33c40e0490eb87787c8dafc8066">tempest-ServerActionsTestOtherA-1968473744-project-member</nova:user>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:project uuid="4d2ef1b6a03d428d94b2072c01964b49">tempest-ServerActionsTestOtherA-1968473744</nova:project>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         <nova:port uuid="655008ea-4b6e-4f49-8d26-86c4c4aff849">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <system>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <entry name="serial">9d7ee143-ce2c-4b61-952a-87eab2cf22bb</entry>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <entry name="uuid">9d7ee143-ce2c-4b61-952a-87eab2cf22bb</entry>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </system>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <os>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   </os>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <features>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   </features>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   <devices>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <alias name="ua-27cefffc-a717-431f-8c2e-14173adab86d"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-1"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <serial>27cefffc-a717-431f-8c2e-14173adab86d</serial>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </disk>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ec:c2:ea"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <target dev="tap655008ea-4b"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </interface>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/console.log" append="off"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </serial>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <video>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </video>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </rng>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:   </devices>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]: </domain>
May 28 03:03:57.819614 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Preparing to wait for external event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-562629376',display_name='tempest-ServerActionsTestOtherA-server-562629376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-562629376',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-vldvpmto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=9d7ee143-ce2c-4b61-952a-87eab2cf22bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:03:57.825999 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:03:57.827630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.827630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:57.827630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:03:57.831449 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.831679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c3b4ce-d3a4-5a49-a808-8e5936261f06', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:57.838792 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.839794 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:57.839794 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.840975 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:03:57.842329 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:03:57.846074 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.846283 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap655008ea-4b, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:57.846644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap655008ea-4b, col_values=(('qos', UUID('023b8240-a28d-4803-96c7-83999f44d9bc')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:57.847104 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap655008ea-4b, col_values=(('external_ids', {'iface-id': '655008ea-4b6e-4f49-8d26-86c4c4aff849', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:c2:ea', 'vm-uuid': '9d7ee143-ce2c-4b61-952a-87eab2cf22bb'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:03:57.847763 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.850182 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:03:57.850182 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:03:57.856083 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:03:57.856083 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:03:57.857690 np0000001589 nova-compute[98297]: INFO os_vif [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b')
May 28 03:03:57.870256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:03:57.871130 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe2a:f30e', 'fe80::e88a:9dff:fe29:20d6', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fed9:99b1', 'fe80::fcc7:c8ff:feee:2faf', 'fe80::fc16:3eff:fead:5e8', 'fe80::fc16:3eff:fed6:5a8', 'fe80::485f:25ff:fef3:b63f', 'fe80::fc16:3eff:fe89:b476', 'fe80::fc16:3eff:fe82:1863', 'fe80::fc16:3eff:fe27:9dfe', 'fe80::fc16:3eff:fe8d:e188', 'fe80::fc16:3eff:fedb:f477', 'fe80::24dc:ebff:fe91:c5bb', 'fe80::fc16:3eff:fede:6d95', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe04:1780', 'fe80::fc16:3eff:fec0:47e6', 'fe80::98b5:c5ff:fe0e:a7a8', 'fe80::fc16:3eff:fedb:a700', 'fe80::fc16:3eff:fec5:afa3', 'fe80::fc16:3eff:febc:e7d4', 'fe80::8008:42ff:fec4:9cf4', 'fe80::fc16:3eff:fe0e:a1bc', 'fe80::fc16:3eff:fee1:d00', 'fe80::fc16:3eff:fe17:bcde', 'fe80::9c1c:d6ff:fec9:3328', 'fe80::f8a7:3dff:fea5:b4c6'] 
May 28 03:03:57.871547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:03:57.871768 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:03:57.872184 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:57.875042 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:57.875042 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Updating existing volume attachment record: 5e60617f-aece-4982-a24f-82d4c616830e {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:03:57.882810 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:03:57.882810 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:57.892568 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:57.900739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.924478 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.925688 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.926630 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:57.927028 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:58.016561 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.50.100,3260]
May 28 03:03:58.016561 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.50.100,3260] successful.
May 28 03:03:58.016561 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:58.033173 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.40.100,3260]
May 28 03:03:58.033173 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.40.100,3260] successful.
May 28 03:03:58.033173 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:58.044681 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:58.052204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.082198 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.082695 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.083259 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:03:58.083650 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.273s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:03:58.083921 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:03:58.084362 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:58.084607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.274s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:58.084809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:03:58.089106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] HCTL ('24', '-', '-', 0) found on session 49 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:58.089304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:58.093676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] HCTL ('25', '-', '-', 0) found on session 50 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:03:58.093885 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Scanning host 25 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:03:58.110960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching for a device in session 49 and hctl ['24', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:58.126784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching for a device in session 50 and hctl ['25', '*', '*', 0] yield: sdt {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:58.127112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to sdt using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:59.111441 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching for a device in session 49 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:03:59.111997 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:03:59.387252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:59.387252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:03:59.387252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No VIF found with MAC fa:16:3e:ec:c2:ea, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:03:59.387252 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Using config drive
May 28 03:03:59.842571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Found WWN 330000000565a3b60 for multipath device dm-14 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:03:59.842902 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.059s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:03:59.843072 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== connect_volume: return (4109ms) {'type': 'block', 'scsi_wwn': '330000000565a3b60', 'path': '/dev/dm-14', 'multipath_id': '330000000565a3b60'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:03:59.843206 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000565a3b60', 'path': '/dev/dm-14', 'multipath_id': '330000000565a3b60'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:03:59.846214 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'flavor' on Instance uuid ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:03:59.896027 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:00.009721 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:04:00.011859 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:04:00.012279 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Creating image(s)
May 28 03:04:00.012826 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:04:00.013092 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Ensure instance console log exists: /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:04:00.013436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:00.013672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:00.013840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:00.014489 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Start _get_guest_xml network_info=[{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '5e60617f-aece-4982-a24f-82d4c616830e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de', 'attached_at': '', 'detached_at': '', 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'serial': '1089d603-1ad4-4db6-91ad-4e53dafbc836'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:04:00.016789 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:04:00.018537 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-141786083', uuid='34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de'), owner=OwnerMeta(userid='ca35293e06644323b1379cbcfa028d87', username='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member', projectid='ea07081265c14a80b849530dbb4de34a', projectname='tempest-ServerBootFromVolumeStableRescueTest-1646172629'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937440.0180376) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:04:00.019961 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:04:00.020459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:04:00.021459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:04:00.021747 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:04:00.023039 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:04:00.023489 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:04:00.023701 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:04:00.023846 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:04:00.024013 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:04:00.024143 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:04:00.024432 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:04:00.024688 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:04:00.024987 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:04:00.025205 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:04:00.025456 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:04:00.025598 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:04:00.043164 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Creating config drive at /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config
May 28 03:04:00.050456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:04:00.050993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:00.051186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:00.052407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:00.053029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:04:00.057778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxu8mm0rx {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:00.074846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:00.076192 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:00.077213 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:00.077717 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:04:00.078477 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:00.078799 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:04:00.093812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:04:00.093812 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:00.101042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:04:00.101042 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:00.112369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836] added
May 28 03:04:00.112369 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:04:00.112369 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:00.112369 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:00.112369 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:00.112369 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:00.112369 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:00.113024 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:04:00.113024 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:04:00.113024 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:04:00.113997 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836] added
May 28 03:04:00.113997 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:04:00.113997 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:00.113997 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:00.113997 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:00.113997 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:00.113997 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:00.114213 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:04:00.114786 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:04:00.116093 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:04:00.126593 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxu8mm0rx" returned: 0 in 0.069s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:00.351132 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Attempting to attach volume 3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:04:00.353288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:04:00.353288 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:04:00.353288 np0000001589 nova-compute[98297]:   <alias name="ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83"/>
May 28 03:04:00.353288 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-14"/>
May 28 03:04:00.353288 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:04:00.353288 np0000001589 nova-compute[98297]:   <serial>3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83</serial>
May 28 03:04:00.353288 np0000001589 nova-compute[98297]: </disk>
May 28 03:04:00.353288 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:04:00.675783 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:00.715500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:00.717409 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:00.791293 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:00.881089 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:00.884243 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:00.911081 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1d29dd21-d7f3-4226-8a42-3c85a94d224d req-ee06d954-1b53-48c0-b7fe-0fcf3a826459 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:00.911362 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d29dd21-d7f3-4226-8a42-3c85a94d224d req-ee06d954-1b53-48c0-b7fe-0fcf3a826459 service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:00.911520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d29dd21-d7f3-4226-8a42-3c85a94d224d req-ee06d954-1b53-48c0-b7fe-0fcf3a826459 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:00.912089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d29dd21-d7f3-4226-8a42-3c85a94d224d req-ee06d954-1b53-48c0-b7fe-0fcf3a826459 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:00.912212 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1d29dd21-d7f3-4226-8a42-3c85a94d224d req-ee06d954-1b53-48c0-b7fe-0fcf3a826459 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Processing event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:04:01.113434 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:04:01.116478 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:01.134324 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:01.134324 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:01.137444 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:01.137444 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.153359 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.158641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.183653 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.184202 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.193888 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.194492 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:01.257617 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.50.100,3260]
May 28 03:04:01.257617 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.50.100,3260] successful.
May 28 03:04:01.257617 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.276056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.290929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.40.100,3260]
May 28 03:04:01.290929 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.40.100,3260] successful.
May 28 03:04:01.290929 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.305888 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.306709 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:01.306709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:01.308339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('26', '-', '-', 0) found on session 51 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:01.308482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 26 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:01.312864 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:01.326304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 51 and hctl ['26', '*', '*', 0] yield: sdu {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:01.326494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdu using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.340336 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [46] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:01.340920 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.264s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:01.340920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:01.344041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('27', '-', '-', 0) found on session 52 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:01.344167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 27 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:01.364114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 52 and hctl ['27', '*', '*', 0] yield: sdv {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:01.364329 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdv using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:01.721606 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937441.7210665, 9d7ee143-ce2c-4b61-952a-87eab2cf22bb => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:01.722254 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:04:01.722766 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] VM Started (Lifecycle Event)
May 28 03:04:01.726806 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:04:01.729053 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance spawned successfully.
May 28 03:04:01.730211 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:04:02.077741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:04:02.105106 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:02.105293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:02.105293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:02.105430 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No VIF found with MAC fa:16:3e:2a:f3:0e, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:04:02.227088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:02.229589 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:02.241008 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:02.241149 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:02.241470 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:02.241757 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:02.242653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:02.243144 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:02.571473 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:02.736033 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:04:02.736264 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937442.7360797, 9d7ee143-ce2c-4b61-952a-87eab2cf22bb => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:02.736364 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] VM Paused (Lifecycle Event)
May 28 03:04:02.755922 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Took 10.42 seconds to spawn the instance on the hypervisor.
May 28 03:04:02.756907 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:02.849268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:02.983481 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af1ca3a3-0c54-4e32-8ff2-6586a3ba7f34 req-a227fcb7-be5a-4b56-af8d-1aedd5ebcd9b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:02.984625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af1ca3a3-0c54-4e32-8ff2-6586a3ba7f34 req-a227fcb7-be5a-4b56-af8d-1aedd5ebcd9b service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:02.984625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af1ca3a3-0c54-4e32-8ff2-6586a3ba7f34 req-a227fcb7-be5a-4b56-af8d-1aedd5ebcd9b service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:02.984625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af1ca3a3-0c54-4e32-8ff2-6586a3ba7f34 req-a227fcb7-be5a-4b56-af8d-1aedd5ebcd9b service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:02.984625 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af1ca3a3-0c54-4e32-8ff2-6586a3ba7f34 req-a227fcb7-be5a-4b56-af8d-1aedd5ebcd9b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] No waiting events found dispatching network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:02.984625 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-af1ca3a3-0c54-4e32-8ff2-6586a3ba7f34 req-a227fcb7-be5a-4b56-af8d-1aedd5ebcd9b service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received unexpected event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 for instance with vm_state active and task_state None.
May 28 03:04:03.101277 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Found WWN 330000000757dffe1 for multipath device dm-17 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:04:03.101559 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.049s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:03.101823 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '330000000757dffe1', 'path': '/dev/dm-17', 'multipath_id': '330000000757dffe1'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:03.101983 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000757dffe1', 'path': '/dev/dm-17', 'multipath_id': '330000000757dffe1'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:04:03.241828 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:03.244756 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937443.2443898, 9d7ee143-ce2c-4b61-952a-87eab2cf22bb => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:03.244923 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] VM Resumed (Lifecycle Event)
May 28 03:04:03.268039 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Took 18.02 seconds to build instance.
May 28 03:04:03.607934 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141786083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-141786083',id=21,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-cldsqhan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:54Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:04:03.607934 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:03.608479 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:03.609437 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'pci_devices' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:03.664807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e334c203-1ca1-435f-9bf1-71d391b29d1d tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.715s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:03.749929 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:03.754806 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:03.769828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2cec2b47-606a-4bcf-870c-d14ebc0aebac tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.531s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:04.001417 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-changed-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:04.001417 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Refreshing instance network info cache due to event network-changed-daff420e-0782-4f0a-8b29-86782a4461e0. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:04.001511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] Acquiring lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:04.001627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] Acquired lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:04.002015 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Refreshing network info cache for port daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:04.113400 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] End _get_guest_xml xml=<domain type="qemu">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <uuid>34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de</uuid>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <name>instance-00000015</name>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-141786083</nova:name>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:04:00</nova:creationTime>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:user uuid="ca35293e06644323b1379cbcfa028d87">tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member</nova:user>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:project uuid="ea07081265c14a80b849530dbb4de34a">tempest-ServerBootFromVolumeStableRescueTest-1646172629</nova:project>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         <nova:port uuid="f9adc971-3eb4-406b-a255-ec3252953d28">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <system>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <entry name="serial">34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de</entry>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <entry name="uuid">34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de</entry>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </system>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <os>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   </os>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <features>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   </features>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   <devices>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <alias name="ua-1089d603-1ad4-4db6-91ad-4e53dafbc836"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-17"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <serial>1089d603-1ad4-4db6-91ad-4e53dafbc836</serial>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:15:28:bd"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <target dev="tapf9adc971-3e"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </interface>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/console.log" append="off"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </serial>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <video>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </video>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </rng>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:   </devices>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]: </domain>
May 28 03:04:04.113400 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:04:04.113400 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Preparing to wait for external event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:03:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141786083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-141786083',id=21,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-cldsqhan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:03:54Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:04.117751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:04:04.118902 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:04.119144 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '447453dc-6540-5376-8275-483206c2a13c', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:04.128996 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:04.129307 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:04.129532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:04.132508 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:04.132761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9adc971-3e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:04.133189 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9adc971-3e, col_values=(('qos', UUID('7bce64e3-58d2-4feb-a8e8-ece8ea2fd114')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:04.133464 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9adc971-3e, col_values=(('external_ids', {'iface-id': 'f9adc971-3eb4-406b-a255-ec3252953d28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:28:bd', 'vm-uuid': '34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:04.134667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:04.136242 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:04.141907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:04.142608 np0000001589 nova-compute[98297]: INFO os_vif [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e')
May 28 03:04:04.505487 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:04.941530 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:05.092526 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Updated VIF entry in instance network info cache for port daff420e-0782-4f0a-8b29-86782a4461e0. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:05.092802 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Updating instance_info_cache with network_info: [{"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:05.594791 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-98835ff3-6145-454e-9593-be74a61eae83 req-71e74e63-bc48-47c9-b797-b30b1d557b3f service nova] Releasing lock "refresh_cache-c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:05.665182 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:05.665465 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:05.665745 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No VIF found with MAC fa:16:3e:15:28:bd, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:04:05.666116 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Using config drive
May 28 03:04:06.089835 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-changed-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:06.089968 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Refreshing instance network info cache due to event network-changed-655008ea-4b6e-4f49-8d26-86c4c4aff849. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:06.090121 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] Acquiring lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:06.090246 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] Acquired lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:06.090332 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Refreshing network info cache for port 655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:06.174462 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:06.303588 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Creating config drive at /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config
May 28 03:04:06.306702 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxscsdjgy {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:06.370016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxscsdjgy" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:06.403724 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Stashing vm_state: active {{(pid=98297) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 03:04:06.593532 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:06.862995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:06.901254 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:06.906588 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:06.963494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:06.963645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:07.011042 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:07.029344 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:07.109349 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:07.111662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:07.246963 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updated VIF entry in instance network info cache for port 655008ea-4b6e-4f49-8d26-86c4c4aff849. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:07.247516 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating instance_info_cache with network_info: [{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:07.473668 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:04:07.473826 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Claim successful on node np0000001589
May 28 03:04:07.575330 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:07.750758 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85cd9a81-36cb-49e2-86aa-7b22a1853dfd req-8b15625e-39f5-47f9-bcde-af0608a6167a service nova] Releasing lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:07.788300 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937447.7878826, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:07.789323 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Started (Lifecycle Event)
May 28 03:04:07.982798 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating resource usage from migration 7e2fb5d5-0ac5-4439-bd80-a11cf3aad18b
May 28 03:04:08.183245 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:08.184315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:08.184315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:08.184315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:08.184411 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Processing event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:04:08.184594 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:08.184718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:08.185319 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:08.185521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:08.185708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:08.186377 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7b8ee427-d263-426f-bf64-b4d3da866953 req-e43f7643-3b56-4977-949b-e2907337df01 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state building and task_state spawning.
May 28 03:04:08.187396 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:04:08.191211 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:04:08.194969 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance spawned successfully.
May 28 03:04:08.195455 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:04:08.291876 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:08.293368 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:08.650714 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:08.650714 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:08.704532 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:08.704746 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:08.705039 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:08.705294 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:08.705576 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:08.705817 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:08.795713 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:04:08.796020 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937448.7958126, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:08.796187 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Paused (Lifecycle Event)
May 28 03:04:09.144294 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:09.153526 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:09.210298 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Took 9.20 seconds to spawn the instance on the hypervisor.
May 28 03:04:09.210492 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:09.298755 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:09.301008 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937449.2998254, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:09.301008 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Resumed (Lifecycle Event)
May 28 03:04:09.663142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.699s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:09.663373 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Migrating
May 28 03:04:09.663687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:09.663827 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:09.728422 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Took 20.32 seconds to build instance.
May 28 03:04:09.802447 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:09.803727 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:10.166011 np0000001589 nova-compute[98297]: INFO nova.compute.rpcapi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 28 03:04:10.166459 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:10.166651 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:04:10.231435 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-63cf807f-c32f-467c-9147-4f58837bbd0a tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.833s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:10.689055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:10.689055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquired lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:10.689248 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:11.001689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:11.002357 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:11.095782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:11.193602 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:11.217698 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Rescuing
May 28 03:04:11.217879 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:11.218216 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:11.218360 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:11.505039 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Detaching volume 3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83
May 28 03:04:11.562288 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Attempting to driver detach volume 3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 from mountpoint /dev/vdb
May 28 03:04:11.567118 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Found disk vdb by alias ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:04:11.568645 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Found disk vdb by alias ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:04:11.570307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Attempting to detach device vdb from instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:04:11.570943 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:04:11.570943 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:04:11.570943 np0000001589 nova-compute[98297]:   <alias name="ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83"/>
May 28 03:04:11.570943 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-14"/>
May 28 03:04:11.570943 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:04:11.570943 np0000001589 nova-compute[98297]:   <serial>3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83</serial>
May 28 03:04:11.570943 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:04:11.570943 np0000001589 nova-compute[98297]: </disk>
May 28 03:04:11.570943 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:04:11.579141 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully detached device vdb from instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe from the persistent domain config.
May 28 03:04:11.579453 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] (1/8): Attempting to detach device vdb with device alias ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 from instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:04:11.579943 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:04:11.579943 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:04:11.579943 np0000001589 nova-compute[98297]:   <alias name="ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83"/>
May 28 03:04:11.579943 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-14"/>
May 28 03:04:11.579943 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:04:11.579943 np0000001589 nova-compute[98297]:   <serial>3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83</serial>
May 28 03:04:11.579943 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:04:11.579943 np0000001589 nova-compute[98297]: </disk>
May 28 03:04:11.579943 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:04:11.598935 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:11.722779 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:11.765252 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating instance_info_cache with network_info: [{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:12.070888 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:12.154695 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937452.1543584, ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe => ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:04:12.156617 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 for instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:04:12.164448 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully detached device vdb from instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe from the live domain config.
May 28 03:04:12.166472 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:12.166970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:12.167202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:12.167732 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:12.168092 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:12.168302 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [49] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:12.226662 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:12.228480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:12.228480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', '50')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:12.229861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', '49')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:12.234012 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:12.234012 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:12.239836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b405b54e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'): ({'sdt'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'): ({'sds'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:12.240145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Removing multipathed devices sdt, sds {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:12.240675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Flush multipath device 330000000565a3b60 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:12.264463 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Updating instance_info_cache with network_info: [{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:12.267742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Releasing lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:12.295816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Remove SCSI device /dev/sdt with /sys/block/sdt/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:12.340736 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:12.386777 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Checking to see if SCSI volumes sdt, sds have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:12.386939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] SCSI volumes sdt, sds have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:12.388892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Checking to see if device paths {'sdt', 'sds'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:12.400514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Device paths {'sdt', 'sds'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:12.400675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:12.418333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:12.462280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.40.100,3260]
May 28 03:04:12.462280 np0000001589 nova-compute[98297]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.40.100,3260] successful.
May 28 03:04:12.462280 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:12.494924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:12.506454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:12.549407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.50.100,3260]
May 28 03:04:12.549407 np0000001589 nova-compute[98297]: Logout of [sid: 49, target: iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, portal: 192.168.50.100,3260] successful.
May 28 03:04:12.549407 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:12.578278 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:12.584981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:12.585159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:12.585290 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== disconnect_volume: return (418ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:12.585400 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:12.739117 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:04:12.771031 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:13.132452 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'flavor' on Instance uuid ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:13.303821 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:13.303821 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:13.306411 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:04:13.308240 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Claim successful on node np0000001589
May 28 03:04:13.788278 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Starting migrate_disk_and_power_off {{(pid=98297) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 03:04:13.815853 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:13.820365 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:13.853953 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.009901 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.015444 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.023495 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c4bf87ef-03a9-4eb8-88e6-aeec50eda534 req-3c50f37c-e361-4d96-b46f-c4d0c31ede37 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:14.023862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c4bf87ef-03a9-4eb8-88e6-aeec50eda534 req-3c50f37c-e361-4d96-b46f-c4d0c31ede37 service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:14.024066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c4bf87ef-03a9-4eb8-88e6-aeec50eda534 req-3c50f37c-e361-4d96-b46f-c4d0c31ede37 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:14.024238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c4bf87ef-03a9-4eb8-88e6-aeec50eda534 req-3c50f37c-e361-4d96-b46f-c4d0c31ede37 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:14.024413 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c4bf87ef-03a9-4eb8-88e6-aeec50eda534 req-3c50f37c-e361-4d96-b46f-c4d0c31ede37 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] No waiting events found dispatching network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:14.024540 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c4bf87ef-03a9-4eb8-88e6-aeec50eda534 req-3c50f37c-e361-4d96-b46f-c4d0c31ede37 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received unexpected event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 for instance with vm_state active and task_state resize_migrating.
May 28 03:04:14.126377 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998466881000013 future=<Future at 0x7e4b405a3a10 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:14.128161 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99814926299996 future=<Future at 0x7e4b405a3a10 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:14.128161 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99803438999993 future=<Future at 0x7e4b405a3a10 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:14.129540 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance destroyed successfully.
May 28 03:04:14.130810 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-562629376',display_name='tempest-ServerActionsTestOtherA-server-562629376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-562629376',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:02Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-vldvpmto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=9d7ee143-ce2c-4b61-952a-87eab2cf22bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:14.131756 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:14.134254 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:14.134254 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:14.136969 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.137167 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap655008ea-4b, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:14.138187 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-80962665-ee46-453f-b917-c45e9d0fbb4a tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.136s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:14.140303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.043s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:14.140303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:14.140303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:14.140303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:14.146458 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.146458 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Terminating instance
May 28 03:04:14.149367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:14.150812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.150812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=023b8240-a28d-4803-96c7-83999f44d9bc) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:14.151409 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.152559 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:14.155061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.160045 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b')
May 28 03:04:14.161985 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:14.164243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:14.164243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:14.164243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:14.164243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:14.164243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:14.202205 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:14.202634 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:14.202634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:14.202987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '47')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:14.204710 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '48')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:14.205794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40586340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'): ({'sdp'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:14.206002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Removing multipathed devices sde, sdp {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:14.206285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flush multipath device 33000000077063afb {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:14.253974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:14.299726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:14.355804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if SCSI volumes sde, sdp have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:14.356135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] SCSI volumes sde, sdp have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:14.359203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if device paths {'sde', 'sdp'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:14.375935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Device paths {'sde', 'sdp'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:14.376132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:14.391662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:14.421580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.423696 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.449651 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.451894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260]
May 28 03:04:14.451894 np0000001589 nova-compute[98297]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260] successful.
May 28 03:04:14.451894 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:14.482610 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:14.499609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:14.539436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260]
May 28 03:04:14.539436 np0000001589 nova-compute[98297]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260] successful.
May 28 03:04:14.539436 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:14.563797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:14.563938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:14.563985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== disconnect_volume: return (401ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:14.564060 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:14.571762 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:04:14.572462 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb_resize/disk.config /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:14.611172 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7714ec74-c4a7-408c-a859-c1c0947b26b1 req-c2e75e8c-8091-4282-9b7e-82a7f59a098e service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:14.611791 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7714ec74-c4a7-408c-a859-c1c0947b26b1 req-c2e75e8c-8091-4282-9b7e-82a7f59a098e service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:14.612074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7714ec74-c4a7-408c-a859-c1c0947b26b1 req-c2e75e8c-8091-4282-9b7e-82a7f59a098e service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:14.612215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7714ec74-c4a7-408c-a859-c1c0947b26b1 req-c2e75e8c-8091-4282-9b7e-82a7f59a098e service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:14.612448 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7714ec74-c4a7-408c-a859-c1c0947b26b1 req-c2e75e8c-8091-4282-9b7e-82a7f59a098e service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:14.612521 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7714ec74-c4a7-408c-a859-c1c0947b26b1 req-c2e75e8c-8091-4282-9b7e-82a7f59a098e service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state active and task_state rescuing.
May 28 03:04:14.625071 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.631879 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.632134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "cp -r /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb_resize/disk.config /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config" returned: 0 in 0.060s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:14.660635 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:04:14.699063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.707792 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.736125 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.746912 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.766138 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999734217999958 future=<Future at 0x7e4b40651ee0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:14.768132 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance destroyed successfully.
May 28 03:04:14.768584 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'numa_topology' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:14.775338 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.794625 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:14.992715 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999646674999894 future=<Future at 0x7e4b64650110 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:14.997077 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Instance destroyed successfully.
May 28 03:04:14.999571 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'resources' on Instance uuid ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:15.130842 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:15.131204 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:15.273737 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Attempting a stable device rescue
May 28 03:04:15.354623 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98297) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 03:04:15.358069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:04:15.358592 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Creating image(s)
May 28 03:04:15.358662 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:15.358813 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:15.359282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:15.359434 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:15.503986 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-622675806',display_name='tempest-VolumesSnapshotTestJSON-instance-622675806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumessnapshottestjson-instance-622675806',id=16,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErIwtzqefvEOm/YN8ek3ZSyZ2dXfp2SL+0IYTZ4S4i6ZmNPY5Ax9/JL1ilLg7mWxyB7B7bhQcumSMdau9TK9MfS9yTfbiuk2RgO5AjtQPktXUZtvZrhtdLYBMUgvUFm6g==',key_name='tempest-keypair-241551643',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:13Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e00f74b8638345979e76606cba0149ce',ramdisk_id='',reservation_id='r-5q5zjm2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1234909468',owner_user_name='tempest-VolumesSnapshotTestJSON-1234909468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a98ac8a8a84d1496b8b48952956e32',uuid=ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:15.504209 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converting VIF {"id": "534ae006-09c5-4883-b913-8365ce689378", "address": "fa:16:3e:2a:f3:0e", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap534ae006-09", "ovs_interfaceid": "534ae006-09c5-4883-b913-8365ce689378", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:15.504892 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f3:0e,bridge_name='br-int',has_traffic_filtering=True,id=534ae006-09c5-4883-b913-8365ce689378,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534ae006-09') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:15.505160 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f3:0e,bridge_name='br-int',has_traffic_filtering=True,id=534ae006-09c5-4883-b913-8365ce689378,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534ae006-09') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:15.506733 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:15.506955 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap534ae006-09, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:15.508064 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:15.508732 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:15.514113 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:15.517367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:15.517549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=384d000e-357a-4d7b-addd-4c2f042b514c) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:15.517964 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:15.518465 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:15.524417 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:15.526712 np0000001589 nova-compute[98297]: INFO os_vif [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:f3:0e,bridge_name='br-int',has_traffic_filtering=True,id=534ae006-09c5-4883-b913-8365ce689378,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534ae006-09')
May 28 03:04:15.527657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:15.528000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:15.528141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:15.528606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:15.528877 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:15.529017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:15.559960 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:15.560665 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:15.560665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:04:15.561481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:15.561481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3a9cb5b3-de99-40d5-8f19-1dc44f6a6e83') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:04:15.561481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b645bb100>, {}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:15.561481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Disconnecting from: [] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:15.561481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:15.561736 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== disconnect_volume: return (33ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:15.561736 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:15.561967 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Deleting instance files /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe_del
May 28 03:04:15.562823 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Deletion of /opt/stack/data/nova/instances/ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe_del complete
May 28 03:04:15.634734 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:15.806501 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:15.806783 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:15.862006 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:15.862006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "1988bc5af11b02d08f5f3da3167add4df5d697d2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:15.862006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "1988bc5af11b02d08f5f3da3167add4df5d697d2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:15.876737 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Port 655008ea-4b6e-4f49-8d26-86c4c4aff849 binding to destination host np0000001589 is already ACTIVE {{(pid=98297) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 03:04:16.072102 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 03:04:16.072714 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:04:16.072861 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:04:16.072930 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:04:16.073159 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:16.143462 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.840s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:16.143829 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:04:16.152247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:16.159007 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fe33c21f-9374-4205-b679-a6f0dc138415 req-78e8887e-60d3-41b9-9141-fe1415d185ac service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:16.159179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fe33c21f-9374-4205-b679-a6f0dc138415 req-78e8887e-60d3-41b9-9141-fe1415d185ac service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:16.159359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fe33c21f-9374-4205-b679-a6f0dc138415 req-78e8887e-60d3-41b9-9141-fe1415d185ac service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:16.160036 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fe33c21f-9374-4205-b679-a6f0dc138415 req-78e8887e-60d3-41b9-9141-fe1415d185ac service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:16.160737 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fe33c21f-9374-4205-b679-a6f0dc138415 req-78e8887e-60d3-41b9-9141-fe1415d185ac service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] No waiting events found dispatching network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:16.161029 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-fe33c21f-9374-4205-b679-a6f0dc138415 req-78e8887e-60d3-41b9-9141-fe1415d185ac service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received unexpected event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 for instance with vm_state active and task_state resize_migrating.
May 28 03:04:16.366927 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:16.369512 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:16.369812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:16.480084 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.part --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:16.480740 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] f92fdff5-579b-4c18-a53a-5ad383df7509 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:04:16.481480 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:04:16.481817 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.part /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:16.558295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.part /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.converted" returned: 0 in 0.076s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:16.567704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:16.658722 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:04:16.659076 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:04:16.659569 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:16.659835 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:16.663507 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2.converted --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:16.664353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "1988bc5af11b02d08f5f3da3167add4df5d697d2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.802s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:16.664990 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:16.667834 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:16.669187 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "1988bc5af11b02d08f5f3da3167add4df5d697d2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:16.669579 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "1988bc5af11b02d08f5f3da3167add4df5d697d2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:16.669852 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:16.672137 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:16.672618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:16.697378 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:16.697986 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:16.698446 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:16.699110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:16.699110 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:16.699110 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state active and task_state rescuing.
May 28 03:04:16.699275 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-vif-unplugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:16.699888 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:16.700245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:16.700315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] No waiting events found dispatching network-vif-unplugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-vif-unplugged-534ae006-09c5-4883-b913-8365ce689378 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-vif-unplugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Acquiring lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] No waiting events found dispatching network-vif-unplugged-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-vif-unplugged-534ae006-09c5-4883-b913-8365ce689378 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:16.701764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Received event network-vif-deleted-534ae006-09c5-4883-b913-8365ce689378 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:16.702012 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Neutron deleted interface 534ae006-09c5-4883-b913-8365ce689378; detaching it from the instance and deleting it from the info cache
May 28 03:04:16.704672 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bbaf9641-4618-4241-8c10-3f85e054ca66 req-07627db6-f8c5-4c04-bc70-eed2086d4356 service nova] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Detach interface failed, port_id=534ae006-09c5-4883-b913-8365ce689378, reason: Instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:16.755830 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b9f2bdea5b14acaa744ac48348a2eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a0972fc130247a8b4956e1141cf7aaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:04:16.758073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2 --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:16.758556 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2,backing_fmt=raw /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.rescue {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:16.809880 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1988bc5af11b02d08f5f3da3167add4df5d697d2,backing_fmt=raw /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.rescue" returned: 0 in 0.051s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:16.810365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "1988bc5af11b02d08f5f3da3167add4df5d697d2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:16.810704 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'migration_context' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:16.906689 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:04:16.921392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:16.927501 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.006s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:16.927692 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:17.055779 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:17.164900 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:04:17.258266 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Successfully created port: ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:04:17.313881 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:17.314175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:04:17.314815 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Start _get_guest_xml network_info=[{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:15:28:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f92fdff5-579b-4c18-a53a-5ad383df7509', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '5e60617f-aece-4982-a24f-82d4c616830e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, 'status': 'reserved', 'instance': '34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de', 'attached_at': '', 'detached_at': '', 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'serial': '1089d603-1ad4-4db6-91ad-4e53dafbc836'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:04:17.314950 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'resources' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:17.559053 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Took 1.49 seconds to deallocate network for instance.
May 28 03:04:17.573439 np0000001589 nova-compute[98297]: WARNING nova.volume.cinder [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Attachment e35bcd98-ba0d-4faf-8328-b5a7775f2afb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e35bcd98-ba0d-4faf-8328-b5a7775f2afb. (HTTP 404) (Request-ID: req-e39c3f0d-098a-4c31-aeed-f42f340ea8e5)
May 28 03:04:17.573700 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Took 0.01 seconds to detach 1 volumes for instance.
May 28 03:04:17.587205 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:17.680894 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Successfully updated port: ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:04:17.816617 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:17.818703 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:04:17.819817 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-141786083', uuid='34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de'), owner=OwnerMeta(userid='ca35293e06644323b1379cbcfa028d87', username='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member', projectid='ea07081265c14a80b849530dbb4de34a', projectname='tempest-ServerBootFromVolumeStableRescueTest-1646172629'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:15:28:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937457.819519) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:04:17.820659 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:04:17.821008 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:04:17.821654 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:04:17.821802 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:04:17.822811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:04:17.823124 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:04:17.823299 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:04:17.823415 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:04:17.823531 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:04:17.823611 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:04:17.823738 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:04:17.823881 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:04:17.824001 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:04:17.824141 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:04:17.824264 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:04:17.824430 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:04:17.824594 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:17.932422 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:18.023123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:18.023238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquired lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:18.023480 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:18.079393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:18.079619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:18.176470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:04:18.186145 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:18.189416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquired lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:18.189606 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:18.326827 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:18.344430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:18.453945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config --force-share --output=json" returned: 0 in 0.109s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:18.454412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:18.454601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:18.455111 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:18.455524 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:04:18.455875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:18.456005 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:18.456462 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:18.456683 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:04:18.469272 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:18.469920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:18.470374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:18.470636 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:04:18.471021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:18.471251 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:18.486831 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:18.486831 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:18.495343 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:18.495343 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:18.508492 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:18.509341 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:18.526085 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.531049 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.531726 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:18.532248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.062s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:18.532352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:18.533575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('26', '0', '0', 0) found on session 51 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:18.533958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 26 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.542927 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:18.543455 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:18.543455 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.072s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:18.543965 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:18.544681 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] HCTL ('27', '0', '0', 0) found on session 52 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:18.544681 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Scanning host 27 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:18.556979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 51 and hctl ('26', '0', '0', 0) yield: sdu {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:18.557194 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdu using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:18.558070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Searching for a device in session 52 and hctl ('27', '0', '0', 0) yield: sdv {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:18.558239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Connected to sdv using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:18.688208 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Booting with volume 704e10fe-5a86-44ac-9b08-b34bfbe27d10 at /dev/vdb
May 28 03:04:18.733895 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:18.741557 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-changed-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:18.741868 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Refreshing instance network info cache due to event network-changed-ae2981b3-9f2c-4589-a68c-242af62e9df4. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:18.742001 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] Acquiring lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:18.745320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:04:18.766537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:18.794450 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:04:18.801494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:04:18.805125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:04:18.817243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:04:18.817243 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fed9:99b1', 'fe80::fcc7:c8ff:feee:2faf', 'fe80::fc16:3eff:fead:5e8', 'fe80::fc16:3eff:fed6:5a8', 'fe80::485f:25ff:fef3:b63f', 'fe80::fc16:3eff:fe89:b476', 'fe80::fc16:3eff:fe82:1863', 'fe80::fc16:3eff:fe27:9dfe', 'fe80::fc16:3eff:fe8d:e188', 'fe80::fc16:3eff:fedb:f477', 'fe80::24dc:ebff:fe91:c5bb', 'fe80::fc16:3eff:fede:6d95', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe04:1780', 'fe80::fc16:3eff:fec0:47e6', 'fe80::98b5:c5ff:fe0e:a7a8', 'fe80::fc16:3eff:fedb:a700', 'fe80::fc16:3eff:fec5:afa3', 'fe80::fc16:3eff:febc:e7d4', 'fe80::8008:42ff:fec4:9cf4', 'fe80::fc16:3eff:fe0e:a1bc', 'fe80::fc16:3eff:fee1:d00', 'fe80::fc16:3eff:fe17:bcde', 'fe80::9c1c:d6ff:fec9:3328', 'fe80::f8a7:3dff:fea5:b4c6'] 
May 28 03:04:18.817243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:04:18.817243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:04:18.817243 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:18.817243 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Updating existing volume attachment record: d5b23b14-ffc9-4195-b965-1dd50555e851 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:04:18.888455 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:18.888659 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:18.940994 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:19.041508 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:19.076352 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating instance_info_cache with network_info: [{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:19.192072 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Updating instance_info_cache with network_info: [{"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:19.392637 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:19.471203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:04:19.578794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Releasing lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:19.693856 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Releasing lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:19.694340 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Instance network_info: |[{"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:04:19.694506 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] Acquired lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:19.694539 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Refreshing network info cache for port ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:19.899312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.820s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:19.953788 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Deleted allocations for instance ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe
May 28 03:04:20.089250 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:20.103440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:04:20.126027 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:20.159249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:04:20.160347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:04:20.167136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:04:20.170700 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fed9:99b1', 'fe80::fcc7:c8ff:feee:2faf', 'fe80::fc16:3eff:fead:5e8', 'fe80::fc16:3eff:fed6:5a8', 'fe80::485f:25ff:fef3:b63f', 'fe80::fc16:3eff:fe89:b476', 'fe80::fc16:3eff:fe82:1863', 'fe80::fc16:3eff:fe27:9dfe', 'fe80::fc16:3eff:fe8d:e188', 'fe80::fc16:3eff:fedb:f477', 'fe80::24dc:ebff:fe91:c5bb', 'fe80::fc16:3eff:fede:6d95', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe04:1780', 'fe80::fc16:3eff:fec0:47e6', 'fe80::98b5:c5ff:fe0e:a7a8', 'fe80::fc16:3eff:fedb:a700', 'fe80::fc16:3eff:fec5:afa3', 'fe80::fc16:3eff:febc:e7d4', 'fe80::8008:42ff:fec4:9cf4', 'fe80::fc16:3eff:fe0e:a1bc', 'fe80::fc16:3eff:fee1:d00', 'fe80::fc16:3eff:fe17:bcde', 'fe80::9c1c:d6ff:fec9:3328', 'fe80::f8a7:3dff:fea5:b4c6'] 
May 28 03:04:20.170888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:04:20.171019 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:04:20.171313 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:20.197069 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:20.497723 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Found WWN 330000000757dffe1 for multipath device dm-17 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:04:20.498132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.042s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:20.498334 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== connect_volume: return (2042ms) {'type': 'block', 'scsi_wwn': '330000000757dffe1', 'path': '/dev/dm-17', 'multipath_id': '330000000757dffe1'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:20.498474 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000757dffe1', 'path': '/dev/dm-17', 'multipath_id': '330000000757dffe1'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:04:20.514159 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:20.520745 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:20.668797 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Updated VIF entry in instance network info cache for port ae2981b3-9f2c-4589-a68c-242af62e9df4. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:20.669201 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Updating instance_info_cache with network_info: [{"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:20.930220 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:04:20.932091 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:04:20.932684 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Creating image(s)
May 28 03:04:20.933624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:20.933866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "/opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:20.934343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "/opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:20.934833 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:20.938934 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:20.941434 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:20.967997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d1c884ae-5164-4e0a-abd7-31aa1e7128af tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.829s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:21.018014 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141786083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-141786083',id=21,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:09Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-cldsqhan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:09Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:15:28:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:04:21.018416 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "vif_mac": "fa:16:3e:15:28:bd"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:21.020257 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:21.021033 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'pci_devices' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:21.048880 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:21.049406 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:21.049905 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:21.051439 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:21.055532 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:21.056282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:21.146059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:21.146612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:21.173249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-441d4a95-116c-4898-8846-331cfd6106cf req-5fa2e3f7-9113-4986-8360-381fa186e5b8 service nova] Releasing lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:21.180905 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:21.181189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:21.181414 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Shelving
May 28 03:04:21.195121 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk 1073741824" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:21.195512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.146s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:21.195871 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:21.279064 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:21.279811 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:04:21.280090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:21.342676 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Starting finish_migration {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 03:04:21.344148 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:04:21.344298 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Creating image(s)
May 28 03:04:21.344590 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:04:21.344751 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Ensure instance console log exists: /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:04:21.345106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:21.345342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:21.345469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:21.346116 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Start _get_guest_xml network_info=[{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '556ddf25-92c8-4108-a4c9-92c9bf89bf57', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '9d7ee143-ce2c-4b61-952a-87eab2cf22bb', 'attached_at': '2026-05-28T03:04:20.000000', 'detached_at': '', 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'serial': '27cefffc-a717-431f-8c2e-14173adab86d'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:04:21.348778 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:04:21.350643 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-562629376', uuid='9d7ee143-ce2c-4b61-952a-87eab2cf22bb'), owner=OwnerMeta(userid='2776d33c40e0490eb87787c8dafc8066', username='tempest-ServerActionsTestOtherA-1968473744-project-member', projectid='4d2ef1b6a03d428d94b2072c01964b49', projectname='tempest-ServerActionsTestOtherA-1968473744'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937461.350094) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:04:21.351756 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:04:21.352199 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:04:21.353278 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:04:21.353531 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:04:21.354783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:04:21.355183 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:04:21.355454 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:04:21.355575 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:04:21.355736 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:04:21.355853 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:04:21.355974 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:04:21.356193 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:04:21.356371 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:04:21.356522 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:04:21.356663 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:04:21.356812 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:04:21.368769 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:21.369850 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Cannot resize image /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:04:21.370290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:04:21.370564 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Ensure instance console log exists: /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:04:21.371523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:21.371739 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:21.371925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:21.375157 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Start _get_guest_xml network_info=[{"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'd5b23b14-ffc9-4195-b965-1dd50555e851', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f0381f84-64fa-4a31-862b-b4feb19c1713', 'attached_at': '', 'detached_at': '', 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'serial': '704e10fe-5a86-44ac-9b08-b34bfbe27d10'}, 'delete_on_termination': False, 'boot_index': -1, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:04:21.377213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:21.394097 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:04:21.396705 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-instance-764140910', uuid='f0381f84-64fa-4a31-862b-b4feb19c1713'), owner=OwnerMeta(userid='3b9f2bdea5b14acaa744ac48348a2eac', username='tempest-VolumesBackupsTest-2039328368-project-member', projectid='6a0972fc130247a8b4956e1141cf7aaa', projectname='tempest-VolumesBackupsTest-2039328368'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937461.3958542) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:04:21.397901 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:04:21.398362 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:04:21.399033 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:04:21.399217 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:04:21.400473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:04:21.400945 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:04:21.401100 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:04:21.401207 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:04:21.401392 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:04:21.401491 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:04:21.401573 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:04:21.401721 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:04:21.401833 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:04:21.401910 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:04:21.402008 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:04:21.402121 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:04:21.411732 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:04:21.412105 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:21.412292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:21.412856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:21.413023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:04:21.423912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:21.424436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:21.424927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:21.425260 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:21.425537 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:04:21.425747 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:04:21.439001 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:04:21.439001 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:21.451393 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:04:21.451393 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:21.455096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10] added
May 28 03:04:21.455096 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:04:21.455096 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:21.455096 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:21.455096 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:21.455096 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:21.455096 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:21.455417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:04:21.456341 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:04:21.456341 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:04:21.460839 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10] added
May 28 03:04:21.460839 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:04:21.460839 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:21.460839 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:21.460839 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:21.460839 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:21.460839 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:21.461127 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:04:21.461859 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:04:21.462160 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:21.462339 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:04:21.462606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:21.462775 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:21.463299 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "/opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:21.463539 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:04:21.463848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:21.463992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:21.523694 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:21.525574 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] End _get_guest_xml xml=<domain type="qemu">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <uuid>34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de</uuid>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <name>instance-00000015</name>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-141786083</nova:name>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:04:17</nova:creationTime>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:user uuid="ca35293e06644323b1379cbcfa028d87">tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member</nova:user>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:project uuid="ea07081265c14a80b849530dbb4de34a">tempest-ServerBootFromVolumeStableRescueTest-1646172629</nova:project>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         <nova:port uuid="f9adc971-3eb4-406b-a255-ec3252953d28">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <system>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <entry name="serial">34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de</entry>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <entry name="uuid">34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de</entry>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </system>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <os>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   </os>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <features>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   </features>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   <devices>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <alias name="ua-1089d603-1ad4-4db6-91ad-4e53dafbc836"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-17"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <serial>1089d603-1ad4-4db6-91ad-4e53dafbc836</serial>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.rescue"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <boot order="1"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:15:28:bd"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <target dev="tapf9adc971-3e"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </interface>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/console.log" append="off"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </serial>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <video>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </video>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </rng>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:   </devices>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]: </domain>
May 28 03:04:21.525574 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:04:21.531170 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance destroyed successfully.
May 28 03:04:22.245382 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:22.245382 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:22.252059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:22.255429 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:22.291658 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:22.292376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:22.387081 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c6f34ca-9d90-402c-833d-7e13d239b526 req-210befa2-33a2-4bd5-a6fa-42fa598c7a73 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-vif-unplugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:22.387536 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c6f34ca-9d90-402c-833d-7e13d239b526 req-210befa2-33a2-4bd5-a6fa-42fa598c7a73 service nova] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:22.387706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c6f34ca-9d90-402c-833d-7e13d239b526 req-210befa2-33a2-4bd5-a6fa-42fa598c7a73 service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:22.388009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c6f34ca-9d90-402c-833d-7e13d239b526 req-210befa2-33a2-4bd5-a6fa-42fa598c7a73 service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:22.388009 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c6f34ca-9d90-402c-833d-7e13d239b526 req-210befa2-33a2-4bd5-a6fa-42fa598c7a73 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] No waiting events found dispatching network-vif-unplugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:22.388108 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-3c6f34ca-9d90-402c-833d-7e13d239b526 req-210befa2-33a2-4bd5-a6fa-42fa598c7a73 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received unexpected event network-vif-unplugged-f680b933-10c8-4f0f-86e7-65aa46fd953d for instance with vm_state active and task_state shelving.
May 28 03:04:22.457062 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:04:22.462743 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:22.474493 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:22.474493 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:22.488350 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:22.488350 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.501997 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.509137 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.522794 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999690307000037 future=<Future at 0x7e4b40635760 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:22.524378 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance destroyed successfully.
May 28 03:04:22.524827 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.528523 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.529011 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.534316 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.534742 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:22.590588 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:22.599507 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.50.100,3260]
May 28 03:04:22.599507 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.50.100,3260] successful.
May 28 03:04:22.599507 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.606650 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.40.100,3260]
May 28 03:04:22.606650 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.40.100,3260] successful.
May 28 03:04:22.606650 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.613034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.620055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.637929 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.638336 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:22.638669 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.213s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:22.638748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:22.641182 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] HCTL ('7', '-', '-', 0) found on session 53 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:22.641421 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.647506 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:22.647848 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:22.648203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:22.648203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:22.649602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] HCTL ('10', '-', '-', 0) found on session 54 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:22.649726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:22.660600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Searching for a device in session 53 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:22.660757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:22.666483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Searching for a device in session 54 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:22.668381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:23.045905 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:23.048241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:23.048241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:23.048241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] No VIF found with MAC fa:16:3e:15:28:bd, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:04:23.048241 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Using config drive
May 28 03:04:23.082248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:23.082248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:23.082248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:23.082248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:23.082248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:23.084630 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Terminating instance
May 28 03:04:23.112885 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Beginning cold snapshot process
May 28 03:04:23.426106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:04:23.549472 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'ec2_ids' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:23.591898 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:04:23.629346 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.632473 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.657214 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.689435 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.707568 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.713059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.715274 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.826009 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.827279 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.833203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.868427 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d089933e-7926-4a92-9d59-d050c1b914a4 req-56251c96-1572-44bb-bcb1-8316e2ea7cbb service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:23.873129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d089933e-7926-4a92-9d59-d050c1b914a4 req-56251c96-1572-44bb-bcb1-8316e2ea7cbb service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:23.873129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d089933e-7926-4a92-9d59-d050c1b914a4 req-56251c96-1572-44bb-bcb1-8316e2ea7cbb service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:23.873129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d089933e-7926-4a92-9d59-d050c1b914a4 req-56251c96-1572-44bb-bcb1-8316e2ea7cbb service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:23.873129 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d089933e-7926-4a92-9d59-d050c1b914a4 req-56251c96-1572-44bb-bcb1-8316e2ea7cbb service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:23.873129 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d089933e-7926-4a92-9d59-d050c1b914a4 req-56251c96-1572-44bb-bcb1-8316e2ea7cbb service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:23.917477 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.941734 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.946947 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.993751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:23.995385 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.031735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.053208 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:24.053444 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'keypairs' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:24.079781 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.100865 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.123195 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.183411 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.273238 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999531281999907 future=<Future at 0x7e4b40520290 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:24.274413 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Instance destroyed successfully.
May 28 03:04:24.274836 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lazy-loading 'resources' on Instance uuid 60a15beb-a3bc-4d0f-8437-21699f6c76ca {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:24.336404 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-00d93f39-1fcd-4f4b-abbd-8779cde19992 req-f064bb66-06bb-435d-aca2-74db0e47f1f0 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:24.336638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-00d93f39-1fcd-4f4b-abbd-8779cde19992 req-f064bb66-06bb-435d-aca2-74db0e47f1f0 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:24.336846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-00d93f39-1fcd-4f4b-abbd-8779cde19992 req-f064bb66-06bb-435d-aca2-74db0e47f1f0 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:24.337027 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-00d93f39-1fcd-4f4b-abbd-8779cde19992 req-f064bb66-06bb-435d-aca2-74db0e47f1f0 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:24.337200 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-00d93f39-1fcd-4f4b-abbd-8779cde19992 req-f064bb66-06bb-435d-aca2-74db0e47f1f0 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:24.337381 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-00d93f39-1fcd-4f4b-abbd-8779cde19992 req-f064bb66-06bb-435d-aca2-74db0e47f1f0 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:24.443842 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Found WWN 330000000e155b7f2 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:04:24.444358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:24.445781 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000e155b7f2', 'path': '/dev/dm-1', 'multipath_id': '330000000e155b7f2'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:24.445949 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e155b7f2', 'path': '/dev/dm-1', 'multipath_id': '330000000e155b7f2'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:04:24.447591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.984s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:24.447872 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:04:24.464685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:24.464685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:24.465353 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:24.465605 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:04:24.466191 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:24.466414 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:04:24.483467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:04:24.483467 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:24.495003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:04:24.495003 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:24.511698 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d] added
May 28 03:04:24.511698 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:04:24.511698 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:24.511698 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:24.511698 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:24.511698 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:24.511698 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:24.511897 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:04:24.512897 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0465(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:04:24.513619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d] added
May 28 03:04:24.513619 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:04:24.513619 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:24.513619 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:24.513619 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:04:24.513619 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:04:24.513619 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:24.513794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:04:24.514020 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:04:24.514425 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0476(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:04:24.514701 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:04:24.524589 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-vif-unplugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:24.525188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:24.525387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:24.525523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:24.525659 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] No waiting events found dispatching network-vif-unplugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:24.525792 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received unexpected event network-vif-unplugged-f680b933-10c8-4f0f-86e7-65aa46fd953d for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 03:04:24.525908 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:24.526047 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:24.526242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:24.526336 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:24.526456 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:24.526575 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:24.526692 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:24.526816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:24.526948 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:24.527064 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:24.527181 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:24.527336 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:24.527451 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:24.527578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:24.527704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:24.527819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:24.528222 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:24.528425 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-f05a7921-2b12-438f-ba0c-e3246b54d45c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:24.528634 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:24.528830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:24.529183 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:24.529469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:24.529667 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-f05a7921-2b12-438f-ba0c-e3246b54d45c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:24.529853 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82eba4ef-628d-4379-97e9-b916138c6240 req-c5e096ff-d21e-4abf-811b-79d2682d98ea service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-f05a7921-2b12-438f-ba0c-e3246b54d45c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:24.560247 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:24.560247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:24.633638 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:04:24.633918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk /opt/stack/data/nova/instances/snapshots/tmpb76_myaj/abfe1257c4744b9691a083313c5e0d0f {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:24.713788 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Creating config drive at /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config.rescue
May 28 03:04:24.716161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw514_met {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:24.765713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw514_met" returned: 0 in 0.049s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:24.777544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:24.777752 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "address": "fa:16:3e:d9:99:b1", "network": {"id": "675db9f7-8c47-41aa-beeb-4a16cd42cb3a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1516817444-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3216c453-3e", "ovs_interfaceid": "3216c453-3e7f-455e-8c3b-d1d783b1c2a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:24.778543 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:99:b1,bridge_name='br-int',has_traffic_filtering=True,id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1,network=Network(675db9f7-8c47-41aa-beeb-4a16cd42cb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3216c453-3e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:24.778793 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:99:b1,bridge_name='br-int',has_traffic_filtering=True,id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1,network=Network(675db9f7-8c47-41aa-beeb-4a16cd42cb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3216c453-3e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:24.780342 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.780706 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3216c453-3e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:24.782703 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.783902 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:24.827989 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.829596 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.829825 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a23a71e7-e95c-4748-95e2-f2307b9bbea4) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:24.830402 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.833650 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:24.867701 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.869532 np0000001589 nova-compute[98297]: INFO os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:99:b1,bridge_name='br-int',has_traffic_filtering=True,id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1,network=Network(675db9f7-8c47-41aa-beeb-4a16cd42cb3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3216c453-3e')
May 28 03:04:24.870563 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:24.870769 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "address": "fa:16:3e:ad:05:e8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee0e82c-fd", "ovs_interfaceid": "2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:24.871343 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:05:e8,bridge_name='br-int',has_traffic_filtering=True,id=2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee0e82c-fd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:24.871560 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:05:e8,bridge_name='br-int',has_traffic_filtering=True,id=2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee0e82c-fd') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:24.872429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk /opt/stack/data/nova/instances/snapshots/tmpb76_myaj/abfe1257c4744b9691a083313c5e0d0f" returned: 0 in 0.238s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:24.872795 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Snapshot extracted, beginning image upload
May 28 03:04:24.875592 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.875592 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ee0e82c-fd, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:24.878177 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.879284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:24.907756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.908587 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.908767 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec1c6d6a-c7e5-4abc-b91c-ff20c8d1550e) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:24.909130 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.909718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:24.938254 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.941775 np0000001589 nova-compute[98297]: INFO os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:05:e8,bridge_name='br-int',has_traffic_filtering=True,id=2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2ee0e82c-fd')
May 28 03:04:24.942445 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:24.942599 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "address": "fa:16:3e:d6:05:a8", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf05a7921-2b", "ovs_interfaceid": "f05a7921-2b12-438f-ba0c-e3246b54d45c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:24.943062 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=f05a7921-2b12-438f-ba0c-e3246b54d45c,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf05a7921-2b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:24.943280 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=f05a7921-2b12-438f-ba0c-e3246b54d45c,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf05a7921-2b') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:24.944223 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.944535 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf05a7921-2b, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:24.945618 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.946545 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:24.954850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-764140910',display_name='tempest-instance-764140910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-instance-764140910',id=22,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZyZErdaGW+a839XxQQXS3yxhGzxILmfQd7Z3yDuwRPwVUQXkBL0qpI//uzHZ7RvhHGb6Av9qDBPtQiqnv3IUmmNxL1gIXbY4pZATte20nTm2C3RuTOl5dg/QhCRY96w==',key_name='tempest-keypair-1722015577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a0972fc130247a8b4956e1141cf7aaa',ramdisk_id='',reservation_id='r-9dipbudx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2039328368',owner_user_name='tempest-VolumesBackupsTest-2039328368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b9f2bdea5b14acaa744ac48348a2eac',uuid=f0381f84-64fa-4a31-862b-b4feb19c1713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:04:24.955072 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Converting VIF {"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:24.955571 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:66:5d,bridge_name='br-int',has_traffic_filtering=True,id=ae2981b3-9f2c-4589-a68c-242af62e9df4,network=Network(5087992a-6f74-48dd-acbc-6c94037d1443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2981b3-9f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:24.956207 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lazy-loading 'pci_devices' on Instance uuid f0381f84-64fa-4a31-862b-b4feb19c1713 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:24.971984 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.972848 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.972981 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f95d68a2-c0cb-4a63-918e-d1bfa9573662) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:24.973427 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:24.973809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:24.999588 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.001778 np0000001589 nova-compute[98297]: INFO os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:05:a8,bridge_name='br-int',has_traffic_filtering=True,id=f05a7921-2b12-438f-ba0c-e3246b54d45c,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf05a7921-2b')
May 28 03:04:25.002448 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:25.002606 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "5560f8fa-1f24-462f-b908-5aa738c9240b", "address": "fa:16:3e:89:b4:76", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5560f8fa-1f", "ovs_interfaceid": "5560f8fa-1f24-462f-b908-5aa738c9240b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:25.003076 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:b4:76,bridge_name='br-int',has_traffic_filtering=True,id=5560f8fa-1f24-462f-b908-5aa738c9240b,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5560f8fa-1f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:25.003289 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b4:76,bridge_name='br-int',has_traffic_filtering=True,id=5560f8fa-1f24-462f-b908-5aa738c9240b,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5560f8fa-1f') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:25.004101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.004289 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5560f8fa-1f, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.005132 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.005844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.025670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.026523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.026656 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b47fa71d-74a9-447f-9012-7c5d68f1fef2) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.027078 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.027485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.046606 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.048415 np0000001589 nova-compute[98297]: INFO os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:b4:76,bridge_name='br-int',has_traffic_filtering=True,id=5560f8fa-1f24-462f-b908-5aa738c9240b,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5560f8fa-1f')
May 28 03:04:25.049147 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:25.049362 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "8f4823d8-e26e-4c35-8521-88219b693c40", "address": "fa:16:3e:27:9d:fe", "network": {"id": "ea314bf3-2133-4493-bb31-474724c1d043", "bridge": "br-int", "label": "tempest-device-tagging-net1-1083069863", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.164", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f4823d8-e2", "ovs_interfaceid": "8f4823d8-e26e-4c35-8521-88219b693c40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:25.049852 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:fe,bridge_name='br-int',has_traffic_filtering=True,id=8f4823d8-e26e-4c35-8521-88219b693c40,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4823d8-e2') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:25.050066 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:fe,bridge_name='br-int',has_traffic_filtering=True,id=8f4823d8-e26e-4c35-8521-88219b693c40,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4823d8-e2') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:25.050963 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.051121 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f4823d8-e2, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.052068 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.053129 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.067202 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.067906 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.068043 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2680110a-cac4-4f3e-8776-800fe0142661) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.068531 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.068920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.086958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.088535 np0000001589 nova-compute[98297]: INFO os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9d:fe,bridge_name='br-int',has_traffic_filtering=True,id=8f4823d8-e26e-4c35-8521-88219b693c40,network=Network(ea314bf3-2133-4493-bb31-474724c1d043),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f4823d8-e2')
May 28 03:04:25.089251 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:25.089472 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "address": "fa:16:3e:8d:e1:88", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b109c91-d1", "ovs_interfaceid": "2b109c91-d16a-4f52-8cc6-f1327fcd5621", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:25.089937 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=2b109c91-d16a-4f52-8cc6-f1327fcd5621,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b109c91-d1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:25.090139 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=2b109c91-d16a-4f52-8cc6-f1327fcd5621,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b109c91-d1') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:25.090937 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.091134 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b109c91-d1, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.092242 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.093149 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.127980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.128952 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.129101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=84d94f4c-9da3-41c0-b823-bac22fd898f5) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.129561 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.129978 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.144389 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.147546 np0000001589 nova-compute[98297]: INFO os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e1:88,bridge_name='br-int',has_traffic_filtering=True,id=2b109c91-d16a-4f52-8cc6-f1327fcd5621,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b109c91-d1')
May 28 03:04:25.148390 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1912742111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-1912742111',id=15,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBARZ3bt7wVC9Y9Y8jnOg5Itz1BZq2lw7V4fAh/9Lldh+hkVp7abCsq8kLgwpEzdibERHm9OLYdnYpMBMKwMNVsr78encXH56VqVBFw70ylklFMREimdS+kFCcGGvRdxG6Q==',key_name='tempest-keypair-243369337',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='715ade0a672744fd95d77abe2cf06e6c',ramdisk_id='',reservation_id='r-h93b7omj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1074514621',owner_user_name='tempest-TaggedBootDevicesTest_v242-1074514621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdecdb6bfb004d4ab1ac71e4d7441b17',uuid=60a15beb-a3bc-4d0f-8437-21699f6c76ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:25.148613 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converting VIF {"id": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "address": "fa:16:3e:db:f4:77", "network": {"id": "5bdf5a74-8fb5-4f61-9c62-083bbfafd54a", "bridge": "br-int", "label": "tempest-device-tagging-net2-777146670", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "715ade0a672744fd95d77abe2cf06e6c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap83bdc31d-1f", "ovs_interfaceid": "83bdc31d-1f6f-4435-a9b1-0e17677f9340", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:25.149236 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=83bdc31d-1f6f-4435-a9b1-0e17677f9340,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83bdc31d-1f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:25.149505 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=83bdc31d-1f6f-4435-a9b1-0e17677f9340,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83bdc31d-1f') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:25.150497 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.150663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83bdc31d-1f, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.151578 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.152431 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.163215 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.163972 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.164096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c6baf44-f60c-4f08-9a81-a0f3208f53e8) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.164552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.164995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.173126 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.174654 np0000001589 nova-compute[98297]: INFO os_vif [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:f4:77,bridge_name='br-int',has_traffic_filtering=True,id=83bdc31d-1f6f-4435-a9b1-0e17677f9340,network=Network(5bdf5a74-8fb5-4f61-9c62-083bbfafd54a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83bdc31d-1f')
May 28 03:04:25.177244 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:25.177573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:25.177701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:25.189271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.223287 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.228456 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.318445 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.358852 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.368256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.458867 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] End _get_guest_xml xml=<domain type="qemu">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <uuid>f0381f84-64fa-4a31-862b-b4feb19c1713</uuid>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <name>instance-00000016</name>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:name>tempest-instance-764140910</nova:name>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:04:21</nova:creationTime>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:user uuid="3b9f2bdea5b14acaa744ac48348a2eac">tempest-VolumesBackupsTest-2039328368-project-member</nova:user>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:project uuid="6a0972fc130247a8b4956e1141cf7aaa">tempest-VolumesBackupsTest-2039328368</nova:project>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         <nova:port uuid="ae2981b3-9f2c-4589-a68c-242af62e9df4">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <system>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <entry name="serial">f0381f84-64fa-4a31-862b-b4feb19c1713</entry>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <entry name="uuid">f0381f84-64fa-4a31-862b-b4feb19c1713</entry>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </system>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <os>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   </os>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <features>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   </features>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   <devices>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk.config"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <alias name="ua-704e10fe-5a86-44ac-9b08-b34bfbe27d10"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-1"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <serial>704e10fe-5a86-44ac-9b08-b34bfbe27d10</serial>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:5f:66:5d"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <target dev="tapae2981b3-9f"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </interface>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/console.log" append="off"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </serial>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <video>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </video>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </rng>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:   </devices>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]: </domain>
May 28 03:04:25.458867 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Preparing to wait for external event network-vif-plugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-764140910',display_name='tempest-instance-764140910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-instance-764140910',id=22,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZyZErdaGW+a839XxQQXS3yxhGzxILmfQd7Z3yDuwRPwVUQXkBL0qpI//uzHZ7RvhHGb6Av9qDBPtQiqnv3IUmmNxL1gIXbY4pZATte20nTm2C3RuTOl5dg/QhCRY96w==',key_name='tempest-keypair-1722015577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a0972fc130247a8b4956e1141cf7aaa',ramdisk_id='',reservation_id='r-9dipbudx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2039328368',owner_user_name='tempest-VolumesBackupsTest-2039328368-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b9f2bdea5b14acaa744ac48348a2eac',uuid=f0381f84-64fa-4a31-862b-b4feb19c1713,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Converting VIF {"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:66:5d,bridge_name='br-int',has_traffic_filtering=True,id=ae2981b3-9f2c-4589-a68c-242af62e9df4,network=Network(5087992a-6f74-48dd-acbc-6c94037d1443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2981b3-9f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:66:5d,bridge_name='br-int',has_traffic_filtering=True,id=ae2981b3-9f2c-4589-a68c-242af62e9df4,network=Network(5087992a-6f74-48dd-acbc-6c94037d1443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2981b3-9f') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.463548 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:04:25.464061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.464197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12f0cb2c-fc86-591f-8756-328e99ccacf6', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.466983 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.466983 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.471500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.475107 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.475335 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae2981b3-9f, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.475853 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae2981b3-9f, col_values=(('qos', UUID('917fc71c-4eee-4e17-a563-5211dd9be0ba')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.476048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae2981b3-9f, col_values=(('external_ids', {'iface-id': 'ae2981b3-9f2c-4589-a68c-242af62e9df4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:66:5d', 'vm-uuid': 'f0381f84-64fa-4a31-862b-b4feb19c1713'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:25.476903 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.480054 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:25.492050 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:25.493641 np0000001589 nova-compute[98297]: INFO os_vif [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:66:5d,bridge_name='br-int',has_traffic_filtering=True,id=ae2981b3-9f2c-4589-a68c-242af62e9df4,network=Network(5087992a-6f74-48dd-acbc-6c94037d1443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2981b3-9f')
May 28 03:04:25.514724 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:04:25.515285 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:25.531900 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:25.531900 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:04:25.540050 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:04:25.540050 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.552947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.560355 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.575330 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.575765 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.590346 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:25.665625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260]
May 28 03:04:25.665625 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260] successful.
May 28 03:04:25.665625 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.675065 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260]
May 28 03:04:25.675065 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260] successful.
May 28 03:04:25.675065 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.683656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.692043 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.710672 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.244s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:25.710672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:25.713583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('21', '-', '-', 0) found on session 55 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:25.713583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:25.720598 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:25.722015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.256s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:25.722015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:04:25.723433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] HCTL ('24', '-', '-', 0) found on session 56 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:04:25.723433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:04:25.764613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 55 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:25.764613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:25.764613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Searching for a device in session 56 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:04:25.764613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:04:25.979796 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:25.979796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.980091 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.984170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.984170 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:25.984170 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2ee0e82c-fd02-4e5e-bfd5-9aa2b264b8ee for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:25.984543 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:25.984543 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-5560f8fa-1f24-462f-b908-5aa738c9240b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-5560f8fa-1f24-462f-b908-5aa738c9240b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-8f4823d8-e26e-4c35-8521-88219b693c40 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.992402 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:25.992402 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-8f4823d8-e26e-4c35-8521-88219b693c40 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:25.992402 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:25.992402 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.992402 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.992402 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.992402 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:25.994415 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:25.994592 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:25.994783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:25.994955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:25.995084 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:25.995221 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:25.995431 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e43efad-4873-450a-af91-fdcdc501b22a req-3e9a605f-459b-4070-9af2-dd542659dbc9 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-2b109c91-d16a-4f52-8cc6-f1327fcd5621 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:26.138044 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:26.138424 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:04:26.158321 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de due to new event <LifecycleEvent: 1779937466.1558764, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:04:26.158321 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937466.1558764, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:26.158321 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Resumed (Lifecycle Event)
May 28 03:04:26.162185 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-53c53be0-4d83-4eca-8661-49eddc2e70f5 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:26.403476 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:26.403908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Acquiring lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:26.404375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:26.404485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:26.404596 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] No waiting events found dispatching network-vif-unplugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:26.404696 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-unplugged-83bdc31d-1f6f-4435-a9b1-0e17677f9340 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:26.404787 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:26.404892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:26.404991 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:26.405109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:26.405216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:26.405348 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state rescued and task_state None.
May 28 03:04:26.405444 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:26.405534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:26.405632 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:26.405718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:26.406075 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:26.406180 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-af9773db-ade8-49d1-9918-af1b25e0750a req-fd1b556e-8b1b-4169-aaf3-d279063442e0 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state rescued and task_state None.
May 28 03:04:26.467470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:04:26.662273 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:26.663667 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:27.019284 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:27.019645 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:27.020454 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:27.021523 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] No VIF found with MAC fa:16:3e:5f:66:5d, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:04:27.022024 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Using config drive
May 28 03:04:27.167013 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937467.166697, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:27.167425 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Started (Lifecycle Event)
May 28 03:04:27.265960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:27.266207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:27.266497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:27.266740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:27.266894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:27.271123 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Terminating instance
May 28 03:04:27.488824 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Found WWN 33000000077063afb for multipath device dm-14 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:04:27.489174 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:27.489394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== connect_volume: return (6025ms) {'type': 'block', 'scsi_wwn': '33000000077063afb', 'path': '/dev/dm-14', 'multipath_id': '33000000077063afb'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:27.489558 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000077063afb', 'path': '/dev/dm-14', 'multipath_id': '33000000077063afb'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:04:27.490383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.312s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:27.490690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:27.490813 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:27.532465 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.536917 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.539549 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:27.540659 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:27.541090 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '31')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:27.542551 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682', '32')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:27.543670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64469f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:27.543853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Removing multipathed devices sdf, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:27.544051 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Flush multipath device 3300000003b14180d {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:27.595499 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:27.602912 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Snapshot image upload complete
May 28 03:04:27.603195 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:27.609469 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:27.659452 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:27.671920 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:27.676632 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:27.691858 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Creating config drive at /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk.config
May 28 03:04:27.696695 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa565zqbj {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:27.708927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Checking to see if SCSI volumes sdf, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:27.709201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] SCSI volumes sdf, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:27.711655 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Checking to see if device paths {'sdf', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:27.723142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Device paths {'sdf', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:27.723573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:27.736602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:27.747016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa565zqbj" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:27.778963 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:04:27.789679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.40.100,3260]
May 28 03:04:27.789679 np0000001589 nova-compute[98297]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.40.100,3260] successful.
May 28 03:04:27.789679 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:27.816343 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:27.821830 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:27.823521 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:27.831950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:27.847547 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:27.852742 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Unrescuing
May 28 03:04:27.852742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:27.852742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquired lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:27.852742 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:27.852742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:27.881048 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.50.100,3260]
May 28 03:04:27.881048 np0000001589 nova-compute[98297]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-15a10103-9b4b-4b90-bf8a-2bfdcf0e3682, portal: 192.168.50.100,3260] successful.
May 28 03:04:27.881048 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:27.885710 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:27.909765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:27.909765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:27.910538 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== disconnect_volume: return (2731ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:27.911255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:27.913697 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:27.913697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:27.913697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:27.913697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:27.913697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c05d3409-3e4a-42de-ab33-7823c0faba4a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:27.913697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.951916 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [33] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [34] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:27.955241 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '33'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '33')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a', '34')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:27.955241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40544540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'): ({'sdg'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:27.955980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Removing multipathed devices sdc, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:27.956270 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Flush multipath device 33000000004c80b68 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:27.990135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:28.000275 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-562629376',display_name='tempest-ServerActionsTestOtherA-server-562629376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-562629376',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:02Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-vldvpmto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=9d7ee143-ce2c-4b61-952a-87eab2cf22bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:04:28.000275 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:28.000275 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:28.001525 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] End _get_guest_xml xml=<domain type="qemu">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <uuid>9d7ee143-ce2c-4b61-952a-87eab2cf22bb</uuid>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <name>instance-00000014</name>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <memory>262144</memory>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsTestOtherA-server-562629376</nova:name>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:04:21</nova:creationTime>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.micro" id="84">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:memory>256</nova:memory>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:user uuid="2776d33c40e0490eb87787c8dafc8066">tempest-ServerActionsTestOtherA-1968473744-project-member</nova:user>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:project uuid="4d2ef1b6a03d428d94b2072c01964b49">tempest-ServerActionsTestOtherA-1968473744</nova:project>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         <nova:port uuid="655008ea-4b6e-4f49-8d26-86c4c4aff849">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <system>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <entry name="serial">9d7ee143-ce2c-4b61-952a-87eab2cf22bb</entry>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <entry name="uuid">9d7ee143-ce2c-4b61-952a-87eab2cf22bb</entry>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </system>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <os>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   </os>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <features>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   </features>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   <devices>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/disk.config"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <alias name="ua-27cefffc-a717-431f-8c2e-14173adab86d"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-14"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <serial>27cefffc-a717-431f-8c2e-14173adab86d</serial>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ec:c2:ea"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <target dev="tap655008ea-4b"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </interface>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb/console.log" append="off"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </serial>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <video>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </video>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </rng>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:   </devices>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]: </domain>
May 28 03:04:28.001525 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:04:28.005631 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-562629376',display_name='tempest-ServerActionsTestOtherA-server-562629376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-562629376',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:02Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-vldvpmto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=9d7ee143-ce2c-4b61-952a-87eab2cf22bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:04:28.005631 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-876105163-network", "vif_mac": "fa:16:3e:ec:c2:ea"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:28.005631 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:28.005631 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:04:28.006590 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.007215 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:28.007563 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:04:28.009756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.010104 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1c3b4ce-d3a4-5a49-a808-8e5936261f06', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:28.011957 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.014356 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:28.027885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.030820 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.031046 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap655008ea-4b, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:28.031474 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap655008ea-4b, col_values=(('qos', UUID('769dfadc-43af-4fb6-99d3-96b8380a4219')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:28.031691 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap655008ea-4b, col_values=(('external_ids', {'iface-id': '655008ea-4b6e-4f49-8d26-86c4c4aff849', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:c2:ea', 'vm-uuid': '9d7ee143-ce2c-4b61-952a-87eab2cf22bb'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:28.032640 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.034589 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:28.037924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:28.058352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.059816 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b')
May 28 03:04:28.092939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Checking to see if SCSI volumes sdc, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:28.092939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] SCSI volumes sdc, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:28.093619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Checking to see if device paths {'sdc', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:28.107918 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Device paths {'sdc', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:28.107918 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:28.122490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.131208 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Shelve offloading
May 28 03:04:28.138300 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:28.138707 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:28.138858 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:04:28.139153 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:04:28.175374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.40.100,3260]
May 28 03:04:28.175374 np0000001589 nova-compute[98297]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.40.100,3260] successful.
May 28 03:04:28.175374 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.178802 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 03:04:28.204213 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.219057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.268313 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.50.100,3260]
May 28 03:04:28.268313 np0000001589 nova-compute[98297]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-c05d3409-3e4a-42de-ab33-7823c0faba4a, portal: 192.168.50.100,3260] successful.
May 28 03:04:28.268313 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.302561 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.302707 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:28.304504 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== disconnect_volume: return (390ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:28.304504 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:28.308102 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:28.308102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:28.308102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:28.308102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:28.308102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'db58a6fd-90c3-4be8-8727-e5e79872375f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:28.308102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:28.326495 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999659930000007 future=<Future at 0x7e4b40517d70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:28.329189 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Instance destroyed successfully.
May 28 03:04:28.329795 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'resources' on Instance uuid e5117e69-981a-42a7-9fdb-c5fb550fe5b9 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [38] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:28.346842 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:28.346842 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '37')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:28.348369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f', '38')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:28.350154 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40579080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'): ({'sdm'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:28.350319 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Removing multipathed devices sdm, sdl {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:28.354394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Flush multipath device 3300000001afcd344 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:28.354394 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.361250 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:28.386358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:28.406483 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.442687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:28.486416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.497951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:28.498387 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:28.499689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:28.513095 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:28.513534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:28.533923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.587857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.40.100,3260]
May 28 03:04:28.587857 np0000001589 nova-compute[98297]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.40.100,3260] successful.
May 28 03:04:28.587857 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.619433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.632693 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.645317 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance destroyed successfully.
May 28 03:04:28.645658 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:28.647151 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:28.647467 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquired lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:28.647622 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:28.693613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.50.100,3260]
May 28 03:04:28.693613 np0000001589 nova-compute[98297]: Logout of [sid: 38, target: iqn.2023-03.storpool.com:os--volume-db58a6fd-90c3-4be8-8727-e5e79872375f, portal: 192.168.50.100,3260] successful.
May 28 03:04:28.693613 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.731399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:28.731399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.423s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:28.731399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] <== disconnect_volume: return (423ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:28.731399 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:28.731399 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Deleting instance files /opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca_del
May 28 03:04:28.731399 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Deletion of /opt/stack/data/nova/instances/60a15beb-a3bc-4d0f-8437-21699f6c76ca_del complete
May 28 03:04:28.768250 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:28.771397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:28.772495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:28.772495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:28.772495 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:28.772495 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:28.772495 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:28.772495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] Acquiring lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:28.774345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:28.774495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:28.774688 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] No waiting events found dispatching network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:28.774835 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b410e3f-e7ea-42d8-9ca5-39ac24f42818 req-f86ffa8a-809d-4706-bf45-8ca2568af59d service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-unplugged-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:28.789421 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.806637 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.814321 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.823239 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:28.837558 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2011301087',display_name='tempest-AttachVolumeTestJSON-server-2011301087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-2011301087',id=11,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0ku9bdzPIFY/43yv5k39cAYcKF/jlZZ4Zp9DQPFyNnh3PX6eUCXXIbT1venYEgjBYBjyNclFeZjXK++0PLeCFaLNRWVDwNYdfxepTasTUCL9ZoDLGiNTwEHG83J981g==',key_name='tempest-keypair-1839900360',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:01:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-b0irrobq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=e5117e69-981a-42a7-9fdb-c5fb550fe5b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:28.837558 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "address": "fa:16:3e:e1:0d:00", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa451f1e5-e9", "ovs_interfaceid": "a451f1e5-e9e1-4ab0-a842-5a7e598465b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:28.837558 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:28.839070 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:28.840699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.840699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa451f1e5-e9, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:28.841844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.843673 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:28.860458 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-378694b4-88d2-4a2e-9a4a-a116cd70989e req-67730e2f-8a8b-4e3f-8fa7-41e7e90a4101 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-vif-plugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:28.860718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-378694b4-88d2-4a2e-9a4a-a116cd70989e req-67730e2f-8a8b-4e3f-8fa7-41e7e90a4101 service nova] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:28.860907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-378694b4-88d2-4a2e-9a4a-a116cd70989e req-67730e2f-8a8b-4e3f-8fa7-41e7e90a4101 service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:28.862188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-378694b4-88d2-4a2e-9a4a-a116cd70989e req-67730e2f-8a8b-4e3f-8fa7-41e7e90a4101 service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:28.863047 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-378694b4-88d2-4a2e-9a4a-a116cd70989e req-67730e2f-8a8b-4e3f-8fa7-41e7e90a4101 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Processing event network-vif-plugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:04:28.863688 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.867951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.871110 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.871279 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62da28dc-690f-437e-a945-67617dc032c8) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:28.872826 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.873627 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:28.888780 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:28.892175 np0000001589 nova-compute[98297]: INFO os_vif [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:0d:00,bridge_name='br-int',has_traffic_filtering=True,id=a451f1e5-e9e1-4ab0-a842-5a7e598465b1,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa451f1e5-e9')
May 28 03:04:28.892485 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Deleting instance files /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9_del
May 28 03:04:28.893531 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Deletion of /opt/stack/data/nova/instances/e5117e69-981a-42a7-9fdb-c5fb550fe5b9_del complete
May 28 03:04:29.038821 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Updating instance_info_cache with network_info: [{"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:29.125204 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.000330151000071055 future=<Future at 0x7e4b405a3a10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.125757 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Emitting event <LifecycleEvent: 1779937454.1247168, 9d7ee143-ce2c-4b61-952a-87eab2cf22bb => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:29.125932 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.126105 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] VM Stopped (Lifecycle Event)
May 28 03:04:29.127480 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.6383716850000383 future=<Future at 0x7e4b40651ee0 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.127634 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.6382400610000332 future=<Future at 0x7e4b40651ee0 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.127634 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.127719 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.8646083399999043 future=<Future at 0x7e4b64650110 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.127765 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.8645420059999651 future=<Future at 0x7e4b64650110 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.151790 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:29.242936 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Took 5.65 seconds to destroy the instance on the hypervisor.
May 28 03:04:29.244214 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:04:29.244505 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:04:29.244595 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:04:29.245244 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:29.331519 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:04:29.331936 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937469.331678, f0381f84-64fa-4a31-862b-b4feb19c1713 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:29.332045 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] VM Started (Lifecycle Event)
May 28 03:04:29.334425 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:04:29.335959 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Instance spawned successfully.
May 28 03:04:29.336281 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:04:29.351676 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:29.398374 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Took 1.62 seconds to destroy the instance on the hypervisor.
May 28 03:04:29.400303 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:04:29.400303 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:04:29.400303 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:04:29.400303 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:29.456974 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:29.457133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:29.511128 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:29.542282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Releasing lock "refresh_cache-34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:29.542925 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'flavor' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:29.582458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:29.585210 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:29.585381 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] No VIF found with MAC fa:16:3e:ec:c2:ea, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:04:29.586086 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Using config drive
May 28 03:04:29.602699 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:29.629591 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:29.800093 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:29.840552 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:29.844170 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:29.851695 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:29.851695 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:29.851695 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:29.852072 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:29.852468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:29.852836 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:29.958727 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:04:29.993142 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0007786329999817099 future=<Future at 0x7e4b64650110 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.993295 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.994351 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.528099616999953 future=<Future at 0x7e4b40635760 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.994475 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.527960369000084 future=<Future at 0x7e4b40635760 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:29.994938 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Emitting event <LifecycleEvent: 1779937454.9922667, ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:29.995103 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] VM Stopped (Lifecycle Event)
May 28 03:04:30.112436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.115093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.174903 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.237093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.307259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Releasing lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:30.307259 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:30.307259 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:30.320641 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.331958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.348702 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:04:30.349031 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937470.3487866, f0381f84-64fa-4a31-862b-b4feb19c1713 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:30.349242 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] VM Paused (Lifecycle Event)
May 28 03:04:30.359191 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Took 9.43 seconds to spawn the instance on the hypervisor.
May 28 03:04:30.359653 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:30.460124 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cb6dd32f-290c-44a2-84b1-8f827ee7da07 req-a0422067-2baa-40db-b6fb-f5638d23fcd1 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:30.460388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cb6dd32f-290c-44a2-84b1-8f827ee7da07 req-a0422067-2baa-40db-b6fb-f5638d23fcd1 service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:30.460789 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cb6dd32f-290c-44a2-84b1-8f827ee7da07 req-a0422067-2baa-40db-b6fb-f5638d23fcd1 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:30.462447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cb6dd32f-290c-44a2-84b1-8f827ee7da07 req-a0422067-2baa-40db-b6fb-f5638d23fcd1 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:30.462698 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cb6dd32f-290c-44a2-84b1-8f827ee7da07 req-a0422067-2baa-40db-b6fb-f5638d23fcd1 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] No waiting events found dispatching network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:30.462758 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-cb6dd32f-290c-44a2-84b1-8f827ee7da07 req-a0422067-2baa-40db-b6fb-f5638d23fcd1 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received unexpected event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 for instance with vm_state active and task_state resize_finish.
May 28 03:04:30.476778 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance destroyed successfully.
May 28 03:04:30.477260 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'numa_topology' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:30.503477 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: ad8c47f2-d3bc-4565-9fe5-b1cb0803dfbe] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:30.539012 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.559839 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:30.565044 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:30.565258 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:30.565813 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:30.574351 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:04:30.575670 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Claim successful on node np0000001589
May 28 03:04:30.851990 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:30.861981 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Received event network-vif-deleted-a451f1e5-e9e1-4ab0-a842-5a7e598465b1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:30.862687 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:30.862863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:30.865311 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:30.865476 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:30.865544 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:30.866571 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state rescued and task_state unrescuing.
May 28 03:04:30.867501 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:30.867501 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:30.867902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:30.867902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:30.868035 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:30.868483 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-4b66b501-cb13-4cb5-b106-54fef6ca9276 req-8322afbd-82c1-4b29-8617-8049174bb5e1 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state rescued and task_state unrescuing.
May 28 03:04:30.869611 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937470.8692052, f0381f84-64fa-4a31-862b-b4feb19c1713 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:30.873110 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] VM Resumed (Lifecycle Event)
May 28 03:04:30.874932 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Took 17.63 seconds to build instance.
May 28 03:04:30.926970 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance destroyed successfully.
May 28 03:04:30.927972 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'resources' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:30.965592 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-df60ff58-88ac-4073-9702-64eaf3ed4a1d req-1149ff6f-2de1-4dff-b853-c2299c21d3b4 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-vif-plugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:30.966464 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-df60ff58-88ac-4073-9702-64eaf3ed4a1d req-1149ff6f-2de1-4dff-b853-c2299c21d3b4 service nova] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:30.966605 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-df60ff58-88ac-4073-9702-64eaf3ed4a1d req-1149ff6f-2de1-4dff-b853-c2299c21d3b4 service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:30.966704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-df60ff58-88ac-4073-9702-64eaf3ed4a1d req-1149ff6f-2de1-4dff-b853-c2299c21d3b4 service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:30.966838 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-df60ff58-88ac-4073-9702-64eaf3ed4a1d req-1149ff6f-2de1-4dff-b853-c2299c21d3b4 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] No waiting events found dispatching network-vif-plugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:30.966942 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-df60ff58-88ac-4073-9702-64eaf3ed4a1d req-1149ff6f-2de1-4dff-b853-c2299c21d3b4 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received unexpected event network-vif-plugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 for instance with vm_state active and task_state None.
May 28 03:04:30.981018 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Object Instance<34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:31.070759 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Took 1.67 seconds to deallocate network for instance.
May 28 03:04:31.138371 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:31.139532 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:04:31.142508 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:31.142896 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:04:31.158916 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance running successfully.
May 28 03:04:31.161591 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Failed to set time: agent not configured {{(pid=98297) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 03:04:31.161912 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9a82af2b-1ec4-44cd-a60b-25d6692732c8 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] finish_migration finished successfully. {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 03:04:31.376557 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:31.378664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.145s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:31.382699 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:31.428262 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.431389 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<2f113470-8b6b-4ddc-b8c8-7f3cfa95803f> lazy-loaded attributes: numa_topology,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:31.431389 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1883072808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1883072808',id=19,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvX0yrsEjRQhKUbSQ0Yc3XjjtKhz/ncFm0Sil9E7SkHBYBK2NYUZQUu5nNL7aJJoGiJCfA7/qOELTS3lioIxM8ke4WsLvemWlzkT5i0Ad/EzJNrjkuhp15FoZFMIFek2Q==',key_name='tempest-keypair-1874979258',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:40Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-2kvbn7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member',shelved_at='2026-05-28T03:04:27.602926',shelved_host='np0000001589',shelved_image_id='9edb83a3-a56b-42e2-9ac8-94d7eacc68f9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=2f113470-8b6b-4ddc-b8c8-7f3cfa95803f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:31.431389 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:31.431674 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:31.431807 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:31.440621 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.440621 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf680b933-10, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:31.445677 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.446621 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:31.468979 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.470697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.472318 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc3607d1-681b-4b2c-9fe0-9ce3d1868557) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:31.474475 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.474973 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:31.478699 np0000001589 nova-compute[98297]: INFO os_vif [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10')
May 28 03:04:31.478996 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Deleting instance files /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f_del
May 28 03:04:31.486759 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Deletion of /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f_del complete
May 28 03:04:31.542958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.579331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:31.670789 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:31.887872 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999762760999829 future=<Future at 0x7e4b404001d0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:31.888022 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937471.8878953, 9d7ee143-ce2c-4b61-952a-87eab2cf22bb => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:31.888116 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] VM Resumed (Lifecycle Event)
May 28 03:04:32.135180 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Deleted allocations for instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f
May 28 03:04:32.139545 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:32.363640 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c635fc3-0799-4000-920e-364c683c58f0 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:32.525288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:32.525288 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:32.552320 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:32.559191 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e87e770d-cf58-4f9a-9a1a-e2ddd2040a29 req-b96b021e-cd45-45a8-8e3b-2db0d5fe920d service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:32.559436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e87e770d-cf58-4f9a-9a1a-e2ddd2040a29 req-b96b021e-cd45-45a8-8e3b-2db0d5fe920d service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:32.559603 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e87e770d-cf58-4f9a-9a1a-e2ddd2040a29 req-b96b021e-cd45-45a8-8e3b-2db0d5fe920d service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:32.559778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e87e770d-cf58-4f9a-9a1a-e2ddd2040a29 req-b96b021e-cd45-45a8-8e3b-2db0d5fe920d service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:32.559909 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e87e770d-cf58-4f9a-9a1a-e2ddd2040a29 req-b96b021e-cd45-45a8-8e3b-2db0d5fe920d service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] No waiting events found dispatching network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:32.560322 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e87e770d-cf58-4f9a-9a1a-e2ddd2040a29 req-b96b021e-cd45-45a8-8e3b-2db0d5fe920d service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received unexpected event network-vif-plugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 for instance with vm_state resized and task_state None.
May 28 03:04:32.561192 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:32.583421 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:32.583755 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:32.583988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:32.584174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:32.584349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:32.587493 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Terminating instance
May 28 03:04:32.598175 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:32.641640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:32.647310 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:32.994545 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:32.994545 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing instance network info cache due to event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:32.994659 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Acquiring lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:32.994754 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Acquired lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:32.994847 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing network info cache for port f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:33.034009 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:33.066734 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937473.0648658, 9d7ee143-ce2c-4b61-952a-87eab2cf22bb => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:33.066734 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] VM Started (Lifecycle Event)
May 28 03:04:33.083782 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-deleted-3216c453-3e7f-455e-8c3b-d1d783b1c2a1 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:33.084307 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Neutron deleted interface 3216c453-3e7f-455e-8c3b-d1d783b1c2a1; detaching it from the instance and deleting it from the info cache
May 28 03:04:33.089009 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Detach interface failed, port_id=3216c453-3e7f-455e-8c3b-d1d783b1c2a1, reason: Instance 60a15beb-a3bc-4d0f-8437-21699f6c76ca could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:33.089009 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-changed-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:33.089009 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Refreshing instance network info cache due to event network-changed-ae2981b3-9f2c-4589-a68c-242af62e9df4. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:33.089009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] Acquiring lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:33.089009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] Acquired lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:33.089009 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Refreshing network info cache for port ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:33.094492 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:04:33.133492 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.138674 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.163895 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.178102 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.202945 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.235937 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:33.266549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.274925 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.365445 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.395416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.401179 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.451562 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.466628 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:33.466893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:33.467060 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Going to confirm migration 1 {{(pid=98297) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 03:04:33.471064 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.497784 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:33.520606 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.550276 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.983s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:33.550276 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:04:33.555117 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.976s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:33.568898 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:33.571837 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.573847 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:33.594247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:33.674779 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.697106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:33.698483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:33.698483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:33.698483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:33.698483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:33.699918 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Terminating instance
May 28 03:04:33.723379 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.740246 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Took 4.50 seconds to deallocate network for instance.
May 28 03:04:33.784058 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:33.815817 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Instance destroyed successfully.
May 28 03:04:33.818374 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lazy-loading 'resources' on Instance uuid 7edf7fdf-a897-456a-b47a-0e6154035b35 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:33.974334 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:34.065068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:04:34.065068 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:04:34.065068 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:34.065068 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:34.077110 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de due to new event <LifecycleEvent: 1779937474.0765314, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:04:34.077110 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937474.0765314, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:34.077515 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Resumed (Lifecycle Event)
May 28 03:04:34.163867 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:34.167580 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:34.167689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquired lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:34.167773 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:34.167919 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'info_cache' on Instance uuid 9d7ee143-ce2c-4b61-952a-87eab2cf22bb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:34.213979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:04:34.229042 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49a98ac8a8a84d1496b8b48952956e32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e00f74b8638345979e76606cba0149ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:04:34.312271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.324463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:49Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:34.325461 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "address": "fa:16:3e:04:17:80", "network": {"id": "22f48e63-5082-4016-ab50-7465732f4540", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1629334300-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e99d894-6c", "ovs_interfaceid": "3e99d894-6ccc-435b-8aaa-b5a9ccc0393e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:34.328840 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:17:80,bridge_name='br-int',has_traffic_filtering=True,id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e,network=Network(22f48e63-5082-4016-ab50-7465732f4540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e99d894-6c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:34.329211 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:17:80,bridge_name='br-int',has_traffic_filtering=True,id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e,network=Network(22f48e63-5082-4016-ab50-7465732f4540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e99d894-6c') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:34.331276 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.331276 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.331276 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e99d894-6c, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.332441 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.333075 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.336949 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.377167 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.379513 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.379859 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=215b0ef9-2a22-4315-9647-b9d2b8464f4d) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.380902 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.382290 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.425972 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.431288 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:17:80,bridge_name='br-int',has_traffic_filtering=True,id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e,network=Network(22f48e63-5082-4016-ab50-7465732f4540),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e99d894-6c')
May 28 03:04:34.432526 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:49Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:34.432944 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "address": "fa:16:3e:c0:47:e6", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f9d30b5-dd", "ovs_interfaceid": "6f9d30b5-ddb6-4742-a71e-4586b2896fd7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:34.436246 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:47:e6,bridge_name='br-int',has_traffic_filtering=True,id=6f9d30b5-ddb6-4742-a71e-4586b2896fd7,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f9d30b5-dd') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:34.436569 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:47:e6,bridge_name='br-int',has_traffic_filtering=True,id=6f9d30b5-ddb6-4742-a71e-4586b2896fd7,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f9d30b5-dd') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:34.437507 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.437983 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f9d30b5-dd, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.441392 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.445294 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.483284 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:34.489793 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.493307 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.493307 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=335f327c-3eae-40c2-badc-3801268bb913) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.494408 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.494408 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.526268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.529157 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:47:e6,bridge_name='br-int',has_traffic_filtering=True,id=6f9d30b5-ddb6-4742-a71e-4586b2896fd7,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f9d30b5-dd')
May 28 03:04:34.530274 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:49Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:34.531167 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "address": "fa:16:3e:db:a7:00", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71da4e7e-ce", "ovs_interfaceid": "71da4e7e-ce44-4a8a-9522-c433f06f9e0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:34.531834 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:a7:00,bridge_name='br-int',has_traffic_filtering=True,id=71da4e7e-ce44-4a8a-9522-c433f06f9e0c,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71da4e7e-ce') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:34.532105 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a7:00,bridge_name='br-int',has_traffic_filtering=True,id=71da4e7e-ce44-4a8a-9522-c433f06f9e0c,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71da4e7e-ce') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:34.545674 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.546069 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71da4e7e-ce, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.547128 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.560834 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.567002 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.568282 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:04:34.575434 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Instance destroyed successfully.
May 28 03:04:34.575958 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'resources' on Instance uuid 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:34.579442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.582434 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:34.588350 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937474.587366, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:34.588350 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Started (Lifecycle Event)
May 28 03:04:34.598726 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.600250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.600499 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26234332-494d-4eea-b23b-a8ea2533e3ba) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.601323 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.601823 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.628877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.648646 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:34.648954 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:34.654033 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.656629 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:a7:00,bridge_name='br-int',has_traffic_filtering=True,id=71da4e7e-ce44-4a8a-9522-c433f06f9e0c,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap71da4e7e-ce')
May 28 03:04:34.658210 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:49Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:34.658389 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "address": "fa:16:3e:c5:af:a3", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.237", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f51ea2-4c", "ovs_interfaceid": "a3f51ea2-4c87-49da-a163-417ce20a5efd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:34.659009 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=a3f51ea2-4c87-49da-a163-417ce20a5efd,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f51ea2-4c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:34.662284 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=a3f51ea2-4c87-49da-a163-417ce20a5efd,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f51ea2-4c') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:34.663567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.663814 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3f51ea2-4c, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.666079 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.667069 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.688645 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:34.688645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:34.688645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:34.695160 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:34.699146 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.709279 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:34.709491 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:34.711129 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:34.711324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:34.712008 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:34.712179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:34.712358 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:34.712510 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-71da4e7e-ce44-4a8a-9522-c433f06f9e0c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:34.712664 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:34.712835 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:34.716836 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.722025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=014efff9-13ea-416c-913c-7ce598adf0dc) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.726155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:34.726354 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.011s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:34.726580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.726970 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:34.727179 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-ae84a137-be40-4ec5-a4f5-587338742734 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:34.727391 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:34.727573 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:34.727772 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:34.727881 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:34.728033 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:34.728184 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-ae84a137-be40-4ec5-a4f5-587338742734 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:34.728607 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:34.728785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:34.729097 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:34.729097 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:34.729274 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:34.729448 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc91e106-a977-405b-a165-3bbfd9c28483 req-fc31abef-9b30-40c7-a91a-4f5fd2a79520 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a55473db-0338-440a-90f5-69820a020453 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:34.743019 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.748606 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:af:a3,bridge_name='br-int',has_traffic_filtering=True,id=a3f51ea2-4c87-49da-a163-417ce20a5efd,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f51ea2-4c')
May 28 03:04:34.749628 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:49Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:34.750261 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "f60a5b73-285c-455a-8503-39987d159dc0", "address": "fa:16:3e:bc:e7:d4", "network": {"id": "4d7b2063-5e2c-4398-8b20-135aaa7cadc4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1752983869", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.105", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf60a5b73-28", "ovs_interfaceid": "f60a5b73-285c-455a-8503-39987d159dc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:34.750637 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e7:d4,bridge_name='br-int',has_traffic_filtering=True,id=f60a5b73-285c-455a-8503-39987d159dc0,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60a5b73-28') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:34.750916 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e7:d4,bridge_name='br-int',has_traffic_filtering=True,id=f60a5b73-285c-455a-8503-39987d159dc0,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60a5b73-28') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:34.752399 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.753742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf60a5b73-28, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.753742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.754538 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.770354 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.771563 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.771734 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e22616ac-35c0-4225-8567-2f8fbefe731f) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.772358 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.772808 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.788837 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.792031 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:e7:d4,bridge_name='br-int',has_traffic_filtering=True,id=f60a5b73-285c-455a-8503-39987d159dc0,network=Network(4d7b2063-5e2c-4398-8b20-135aaa7cadc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf60a5b73-28')
May 28 03:04:34.792792 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:49Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:34.792980 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "ae84a137-be40-4ec5-a4f5-587338742734", "address": "fa:16:3e:0e:a1:bc", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae84a137-be", "ovs_interfaceid": "ae84a137-be40-4ec5-a4f5-587338742734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:34.793610 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a1:bc,bridge_name='br-int',has_traffic_filtering=True,id=ae84a137-be40-4ec5-a4f5-587338742734,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae84a137-be') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:34.793861 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a1:bc,bridge_name='br-int',has_traffic_filtering=True,id=ae84a137-be40-4ec5-a4f5-587338742734,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae84a137-be') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:34.794680 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.794864 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae84a137-be, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.795972 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.798815 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.805990 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.806816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.806954 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1a6f2d0-2b35-4a98-8441-8aef0112b9a9) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.808079 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.817871 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.820177 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a1:bc,bridge_name='br-int',has_traffic_filtering=True,id=ae84a137-be40-4ec5-a4f5-587338742734,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae84a137-be')
May 28 03:04:34.820817 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-658837030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-device-tagging-server-658837030',id=17,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAm2dIe9P7sbI/bOdOKJlVR/2dX9yAEkU7DvIojewLE8SrUaDTTH0OSshI6eeA4BrR2sy1qd/1q8QELiaQkg9MMglNjxjwxx42w6tf7uTjpm/ou5lasgN52gvKKAZnA42w==',key_name='tempest-keypair-73712955',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:49Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077e33a200944c65a8018f12fe6f499e',ramdisk_id='',reservation_id='r-n2tjm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-864280134',owner_user_name='tempest-TaggedBootDevicesTest-864280134-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd7536c083d44349596a82948bb40e0',uuid=7edf7fdf-a897-456a-b47a-0e6154035b35,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:34.821064 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converting VIF {"id": "a55473db-0338-440a-90f5-69820a020453", "address": "fa:16:3e:17:bc:de", "network": {"id": "fcc89b53-6b78-4d14-903f-a7cf94ddb3be", "bridge": "br-int", "label": "tempest-device-tagging-net2-1981718211", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "077e33a200944c65a8018f12fe6f499e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa55473db-03", "ovs_interfaceid": "a55473db-0338-440a-90f5-69820a020453", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:34.821545 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:de,bridge_name='br-int',has_traffic_filtering=True,id=a55473db-0338-440a-90f5-69820a020453,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55473db-03') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:34.821783 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:de,bridge_name='br-int',has_traffic_filtering=True,id=a55473db-0338-440a-90f5-69820a020453,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55473db-03') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:34.822933 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.823377 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa55473db-03, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.824152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.825887 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.828443 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:34.830011 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.831180 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.831180 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=304e4ae9-c6d5-48fa-8656-9b32d39bbf75) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:34.831814 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.833098 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:34.837014 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:34.844074 np0000001589 nova-compute[98297]: INFO os_vif [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:bc:de,bridge_name='br-int',has_traffic_filtering=True,id=a55473db-0338-440a-90f5-69820a020453,network=Network(fcc89b53-6b78-4d14-903f-a7cf94ddb3be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa55473db-03')
May 28 03:04:34.845434 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:34.845682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:34.845792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:34.846076 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:34.846336 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ef60b330-4fcb-41e8-871c-edf3f5932bba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:34.846451 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:34.851058 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Updated VIF entry in instance network info cache for port ae2981b3-9f2c-4589-a68c-242af62e9df4. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:34.851681 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Updating instance_info_cache with network_info: [{"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:34.880904 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:34.881364 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:34.881364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '35')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:34.883086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba', '36')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:34.883776 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40544fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'): ({'sdk'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:34.884214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Removing multipathed devices sdk, sdj {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:34.884299 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Flush multipath device 3300000005c6d50c6 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:34.943436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:34.990256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:35.037251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:35.037251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:35.038330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:35.054759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:35.054759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:35.062243 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updated VIF entry in instance network info cache for port f680b933-10c8-4f0f-86e7-65aa46fd953d. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:35.062612 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf680b933-10", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:35.068825 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.068825 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.068825 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.069053 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.069053 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.069247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:35.069247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.069495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.070691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.070691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.070691 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.076163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:04:35.079846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.087380 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b34120db-86fe-43e4-98ca-6bb7585d0953 req-62a7bfb5-5cdc-444c-b980-ce985f812c36 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-unplugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:35.087805 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-141786083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-141786083',id=21,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:26Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-cldsqhan',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:04:32Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:35.087998 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "f9adc971-3eb4-406b-a255-ec3252953d28", "address": "fa:16:3e:15:28:bd", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9adc971-3e", "ovs_interfaceid": "f9adc971-3eb4-406b-a255-ec3252953d28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:35.088610 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:35.088874 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:35.091967 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:35.092714 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:35.092954 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9adc971-3e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:35.094104 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:35.094947 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:35.097177 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:35.099281 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999708780999981 future=<Future at 0x7e4b40583320 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:35.099461 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999894625000024 future=<Future at 0x7e4b40552ed0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:35.104164 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:35.104164 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bce64e3-58d2-4feb-a8e8-ece8ea2fd114) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:35.104164 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:35.104839 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:35.105311 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:35.106952 np0000001589 nova-compute[98297]: INFO os_vif [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:28:bd,bridge_name='br-int',has_traffic_filtering=True,id=f9adc971-3eb4-406b-a255-ec3252953d28,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9adc971-3e')
May 28 03:04:35.107858 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:35.108102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:35.108267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:35.133385 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.40.100,3260]
May 28 03:04:35.133385 np0000001589 nova-compute[98297]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.40.100,3260] successful.
May 28 03:04:35.133385 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.152659 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:35.161430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.177395 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:35.179355 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.184790 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.184790 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.185142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.185142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.185142 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.188356 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:35.188686 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.188686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.188823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.190183 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.190820 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.193382 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:35.193599 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.193777 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.193967 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.194107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.194649 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.195914 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:35.195914 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.195914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.195914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.196040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.196160 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.196568 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-6f9d30b5-ddb6-4742-a71e-4586b2896fd7 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:35.196684 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.196793 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.196902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.196991 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.197083 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.197175 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23db313c-9715-4a67-baab-96907ebe59b5 req-a5b6c6ae-4f3b-42e7-8159-a575866bb723 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a3f51ea2-4c87-49da-a163-417ce20a5efd for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:35.216691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.226833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.50.100,3260]
May 28 03:04:35.226833 np0000001589 nova-compute[98297]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-ef60b330-4fcb-41e8-871c-edf3f5932bba, portal: 192.168.50.100,3260] successful.
May 28 03:04:35.226833 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.247358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.247702 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:35.247987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== disconnect_volume: return (402ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:35.248438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:35.248857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.141s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:35.249255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1089d603-1ad4-4db6-91ad-4e53dafbc836', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-17'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:35.249428 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:35.250588 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:35.250863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:35.250974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:35.257239 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Successfully created port: 720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.281086 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:35.281641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:35.281641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '52')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:35.284311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836', '51')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:35.284311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646bb560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'): ({'sdv'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'): ({'sdu'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:35.284311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Removing multipathed devices sdu, sdv {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:35.284311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flush multipath device 330000000757dffe1 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:35.327428 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Remove SCSI device /dev/sdu with /sys/block/sdu/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:35.353919 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81baa210-17b7-4ac7-b365-4cd116d44582 req-538d8084-f700-4074-b3a7-d4eb433f6e30 service nova] Releasing lock "refresh_cache-f0381f84-64fa-4a31-862b-b4feb19c1713" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:35.372112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Remove SCSI device /dev/sdv with /sys/block/sdv/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:35.426622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Checking to see if SCSI volumes sdu, sdv have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:35.426622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] SCSI volumes sdu, sdv have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:35.427693 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Checking to see if device paths {'sdu', 'sdv'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:35.440412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Device paths {'sdu', 'sdv'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:35.440643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:35.460178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.510439 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Took 1.77 seconds to detach 3 volumes for instance.
May 28 03:04:35.515912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.40.100,3260]
May 28 03:04:35.515912 np0000001589 nova-compute[98297]: Logout of [sid: 52, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.40.100,3260] successful.
May 28 03:04:35.515912 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.525257 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:35.536203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.548307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.565407 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Releasing lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:35.565742 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-deleted-8f4823d8-e26e-4c35-8521-88219b693c40 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.565906 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Neutron deleted interface 8f4823d8-e26e-4c35-8521-88219b693c40; detaching it from the instance and deleting it from the info cache
May 28 03:04:35.567131 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Detach interface failed, port_id=8f4823d8-e26e-4c35-8521-88219b693c40, reason: Instance 60a15beb-a3bc-4d0f-8437-21699f6c76ca could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:35.567368 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.567584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.567827 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.567973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.568152 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.568336 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state active and task_state None.
May 28 03:04:35.568469 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.569740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Acquiring lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:35.569961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.570250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.570381 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] No waiting events found dispatching network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:35.570838 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received unexpected event network-vif-plugged-f9adc971-3eb4-406b-a255-ec3252953d28 for instance with vm_state active and task_state None.
May 28 03:04:35.570838 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-deleted-2b109c91-d16a-4f52-8cc6-f1327fcd5621 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.570838 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Neutron deleted interface 2b109c91-d16a-4f52-8cc6-f1327fcd5621; detaching it from the instance and deleting it from the info cache
May 28 03:04:35.574216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Detach interface failed, port_id=2b109c91-d16a-4f52-8cc6-f1327fcd5621, reason: Instance 60a15beb-a3bc-4d0f-8437-21699f6c76ca could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:35.574216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-deleted-5560f8fa-1f24-462f-b908-5aa738c9240b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.574216 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Neutron deleted interface 5560f8fa-1f24-462f-b908-5aa738c9240b; detaching it from the instance and deleting it from the info cache
May 28 03:04:35.576343 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Detach interface failed, port_id=5560f8fa-1f24-462f-b908-5aa738c9240b, reason: Instance 60a15beb-a3bc-4d0f-8437-21699f6c76ca could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:35.576818 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Received event network-vif-deleted-83bdc31d-1f6f-4435-a9b1-0e17677f9340 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:35.576818 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Neutron deleted interface 83bdc31d-1f6f-4435-a9b1-0e17677f9340; detaching it from the instance and deleting it from the info cache
May 28 03:04:35.577548 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eb12e09-46f5-41cb-a0d5-8f408f8bde6e req-c384a835-531e-4e88-9e81-d464e78eed48 service nova] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Detach interface failed, port_id=83bdc31d-1f6f-4435-a9b1-0e17677f9340, reason: Instance 60a15beb-a3bc-4d0f-8437-21699f6c76ca could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:35.584138 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.50.100,3260]
May 28 03:04:35.584138 np0000001589 nova-compute[98297]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-1089d603-1ad4-4db6-91ad-4e53dafbc836, portal: 192.168.50.100,3260] successful.
May 28 03:04:35.584138 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.604039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.604039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:35.604039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== disconnect_volume: return (495ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:35.604155 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:35.604621 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Deleting instance files /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de_del
May 28 03:04:35.604912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.354s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:35.605240 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:35.605441 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:35.608357 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Deletion of /opt/stack/data/nova/instances/34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de_del complete
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.635113 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9 (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.635509 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:35.635509 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:35.635728 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '39')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:35.636964 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9', '40')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:35.638317 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40547060>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'): ({'sdo'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:35.638547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Removing multipathed devices sdo, sdn {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:35.638808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Flush multipath device 3300000001b387ef0 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:35.664059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.109s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:35.666512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.025s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:35.675556 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:35.706927 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating instance_info_cache with network_info: [{"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:35.715622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:35.742590 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Deleted allocations for instance e5117e69-981a-42a7-9fdb-c5fb550fe5b9
May 28 03:04:35.769241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Checking to see if SCSI volumes sdo, sdn have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:35.769479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] SCSI volumes sdo, sdn have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:35.772676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Checking to see if device paths {'sdo', 'sdn'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:35.788085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Device paths {'sdo', 'sdn'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:35.788415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:35.799794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.819860 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Successfully updated port: 720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:04:35.841314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.40.100,3260]
May 28 03:04:35.841314 np0000001589 nova-compute[98297]: Logout of [sid: 39, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.40.100,3260] successful.
May 28 03:04:35.841314 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.858749 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.869901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.908730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.50.100,3260]
May 28 03:04:35.908730 np0000001589 nova-compute[98297]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-aac98498-ef87-4ea4-8b0a-47d9eef04ca9, portal: 192.168.50.100,3260] successful.
May 28 03:04:35.908730 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.940714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:35.940904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:35.941008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== disconnect_volume: return (690ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:35.941135 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:35.944280 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:35.944280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:35.944280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:35.944280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:35.944280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f810741-3315-4c52-9a1f-0c51ae77e7db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:35.944280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.972514 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:35.972881 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:35.972881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:35.973219 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '44')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:35.973814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db', '45')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:35.974605 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64442d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'): ({'sdr'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'): ({'sdq'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:35.974808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Removing multipathed devices sdq, sdr {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:35.975011 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Flush multipath device 3300000002af3bfdf {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:36.012809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:36.017613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:36.060537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:36.095163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:04:36.096173 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:04:36.096437 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Creating image(s)
May 28 03:04:36.096864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "/opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:36.097082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "/opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:36.097620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "/opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:36.098210 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:36.102703 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:36.105279 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Checking to see if SCSI volumes sdq, sdr have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:36.105784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] SCSI volumes sdq, sdr have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:36.106542 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:36.134254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Checking to see if device paths {'sdq', 'sdr'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:36.135380 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Took 1.92 seconds to destroy the instance on the hypervisor.
May 28 03:04:36.140611 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:04:36.140881 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:04:36.141109 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:04:36.142237 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:36.147660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Device paths {'sdq', 'sdr'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:36.148239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:36.158086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:36.191832 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.40.100,3260]
May 28 03:04:36.191832 np0000001589 nova-compute[98297]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.40.100,3260] successful.
May 28 03:04:36.191832 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:36.200175 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:36.200960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:36.202716 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:36.203113 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:36.208033 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:36.209167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:36.241481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Releasing lock "refresh_cache-9d7ee143-ce2c-4b61-952a-87eab2cf22bb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:36.241996 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'migration_context' on Instance uuid 9d7ee143-ce2c-4b61-952a-87eab2cf22bb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:36.257649 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:36.262847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:36.277468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:36.313303 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.50.100,3260]
May 28 03:04:36.313303 np0000001589 nova-compute[98297]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-8f810741-3315-4c52-9a1f-0c51ae77e7db, portal: 192.168.50.100,3260] successful.
May 28 03:04:36.313303 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:36.321900 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.113s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:36.322351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:36.323174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:36.323413 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquired lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:36.323705 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:36.343293 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:36.344070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:36.344311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] <== disconnect_volume: return (401ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:36.344551 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:36.345386 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Deleting instance files /opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35_del
May 28 03:04:36.346771 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Deletion of /opt/stack/data/nova/instances/7edf7fdf-a897-456a-b47a-0e6154035b35_del complete
May 28 03:04:36.382896 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk 1073741824" returned: 0 in 0.060s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:36.383320 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:36.383617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:36.485439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:36.486279 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:04:36.487040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:36.529773 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:36.530250 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:36.595168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:36.595772 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Cannot resize image /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:04:36.595826 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:04:36.596003 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Ensure instance console log exists: /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:04:36.596250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:36.596440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:36.596588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:36.769580 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Object Instance<9d7ee143-ce2c-4b61-952a-87eab2cf22bb> lazy-loaded attributes: info_cache,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:36.771760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5c8e800d-b0da-48fe-89e4-bd98721c0384 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "e5117e69-981a-42a7-9fdb-c5fb550fe5b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.505s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:36.775463 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4fafacc8-dfce-4989-b37f-584fc12da4cd req-eeeffa17-b75d-4f17-9a8c-3d7acd0ff5b4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:36.775638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4fafacc8-dfce-4989-b37f-584fc12da4cd req-eeeffa17-b75d-4f17-9a8c-3d7acd0ff5b4 service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:36.775784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4fafacc8-dfce-4989-b37f-584fc12da4cd req-eeeffa17-b75d-4f17-9a8c-3d7acd0ff5b4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:36.775924 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4fafacc8-dfce-4989-b37f-584fc12da4cd req-eeeffa17-b75d-4f17-9a8c-3d7acd0ff5b4 service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:36.776052 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4fafacc8-dfce-4989-b37f-584fc12da4cd req-eeeffa17-b75d-4f17-9a8c-3d7acd0ff5b4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:36.776161 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4fafacc8-dfce-4989-b37f-584fc12da4cd req-eeeffa17-b75d-4f17-9a8c-3d7acd0ff5b4 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a55473db-0338-440a-90f5-69820a020453 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:36.777500 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:36.854335 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Took 3.76 seconds to destroy the instance on the hypervisor.
May 28 03:04:36.855134 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:04:36.855717 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:04:36.856311 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:04:36.856600 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:36.942300 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:04:36.983660 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:37.038569 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:37.069894 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:37.153933 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-changed-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:37.154647 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Refreshing instance network info cache due to event network-changed-720e400f-ae4a-4fab-a504-d914c0ad1119. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:37.156647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] Acquiring lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:37.207038 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:37.271821 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:37.272008 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:37.272217 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:37.272366 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:37.272503 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:37.272626 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-a3f51ea2-4c87-49da-a163-417ce20a5efd for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:37.272740 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:37.272890 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:37.273043 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:37.273181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:37.275334 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:37.275557 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-f60a5b73-285c-455a-8503-39987d159dc0 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:37.276039 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:37.276250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Acquiring lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:37.276425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:37.276522 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:37.276716 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] No waiting events found dispatching network-vif-unplugged-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:37.276889 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a28d667e-5c61-4ad7-af85-7f9f99c55bf7 req-f4f6edcf-0ea9-46f3-a954-9941cd53fe0f service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-unplugged-f60a5b73-285c-455a-8503-39987d159dc0 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:37.386566 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Updating instance_info_cache with network_info: [{"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:37.522917 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00042274699990230147 future=<Future at 0x7e4b40635760 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:37.523455 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Emitting event <LifecycleEvent: 1779937462.5223632, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:37.523686 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:37.523785 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Stopped (Lifecycle Event)
May 28 03:04:37.523866 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.7488571099997898 future=<Future at 0x7e4b40520290 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:37.523945 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.748768304999885 future=<Future at 0x7e4b40520290 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:37.545788 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.879s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:37.548156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 4.899s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:37.548156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:37.548324 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:04:37.549375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.531s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:37.573273 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Took 1.43 seconds to deallocate network for instance.
May 28 03:04:37.602555 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:37.889384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Releasing lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:37.889787 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Instance network_info: |[{"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:04:37.890031 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] Acquired lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:37.890309 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Refreshing network info cache for port 720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:37.893443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Start _get_guest_xml network_info=[{"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:04:37.896931 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:04:37.898046 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-2011550058', uuid='6aeff63a-cb33-4923-91c2-08b7756e9a0c'), owner=OwnerMeta(userid='49a98ac8a8a84d1496b8b48952956e32', username='tempest-VolumesSnapshotTestJSON-1234909468-project-member', projectid='e00f74b8638345979e76606cba0149ce', projectname='tempest-VolumesSnapshotTestJSON-1234909468'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937477.8977087) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:04:37.899036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:04:37.899332 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:04:37.901615 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:04:37.901788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:04:37.902630 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:04:37.903467 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:04:37.903467 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:04:37.903467 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:04:37.903768 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:04:37.903768 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:04:37.903768 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:04:37.903852 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:04:37.903975 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:04:37.904037 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:04:37.904153 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:04:37.904412 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:04:37.921345 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2011550058',display_name='tempest-VolumesSnapshotTestJSON-instance-2011550058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumessnapshottestjson-instance-2011550058',id=23,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWM+HHij8glvOy33J4kSWmumbKMnMZ8n0WNPBTPGYTIccbmdf4JQOutuESra/Odo9sIIKNzUKtVPeLD1Y4JTZpVYQPXZWySsUmJiXsASWogu0j+Zv+y/ZHcf1TGMvgdWw==',key_name='tempest-keypair-857640879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e00f74b8638345979e76606cba0149ce',ramdisk_id='',reservation_id='r-ksavz0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1234909468',owner_user_name='tempest-VolumesSnapshotTestJSON-1234909468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a98ac8a8a84d1496b8b48952956e32',uuid=6aeff63a-cb33-4923-91c2-08b7756e9a0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:04:37.921646 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converting VIF {"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:37.922548 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:16,bridge_name='br-int',has_traffic_filtering=True,id=720e400f-ae4a-4fab-a504-d914c0ad1119,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720e400f-ae') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:37.923142 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'pci_devices' on Instance uuid 6aeff63a-cb33-4923-91c2-08b7756e9a0c {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:38.027491 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:38.051698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b2a6a5-4e50-47d8-9e81-62a4b823572c tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 16.870s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:38.052467 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 2.836s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:38.052586 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Unshelving
May 28 03:04:38.165355 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Took 0.59 seconds to detach 1 volumes for instance.
May 28 03:04:38.168593 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Deleting volume: 1089d603-1ad4-4db6-91ad-4e53dafbc836 {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:04:38.315355 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:38.315703 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:38.395650 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:38.425993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] End _get_guest_xml xml=<domain type="qemu">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <uuid>6aeff63a-cb33-4923-91c2-08b7756e9a0c</uuid>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <name>instance-00000017</name>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2011550058</nova:name>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:04:37</nova:creationTime>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:user uuid="49a98ac8a8a84d1496b8b48952956e32">tempest-VolumesSnapshotTestJSON-1234909468-project-member</nova:user>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:project uuid="e00f74b8638345979e76606cba0149ce">tempest-VolumesSnapshotTestJSON-1234909468</nova:project>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         <nova:port uuid="720e400f-ae4a-4fab-a504-d914c0ad1119">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <system>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <entry name="serial">6aeff63a-cb33-4923-91c2-08b7756e9a0c</entry>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <entry name="uuid">6aeff63a-cb33-4923-91c2-08b7756e9a0c</entry>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </system>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <os>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   </os>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <features>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   </features>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   <devices>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk.config"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:32:c0:16"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <target dev="tap720e400f-ae"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </interface>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/console.log" append="off"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </serial>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <video>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </video>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </rng>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:   </devices>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]: </domain>
May 28 03:04:38.425993 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:04:38.427686 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Preparing to wait for external event network-vif-plugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:04:38.427686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:38.427686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:38.427686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:38.427686 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2011550058',display_name='tempest-VolumesSnapshotTestJSON-instance-2011550058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumessnapshottestjson-instance-2011550058',id=23,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWM+HHij8glvOy33J4kSWmumbKMnMZ8n0WNPBTPGYTIccbmdf4JQOutuESra/Odo9sIIKNzUKtVPeLD1Y4JTZpVYQPXZWySsUmJiXsASWogu0j+Zv+y/ZHcf1TGMvgdWw==',key_name='tempest-keypair-857640879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e00f74b8638345979e76606cba0149ce',ramdisk_id='',reservation_id='r-ksavz0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1234909468',owner_user_name='tempest-VolumesSnapshotTestJSON-1234909468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a98ac8a8a84d1496b8b48952956e32',uuid=6aeff63a-cb33-4923-91c2-08b7756e9a0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:04:38.427686 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converting VIF {"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:38.428889 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:16,bridge_name='br-int',has_traffic_filtering=True,id=720e400f-ae4a-4fab-a504-d914c0ad1119,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720e400f-ae') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:38.429325 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:16,bridge_name='br-int',has_traffic_filtering=True,id=720e400f-ae4a-4fab-a504-d914c0ad1119,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720e400f-ae') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:04:38.430462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:38.430462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:38.430634 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:04:38.431426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:38.431572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db0b099f-1352-51e2-a20a-a972149d5eaf', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:38.433564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:38.434368 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:38.437644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:38.437769 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap720e400f-ae, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:38.438034 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap720e400f-ae, col_values=(('qos', UUID('cf796189-8546-498d-b29f-7778a466291c')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:38.438203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap720e400f-ae, col_values=(('external_ids', {'iface-id': '720e400f-ae4a-4fab-a504-d914c0ad1119', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:c0:16', 'vm-uuid': '6aeff63a-cb33-4923-91c2-08b7756e9a0c'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:38.438857 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:38.439863 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:38.445070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:38.446453 np0000001589 nova-compute[98297]: INFO os_vif [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c0:16,bridge_name='br-int',has_traffic_filtering=True,id=720e400f-ae4a-4fab-a504-d914c0ad1119,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720e400f-ae')
May 28 03:04:38.611167 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-14 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:04:38.615110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:38.699539 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:38.700923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:38.729327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:38.798268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:38.801430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:38.824737 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:38.876775 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cb96c4b3-dc5d-4e89-9108-463f651a6cf7 req-91b8670d-c953-47e7-b17f-f7a6f49b7f79 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-deleted-3e99d894-6ccc-435b-8aaa-b5a9ccc0393e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:38.876775 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-cb96c4b3-dc5d-4e89-9108-463f651a6cf7 req-91b8670d-c953-47e7-b17f-f7a6f49b7f79 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Neutron deleted interface 3e99d894-6ccc-435b-8aaa-b5a9ccc0393e; detaching it from the instance and deleting it from the info cache
May 28 03:04:38.884604 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cb96c4b3-dc5d-4e89-9108-463f651a6cf7 req-91b8670d-c953-47e7-b17f-f7a6f49b7f79 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Detach interface failed, port_id=3e99d894-6ccc-435b-8aaa-b5a9ccc0393e, reason: Instance 7edf7fdf-a897-456a-b47a-0e6154035b35 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:38.896650 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:38.899305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:38.901618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:38.996958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:39.007612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:04:39.011999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:39.089091 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Updated VIF entry in instance network info cache for port 720e400f-ae4a-4fab-a504-d914c0ad1119. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:39.089769 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Updating instance_info_cache with network_info: [{"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:39.093329 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:39.093690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:39.176452 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:39.180509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:39.223644 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2c188a68-9798-49cf-b131-115951472dd7 req-61df4bdb-df6e-408c-8155-5bdbcd26e874 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-deleted-f60a5b73-285c-455a-8503-39987d159dc0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:39.223999 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-2c188a68-9798-49cf-b131-115951472dd7 req-61df4bdb-df6e-408c-8155-5bdbcd26e874 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Neutron deleted interface f60a5b73-285c-455a-8503-39987d159dc0; detaching it from the instance and deleting it from the info cache
May 28 03:04:39.228286 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2c188a68-9798-49cf-b131-115951472dd7 req-61df4bdb-df6e-408c-8155-5bdbcd26e874 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Detach interface failed, port_id=f60a5b73-285c-455a-8503-39987d159dc0, reason: Instance 7edf7fdf-a897-456a-b47a-0e6154035b35 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:39.265990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:39.266439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:39.280607 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.007738576000065223 future=<Future at 0x7e4b40520290 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:39.280798 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:39.281011 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.045075137999902 future=<Future at 0x7e4b40517d70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:39.281138 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.044943272999944 future=<Future at 0x7e4b40517d70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:39.282137 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Emitting event <LifecycleEvent: 1779937464.272662, 60a15beb-a3bc-4d0f-8437-21699f6c76ca => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:39.282376 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] VM Stopped (Lifecycle Event)
May 28 03:04:39.333736 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b821180-48ea-44f7-b247-259140936659 req-d547f52c-b219-486a-a76f-8543a377e492 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-deleted-a55473db-0338-440a-90f5-69820a020453 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:39.333736 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-7b821180-48ea-44f7-b247-259140936659 req-d547f52c-b219-486a-a76f-8543a377e492 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Neutron deleted interface a55473db-0338-440a-90f5-69820a020453; detaching it from the instance and deleting it from the info cache
May 28 03:04:39.337671 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b821180-48ea-44f7-b247-259140936659 req-d547f52c-b219-486a-a76f-8543a377e492 service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Detach interface failed, port_id=a55473db-0338-440a-90f5-69820a020453, reason: Instance 7edf7fdf-a897-456a-b47a-0e6154035b35 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:39.343303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.794s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:39.346485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 2.569s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:39.359318 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:39.359938 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:04:39.363360 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:04:39.363360 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:39.414110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:39.414607 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=12488MB free_disk=74.23920822143555GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:04:39.414821 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:39.444680 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Deleted allocations for instance 60a15beb-a3bc-4d0f-8437-21699f6c76ca
May 28 03:04:39.532835 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:39.533074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:39.570215 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Booting with volume f9248077-253b-40f9-be56-ac1428bf3fa0 at /dev/vdc
May 28 03:04:39.591685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] Releasing lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:39.591894 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c05876c0-61a4-4a69-8499-6b34a7eea7c2 req-d2f25c78-599a-4e2a-8151-aee726d5e48d service nova] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Received event network-vif-deleted-f9adc971-3eb4-406b-a255-ec3252953d28 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:39.628125 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:39.641860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:04:39.667110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:39.720082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:04:39.720807 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:04:39.734875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:04:39.736398 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fed6:5beb', 'fe80::b0a6:2aff:fe54:9aff', 'fe80::fc16:3eff:fec3:f940', 'fe80::5468:50ff:fe76:8aea', 'fe80::fc16:3eff:fe10:201', 'fe80::fc16:3eff:fe82:1863', 'fe80::fc16:3eff:fe5f:665d', 'fe80::749f:ecff:fe28:1f33', 'fe80::fc16:3eff:feec:c2ea'] 
May 28 03:04:39.736591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:04:39.736671 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:04:39.736898 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:39.737189 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating existing volume attachment record: 8fa672c9-8522-4f99-a41f-ab6fc195c733 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:04:39.788455 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c77f07f-d385-46ab-98b2-9b7bbdc6bc8f tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 60a15beb-a3bc-4d0f-8437-21699f6c76ca] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:39.975364 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:39.975364 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:39.975364 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No VIF found with MAC fa:16:3e:32:c0:16, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:04:39.975364 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Using config drive
May 28 03:04:40.036763 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:04:40.283565 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:40.416763 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:40.416943 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:40.453689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6192be35-2351-4972-b8bd-9819dca1d55f tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Lock "60a15beb-a3bc-4d0f-8437-21699f6c76ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.372s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:40.479860 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:40.603118 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Creating config drive at /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk.config
May 28 03:04:40.608714 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2i2qd_ge {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:40.630931 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:40.666702 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2i2qd_ge" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:40.786192 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Took 3.93 seconds to deallocate network for instance.
May 28 03:04:40.921250 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:40.973770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a99bbfab-552b-4f89-a63f-670216b7f85c req-a30b5203-0766-4e32-95b1-dcbcb5acacee service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-deleted-ae84a137-be40-4ec5-a4f5-587338742734 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:40.977895 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a99bbfab-552b-4f89-a63f-670216b7f85c req-a30b5203-0766-4e32-95b1-dcbcb5acacee service nova] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Received event network-vif-deleted-a3f51ea2-4c87-49da-a163-417ce20a5efd {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:41.092258 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:41.123297 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:41.238460 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:41.441477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:41.501919 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:41.501919 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:41.535774 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:41.930518 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.584s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:41.932572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.203s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:41.975613 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937481.975237, 6aeff63a-cb33-4923-91c2-08b7756e9a0c => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:41.975994 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] VM Started (Lifecycle Event)
May 28 03:04:42.480247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:42.483021 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Took 1.70 seconds to detach 3 volumes for instance.
May 28 03:04:42.484815 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937482.484347, 6aeff63a-cb33-4923-91c2-08b7756e9a0c => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:42.485007 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] VM Paused (Lifecycle Event)
May 28 03:04:42.539902 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9860a39d-bdb0-4821-be76-5726b86971f6 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Get console output
May 28 03:04:42.621383 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:42.624798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:42.637158 np0000001589 nova-compute[98297]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 03:04:42.645679 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Deleted allocation for migration 7e2fb5d5-0ac5-4439-bd80-a11cf3aad18b
May 28 03:04:42.712917 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:42.713067 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:42.989607 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:42.994587 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:42.995589 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:43.035957 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-vif-plugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:43.037063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:43.037331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:43.037520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:43.037683 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Processing event network-vif-plugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:04:43.038023 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-vif-plugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:43.038881 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:04:43.038881 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:43.038881 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:43.039028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:43.039243 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] No waiting events found dispatching network-vif-plugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:43.039427 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f7f2026b-6322-45e7-8853-86343f9f2360 req-e2a32dd9-3458-4c49-9d44-cd81fc106f69 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received unexpected event network-vif-plugged-720e400f-ae4a-4fab-a504-d914c0ad1119 for instance with vm_state building and task_state spawning.
May 28 03:04:43.043934 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:04:43.045912 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Instance spawned successfully.
May 28 03:04:43.046433 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:04:43.153927 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7476f595-29e8-40bb-bd41-4a6c10379e0e tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 9.687s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:43.217726 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:43.326682 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004481630001009762 future=<Future at 0x7e4b40517d70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:43.326682 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:43.326855 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.5608621309997943 future=<Future at 0x7e4b404001d0 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:43.326855 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.5607920420000028 future=<Future at 0x7e4b404001d0 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:43.326961 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:43.327012 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.771963816000152 future=<Future at 0x7e4b40583320 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:43.327090 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.771869461000051 future=<Future at 0x7e4b40583320 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:43.328058 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Emitting event <LifecycleEvent: 1779937468.3260064, e5117e69-981a-42a7-9fdb-c5fb550fe5b9 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:43.328308 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] VM Stopped (Lifecycle Event)
May 28 03:04:43.439657 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:43.498139 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:04:43.498695 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937483.4984288, 6aeff63a-cb33-4923-91c2-08b7756e9a0c => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:43.498927 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] VM Resumed (Lifecycle Event)
May 28 03:04:43.554255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:43.554255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:43.554255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:43.554255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:43.554255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:43.554255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:04:43.725558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.795s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:43.728789 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 4.311s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:43.783787 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Deleted allocations for instance 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de
May 28 03:04:43.830865 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: e5117e69-981a-42a7-9fdb-c5fb550fe5b9] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:44.001634 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:44.003524 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:04:44.061296 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Took 7.97 seconds to spawn the instance on the hypervisor.
May 28 03:04:44.061296 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:44.505875 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:04:44.570305 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Took 14.10 seconds to build instance.
May 28 03:04:44.792480 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:04:44.792659 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ad211867-f4ec-4773-bca9-5383cde1e916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:04:44.792729 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ada45e15-d8ee-4ad0-b222-30f543ee7089 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:04:44.792837 np0000001589 nova-compute[98297]: WARNING nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7edf7fdf-a897-456a-b47a-0e6154035b35 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 28 03:04:44.792923 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 185fd29d-4f07-4f32-8674-c734cdccc83d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:04:44.793017 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 9d7ee143-ce2c-4b61-952a-87eab2cf22bb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:04:44.793164 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance f0381f84-64fa-4a31-862b-b4feb19c1713 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:04:44.793210 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:04:44.794458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b640173-561f-4a2a-afa8-48ccdc3e1e72 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.097s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:45.072306 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.615s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:45.296317 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 03:04:45.798677 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 4a5225e8-8a5f-4192-91ac-513d048c59eb has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 03:04:45.798844 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:04:45.799014 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1920MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:04:39 up 32 min,  2 users,  load average: 7.34, 5.80, 3.01\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '7', 'num_proj_4d2ef1b6a03d428d94b2072c01964b49': '2', 'io_workload': '1', 'num_proj_ea07081265c14a80b849530dbb4de34a': '3', 'num_proj_6a0972fc130247a8b4956e1141cf7aaa': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_e00f74b8638345979e76606cba0149ce': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:04:45.936869 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-changed-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:45.937026 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Refreshing instance network info cache due to event network-changed-720e400f-ae4a-4fab-a504-d914c0ad1119. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:45.937258 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] Acquiring lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:45.937379 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] Acquired lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:45.937549 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Refreshing network info cache for port 720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:46.026264 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:46.026927 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:46.027159 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:46.027385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:46.027607 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:46.030281 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Terminating instance
May 28 03:04:46.304410 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:46.304841 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:46.439510 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:46.533482 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:04:46.576786 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.579647 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.606732 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.742682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.768285 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.775347 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.809853 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:46.843454 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:46.866776 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.874408 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:46.899099 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999753774000055 future=<Future at 0x7e4b406355b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:46.902354 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-218cfa61-8c6b-45eb-87f0-ae775e0e10c2 req-c857b1d0-b9d4-418d-a9d5-1528a83f3bbe service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-vif-unplugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:46.903564 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-218cfa61-8c6b-45eb-87f0-ae775e0e10c2 req-c857b1d0-b9d4-418d-a9d5-1528a83f3bbe service nova] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:46.903753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-218cfa61-8c6b-45eb-87f0-ae775e0e10c2 req-c857b1d0-b9d4-418d-a9d5-1528a83f3bbe service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:46.903877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-218cfa61-8c6b-45eb-87f0-ae775e0e10c2 req-c857b1d0-b9d4-418d-a9d5-1528a83f3bbe service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:46.904009 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-218cfa61-8c6b-45eb-87f0-ae775e0e10c2 req-c857b1d0-b9d4-418d-a9d5-1528a83f3bbe service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] No waiting events found dispatching network-vif-unplugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:46.904310 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-218cfa61-8c6b-45eb-87f0-ae775e0e10c2 req-c857b1d0-b9d4-418d-a9d5-1528a83f3bbe service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-vif-unplugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:46.904622 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Instance destroyed successfully.
May 28 03:04:46.905657 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'resources' on Instance uuid 185fd29d-4f07-4f32-8674-c734cdccc83d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:47.033297 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Updated VIF entry in instance network info cache for port 720e400f-ae4a-4fab-a504-d914c0ad1119. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:47.033681 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Updating instance_info_cache with network_info: [{"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:47.318821 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:04:47.319259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.593s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:47.319400 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 6.690s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:47.319700 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:04:47.323552 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:04:47.323694 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Claim successful on node np0000001589
May 28 03:04:47.408473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-69400073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-69400073',id=18,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-w849yn0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:46Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=185fd29d-4f07-4f32-8674-c734cdccc83d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:47.408684 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "address": "fa:16:3e:82:18:63", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap035de3fc-4c", "ovs_interfaceid": "035de3fc-4c7f-44d7-bf09-c7148e66f70a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:47.409324 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:18:63,bridge_name='br-int',has_traffic_filtering=True,id=035de3fc-4c7f-44d7-bf09-c7148e66f70a,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035de3fc-4c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:47.409555 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:18:63,bridge_name='br-int',has_traffic_filtering=True,id=035de3fc-4c7f-44d7-bf09-c7148e66f70a,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035de3fc-4c') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:47.412605 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:47.412605 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap035de3fc-4c, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:47.412878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:47.413840 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:47.414551 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:47.414823 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6716d05f-ca84-482d-b372-2891708e50f7) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:47.415354 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:47.416312 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:47.416312 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:47.417654 np0000001589 nova-compute[98297]: INFO os_vif [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:18:63,bridge_name='br-int',has_traffic_filtering=True,id=035de3fc-4c7f-44d7-bf09-c7148e66f70a,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap035de3fc-4c')
May 28 03:04:47.417933 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Deleting instance files /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d_del
May 28 03:04:47.418818 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Deletion of /opt/stack/data/nova/instances/185fd29d-4f07-4f32-8674-c734cdccc83d_del complete
May 28 03:04:47.535823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-96d5e443-2ee7-45ca-b65f-3761e7b07a0f req-5424069b-1c25-45bc-992e-acce96ba860c service nova] Releasing lock "refresh_cache-6aeff63a-cb33-4923-91c2-08b7756e9a0c" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:47.623639 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:47.927373 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 03:04:47.930744 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:04:47.931273 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:04:47.931856 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:04:47.932293 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:48.032393 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:48.069665 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:48.305047 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-34cefc69-5550-4f20-bc1e-d9038adc3746 req-71de59dc-b02b-435b-b946-2453436ac6aa service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-vif-deleted-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:48.305213 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-34cefc69-5550-4f20-bc1e-d9038adc3746 req-71de59dc-b02b-435b-b946-2453436ac6aa service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Neutron deleted interface 035de3fc-4c7f-44d7-bf09-c7148e66f70a; detaching it from the instance and deleting it from the info cache
May 28 03:04:48.310144 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-34cefc69-5550-4f20-bc1e-d9038adc3746 req-71de59dc-b02b-435b-b946-2453436ac6aa service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Detach interface failed, port_id=035de3fc-4c7f-44d7-bf09-c7148e66f70a, reason: Instance 185fd29d-4f07-4f32-8674-c734cdccc83d could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:48.753112 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:48.845869 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:48.846143 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:48.968137 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5b2ea3af-1943-4927-a48d-578d32e98a93 req-8c62203d-010b-4fc5-83d5-694f19d32253 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-vif-unplugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:48.968380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5b2ea3af-1943-4927-a48d-578d32e98a93 req-8c62203d-010b-4fc5-83d5-694f19d32253 service nova] Acquiring lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:48.968542 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5b2ea3af-1943-4927-a48d-578d32e98a93 req-8c62203d-010b-4fc5-83d5-694f19d32253 service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:48.968687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5b2ea3af-1943-4927-a48d-578d32e98a93 req-8c62203d-010b-4fc5-83d5-694f19d32253 service nova] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:48.968813 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5b2ea3af-1943-4927-a48d-578d32e98a93 req-8c62203d-010b-4fc5-83d5-694f19d32253 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] No waiting events found dispatching network-vif-unplugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:48.968940 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5b2ea3af-1943-4927-a48d-578d32e98a93 req-8c62203d-010b-4fc5-83d5-694f19d32253 service nova] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Received event network-vif-unplugged-035de3fc-4c7f-44d7-bf09-c7148e66f70a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:49.256951 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Took 1.33 seconds to deallocate network for instance.
May 28 03:04:49.314191 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:49.315405 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:04:49.315405 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 38.82 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:04:49.349005 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:49.762386 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:49.854861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.536s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:49.855391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 8.414s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:49.856698 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:04:49.858596 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'pci_requests' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:49.876836 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:50.099848 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0008485109999583074 future=<Future at 0x7e4b40583320 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:50.101168 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] Emitting event <LifecycleEvent: 1779937475.0989003, 7edf7fdf-a897-456a-b47a-0e6154035b35 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:50.101168 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:50.101168 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.001339368999879298 future=<Future at 0x7e4b40552ed0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:50.101168 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0014883149999604939 future=<Future at 0x7e4b40552ed0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:50.101168 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:50.101168 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.797794989000067 future=<Future at 0x7e4b406355b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:50.101168 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.79769985200005 future=<Future at 0x7e4b406355b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:50.104730 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Emitting event <LifecycleEvent: 1779937475.0993218, 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:50.104730 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] VM Stopped (Lifecycle Event)
May 28 03:04:50.104816 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] VM Stopped (Lifecycle Event)
May 28 03:04:50.363659 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:50.364768 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:04:50.364980 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:04:50.365350 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:50.366784 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:50.440098 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41af6183ea4b4a668518493baf359999', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '989151e14dc44db3b75763b654bb2199', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:04:50.607895 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: 34804b4f-e2c7-43f7-b0e5-9bef6e6bf0de] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:50.608604 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] [instance: 7edf7fdf-a897-456a-b47a-0e6154035b35] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:50.868195 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:04:50.868554 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Claim successful on node np0000001589
May 28 03:04:50.870741 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:04:50.970813 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Successfully created port: 7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:04:51.381449 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:04:51.456129 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Successfully updated port: 7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:04:51.508038 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-changed-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:51.508168 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Refreshing instance network info cache due to event network-changed-7e63aace-4454-4768-9919-9a82614e388b. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:51.508345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] Acquiring lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:51.508481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] Acquired lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:51.508568 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Refreshing network info cache for port 7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:51.958341 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:52.010979 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:52.088283 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:04:52.252579 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:52.393130 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:04:52.397427 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:04:52.397779 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Creating image(s)
May 28 03:04:52.398375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:52.398527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "/opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:52.398960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "/opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:52.399461 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:52.402196 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:52.403285 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:52.417602 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:52.469146 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:52.469405 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:52.495547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:52.496318 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:52.496797 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:52.497216 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:52.501252 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:52.501815 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:52.610136 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:52.610653 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:52.636186 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:52.671170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk 1073741824" returned: 0 in 0.060s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:52.672895 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:52.672895 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:52.755350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1a8bdd89-664d-4bad-8adc-f6cf75492270 req-a3c89ee4-6e8f-4d62-ad5e-57acd42ad578 service nova] Releasing lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:52.756460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquired lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:52.756460 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:52.763293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:52.764344 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:04:52.764623 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:52.855628 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:52.856016 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Cannot resize image /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:04:52.856415 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:04:52.856590 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Ensure instance console log exists: /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:04:52.856894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:52.857139 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:52.857292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:52.973527 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:53.338268 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:04:53.481014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.626s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:53.481374 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:53.483425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 10.489s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:53.485125 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:53.486040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.723s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:53.492847 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:53.594157 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:53.598766 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Deleted allocations for instance 7edf7fdf-a897-456a-b47a-0e6154035b35
May 28 03:04:53.671389 np0000001589 nova-compute[98297]: INFO nova.network.neutron [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating port f680b933-10c8-4f0f-86e7-65aa46fd953d with attributes {'binding:host_id': 'np0000001589', 'device_owner': 'compute:nova'}
May 28 03:04:53.699120 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Updating instance_info_cache with network_info: [{"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:54.076652 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:04:54.077119 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:04:54.202502 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Releasing lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:54.202744 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Instance network_info: |[{"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:04:54.204189 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Start _get_guest_xml network_info=[{"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:04:54.207712 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:04:54.208898 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1091621589', uuid='4a5225e8-8a5f-4192-91ac-513d048c59eb'), owner=OwnerMeta(userid='41af6183ea4b4a668518493baf359999', username='tempest-AttachVolumeTestJSON-695798121-project-member', projectid='989151e14dc44db3b75763b654bb2199', projectname='tempest-AttachVolumeTestJSON-695798121'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937494.2085814) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:04:54.209707 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:04:54.210076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:04:54.210828 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:04:54.211059 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:04:54.211927 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:04:54.212303 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:04:54.212526 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:04:54.212644 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:04:54.212835 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:04:54.212953 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:04:54.213093 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:04:54.213280 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:04:54.213441 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:04:54.213637 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:04:54.213866 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:04:54.214092 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:04:54.227736 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1091621589',display_name='tempest-AttachVolumeTestJSON-server-1091621589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-1091621589',id=24,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlF0XXl20zPLD7Ond0vj+wiN0ftezGjLzoeyQXL6qliOZBs9ZQvSBFaFzyAFJsFFZxgxHnWqtk/CxWshyOKJU/PWdG5NZ8ojPEukWlwcO4HT10Wj3c4fpcH0PwD0vc51A==',key_name='tempest-keypair-1760421558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-hg01y9qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=4a5225e8-8a5f-4192-91ac-513d048c59eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:04:54.227938 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:54.228520 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:c8:6d,bridge_name='br-int',has_traffic_filtering=True,id=7e63aace-4454-4768-9919-9a82614e388b,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e63aace-44') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:54.229053 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:54.579750 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:04:54.608879 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9a99cff6-ebb6-42c4-a30d-8d6c02d3f2f4 tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Lock "7edf7fdf-a897-456a-b47a-0e6154035b35" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 22.025s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:54.736433 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] End _get_guest_xml xml=<domain type="qemu">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <uuid>4a5225e8-8a5f-4192-91ac-513d048c59eb</uuid>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <name>instance-00000018</name>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeTestJSON-server-1091621589</nova:name>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:04:54</nova:creationTime>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:user uuid="41af6183ea4b4a668518493baf359999">tempest-AttachVolumeTestJSON-695798121-project-member</nova:user>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:project uuid="989151e14dc44db3b75763b654bb2199">tempest-AttachVolumeTestJSON-695798121</nova:project>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         <nova:port uuid="7e63aace-4454-4768-9919-9a82614e388b">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <system>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <entry name="serial">4a5225e8-8a5f-4192-91ac-513d048c59eb</entry>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <entry name="uuid">4a5225e8-8a5f-4192-91ac-513d048c59eb</entry>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </system>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <os>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   </os>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <features>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   </features>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   <devices>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk.config"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </disk>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:29:c8:6d"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <target dev="tap7e63aace-44"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </interface>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/console.log" append="off"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </serial>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <video>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </video>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </rng>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:   </devices>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]: </domain>
May 28 03:04:54.736433 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:04:54.738270 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Preparing to wait for external event network-vif-plugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:04:54.738270 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:54.738270 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:54.738270 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:54.738575 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1091621589',display_name='tempest-AttachVolumeTestJSON-server-1091621589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-1091621589',id=24,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlF0XXl20zPLD7Ond0vj+wiN0ftezGjLzoeyQXL6qliOZBs9ZQvSBFaFzyAFJsFFZxgxHnWqtk/CxWshyOKJU/PWdG5NZ8ojPEukWlwcO4HT10Wj3c4fpcH0PwD0vc51A==',key_name='tempest-keypair-1760421558',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-hg01y9qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=4a5225e8-8a5f-4192-91ac-513d048c59eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:04:54.739866 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:54.740710 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:c8:6d,bridge_name='br-int',has_traffic_filtering=True,id=7e63aace-4454-4768-9919-9a82614e388b,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e63aace-44') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:54.741124 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c8:6d,bridge_name='br-int',has_traffic_filtering=True,id=7e63aace-4454-4768-9919-9a82614e388b,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e63aace-44') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:04:54.741899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:54.741899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:54.741899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:04:54.743244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:54.743244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74bc3317-9bf5-5180-9b6d-cf7f5c4c2c0b', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:54.743880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:54.744622 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:54.745175 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:54.748667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:54.748667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e63aace-44, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:54.748667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e63aace-44, col_values=(('qos', UUID('2bb3171f-ccf8-4c0d-9e0b-336b7c08b344')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:54.748667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e63aace-44, col_values=(('external_ids', {'iface-id': '7e63aace-4454-4768-9919-9a82614e388b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:c8:6d', 'vm-uuid': '4a5225e8-8a5f-4192-91ac-513d048c59eb'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:54.750198 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:54.750198 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:54.754647 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:54.755506 np0000001589 nova-compute[98297]: INFO os_vif [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:c8:6d,bridge_name='br-int',has_traffic_filtering=True,id=7e63aace-4454-4768-9919-9a82614e388b,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e63aace-44')
May 28 03:04:54.959972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:54.960068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquired lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:54.960243 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:04:55.017748 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:55.017748 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing instance network info cache due to event network-changed-f680b933-10c8-4f0f-86e7-65aa46fd953d. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:04:55.017748 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] Acquiring lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:04:55.088030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.603s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:55.178375 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Deleted allocations for instance 185fd29d-4f07-4f32-8674-c734cdccc83d
May 28 03:04:55.200527 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:55.463242 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:55.841762 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:55.992556 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:56.191627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c1979bfe-4a3a-4458-9e30-24329b4c86bf tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "185fd29d-4f07-4f32-8674-c734cdccc83d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.164s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:56.275934 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:56.276179 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:04:56.276179 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No VIF found with MAC fa:16:3e:29:c8:6d, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:04:56.276572 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Using config drive
May 28 03:04:56.494494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Releasing lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:56.495596 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:04:56.496006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] Acquired lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:04:56.496283 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Refreshing network info cache for port f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:04:56.497831 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Creating image(s)
May 28 03:04:56.498437 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:56.498618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:56.500419 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:56.500419 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:56.717043 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:56.717376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:56.717741 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:56.718018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:56.718161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:56.720821 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Terminating instance
May 28 03:04:56.783375 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:56.969953 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Creating config drive at /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk.config
May 28 03:04:56.976056 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzb4b3083 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:57.002880 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:57.007236 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<2f113470-8b6b-4ddc-b8c8-7f3cfa95803f> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:57.009350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "121f715598475bcd2559dff9acba38e980894d94" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:57.011613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "121f715598475bcd2559dff9acba38e980894d94" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:57.030026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzb4b3083" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:57.227478 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:04:57.265025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:57.295977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:57.483673 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:57.488268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:57.497049 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:57.502900 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4dd755e9-05aa-4626-941a-d57cb809bed0 req-e373595a-7381-4c83-a489-879e765130ae service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:57.504178 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4dd755e9-05aa-4626-941a-d57cb809bed0 req-e373595a-7381-4c83-a489-879e765130ae service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:57.504411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4dd755e9-05aa-4626-941a-d57cb809bed0 req-e373595a-7381-4c83-a489-879e765130ae service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:57.504601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4dd755e9-05aa-4626-941a-d57cb809bed0 req-e373595a-7381-4c83-a489-879e765130ae service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:57.504783 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4dd755e9-05aa-4626-941a-d57cb809bed0 req-e373595a-7381-4c83-a489-879e765130ae service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:57.504967 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4dd755e9-05aa-4626-941a-d57cb809bed0 req-e373595a-7381-4c83-a489-879e765130ae service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:57.637851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:57.773115 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updated VIF entry in instance network info cache for port f680b933-10c8-4f0f-86e7-65aa46fd953d. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:04:57.773493 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:04:57.828910 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999621519999891 future=<Future at 0x7e4b4052fe00 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:04:57.833505 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Instance destroyed successfully.
May 28 03:04:57.833505 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'resources' on Instance uuid ada45e15-d8ee-4ad0-b222-30f543ee7089 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:57.839525 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:57.882559 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:57.982950 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.219756 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:58.224848 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:58.224848 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:58.257169 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.263952 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.271057 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.277077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c08ac38e-1fc4-4116-b1e1-7073ecd7f8a5 req-27775319-6735-4634-b3b1-3979b612b9ea service nova] Releasing lock "refresh_cache-2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:04:58.293338 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.300580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.338188 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1530392760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-1530392760',id=13,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:14Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-q26dj0rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:03:21Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=ada45e15-d8ee-4ad0-b222-30f543ee7089,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:04:58.339373 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "address": "fa:16:3e:10:02:01", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34e756fe-3a", "ovs_interfaceid": "34e756fe-3ab6-4283-b1fb-dd1682f398c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:04:58.341265 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:04:58.341265 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:04:58.342537 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.342792 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34e756fe-3a, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:58.346536 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.347972 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:58.349629 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:04:58.349795 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=695ce4d8-3e7a-437a-845f-2ef8d5efa750) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:04:58.351090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.part --force-share --output=json" returned: 0 in 0.126s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:58.351794 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:04:58.352729 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] 9edb83a3-a56b-42e2-9ac8-94d7eacc68f9 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:04:58.354363 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:04:58.356909 np0000001589 nova-compute[98297]: INFO os_vif [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:02:01,bridge_name='br-int',has_traffic_filtering=True,id=34e756fe-3ab6-4283-b1fb-dd1682f398c3,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34e756fe-3a')
May 28 03:04:58.356909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.part /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:58.373774 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:04:58.373774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:04:58.373774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:04:58.374732 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:04:58.375581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '827eac3f-e35b-4ade-a140-b62fff706262', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:04:58.376077 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:04:58.404458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:58.404458 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:58.404458 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:58.404458 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:58.404458 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:58.404458 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:58.404458 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:04:58.405103 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:58.405103 np0000001589 nova-compute[98297]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262 (non-flash)
May 28 03:04:58.405103 np0000001589 nova-compute[98297]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:58.405103 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:04:58.405103 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:58.405103 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:04:58.405103 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:04:58.406880 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:04:58.406880 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '27')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:58.406880 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262', '28')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:04:58.408343 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b781e4540>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'): ({'sdi'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:04:58.408885 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Removing multipathed devices sdi, sdh {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:04:58.409332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Flush multipath device 330000000b6978475 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:04:58.445704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:58.494924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:04:58.533004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.part /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.converted" returned: 0 in 0.176s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:58.537545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:04:58.538564 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:04:58.540876 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:04:58.548800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:58.567269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:04:58.567269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:04:58.585211 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:58.620962 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.40.100,3260]
May 28 03:04:58.620962 np0000001589 nova-compute[98297]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.40.100,3260] successful.
May 28 03:04:58.620962 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:58.640154 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:58.649076 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94.converted --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:58.649983 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "121f715598475bcd2559dff9acba38e980894d94" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.639s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:58.650615 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:58.655763 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:58.656539 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:58.658658 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:58.688949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.50.100,3260]
May 28 03:04:58.688949 np0000001589 nova-compute[98297]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-827eac3f-e35b-4ade-a140-b62fff706262, portal: 192.168.50.100,3260] successful.
May 28 03:04:58.688949 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:58.703578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:04:58.703926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:04:58.704084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] <== disconnect_volume: return (331ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:04:58.704239 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:04:58.704592 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Deleting instance files /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089_del
May 28 03:04:58.705091 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Deletion of /opt/stack/data/nova/instances/ada45e15-d8ee-4ad0-b222-30f543ee7089_del complete
May 28 03:04:58.746411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94 --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:58.746926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "121f715598475bcd2559dff9acba38e980894d94" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:58.747987 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "121f715598475bcd2559dff9acba38e980894d94" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:58.748582 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:58.752339 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:04:58.752790 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:58.796359 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937498.7939796, 4a5225e8-8a5f-4192-91ac-513d048c59eb => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:58.796714 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] VM Started (Lifecycle Event)
May 28 03:04:58.840041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94 --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:58.840554 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94,backing_fmt=raw /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:58.894972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94,backing_fmt=raw /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk 1073741824" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:58.894972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "121f715598475bcd2559dff9acba38e980894d94" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.147s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:58.895463 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:58.946936 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:58.947170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:58.985151 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/121f715598475bcd2559dff9acba38e980894d94 --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:58.985604 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'migration_context' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:04:59.212387 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Took 1.99 seconds to destroy the instance on the hypervisor.
May 28 03:04:59.213411 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:04:59.213763 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:04:59.213910 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:04:59.214406 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:59.299898 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:59.304139 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937499.3025708, 4a5225e8-8a5f-4192-91ac-513d048c59eb => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:59.304139 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] VM Paused (Lifecycle Event)
May 28 03:04:59.335837 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:04:59.449216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:04:59.489248 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<2f113470-8b6b-4ddc-b8c8-7f3cfa95803f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:04:59.489248 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Rebasing disk image.
May 28 03:04:59.489248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:59.583150 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:04:59.583709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a -F raw /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:04:59.616724 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Acquiring lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] No waiting events found dispatching network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-unplugged-34e756fe-3ab6-4283-b1fb-dd1682f398c3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-vif-plugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:59.619475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:59.619680 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Processing event network-vif-plugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:04:59.619680 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-vif-plugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:59.619872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:04:59.619978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:04:59.620107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:04:59.620253 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] No waiting events found dispatching network-vif-plugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:04:59.620388 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d7a76b7c-ab1f-40da-9292-30947d7c66ec req-fc435fec-7af8-4cb7-8348-6e667652a11d service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received unexpected event network-vif-plugged-7e63aace-4454-4768-9919-9a82614e388b for instance with vm_state building and task_state spawning.
May 28 03:04:59.620950 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:04:59.623660 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56754aa3-9a4f-45a7-aaa4-faa9f69b2495 req-22f31c78-818a-4a70-bc7c-7d3b2b9e0bc4 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Received event network-vif-deleted-34e756fe-3ab6-4283-b1fb-dd1682f398c3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:04:59.623846 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-56754aa3-9a4f-45a7-aaa4-faa9f69b2495 req-22f31c78-818a-4a70-bc7c-7d3b2b9e0bc4 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Neutron deleted interface 34e756fe-3ab6-4283-b1fb-dd1682f398c3; detaching it from the instance and deleting it from the info cache
May 28 03:04:59.625255 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56754aa3-9a4f-45a7-aaa4-faa9f69b2495 req-22f31c78-818a-4a70-bc7c-7d3b2b9e0bc4 service nova] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Detach interface failed, port_id=34e756fe-3ab6-4283-b1fb-dd1682f398c3, reason: Instance ada45e15-d8ee-4ad0-b222-30f543ee7089 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:04:59.627069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:04:59.629537 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Instance spawned successfully.
May 28 03:04:59.629881 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:04:59.806414 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:04:59.807997 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937499.8077538, 4a5225e8-8a5f-4192-91ac-513d048c59eb => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:04:59.808166 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] VM Resumed (Lifecycle Event)
May 28 03:05:00.031868 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:00.032155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:00.036797 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:05:00.037022 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Claim successful on node np0000001589
May 28 03:05:00.068020 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:00.139588 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:00.140303 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:00.141198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:00.141402 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:00.142099 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:00.142298 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:00.310752 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:00.314518 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:05:00.562393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a -F raw /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk" returned: 0 in 0.979s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:00.562872 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:05:00.563136 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Ensure instance console log exists: /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:05:00.563487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:00.563704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:00.563897 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:00.566948 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Start _get_guest_xml network_info=[{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='497be40cb540c96ee1f4de17675ee6c2',container_format='bare',created_at=2026-05-28T03:04:21Z,direct_url=<?>,disk_format='qcow2',id=9edb83a3-a56b-42e2-9ac8-94d7eacc68f9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1883072808-shelved',owner='c470ae60a73f43d183ba78fe4ed0d29b',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T03:04:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '8fa672c9-8522-4f99-a41f-ab6fc195c733', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '2f113470-8b6b-4ddc-b8c8-7f3cfa95803f', 'attached_at': '', 'detached_at': '', 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'serial': 'f9248077-253b-40f9-be56-ac1428bf3fa0'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:05:00.568886 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:05:00.570612 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1883072808', uuid='2f113470-8b6b-4ddc-b8c8-7f3cfa95803f'), owner=OwnerMeta(userid='84aa869713da4347914ce6054de5ea1e', username='tempest-AttachVolumeShelveTestJSON-653410335-project-member', projectid='c470ae60a73f43d183ba78fe4ed0d29b', projectname='tempest-AttachVolumeShelveTestJSON-653410335'), image=ImageMeta(id='9edb83a3-a56b-42e2-9ac8-94d7eacc68f9', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937500.570103) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:05:00.571372 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Took 1.36 seconds to deallocate network for instance.
May 28 03:05:00.574682 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:05:00.575399 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:05:00.576754 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:05:00.576993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:05:00.578100 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:05:00.578476 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='497be40cb540c96ee1f4de17675ee6c2',container_format='bare',created_at=2026-05-28T03:04:21Z,direct_url=<?>,disk_format='qcow2',id=9edb83a3-a56b-42e2-9ac8-94d7eacc68f9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1883072808-shelved',owner='c470ae60a73f43d183ba78fe4ed0d29b',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-28T03:04:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:05:00.578681 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:05:00.578828 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:05:00.579024 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:05:00.580161 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:05:00.580161 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:05:00.580161 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:05:00.580161 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:05:00.580161 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:05:00.580161 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:05:00.580445 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:05:00.580614 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:00.649104 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Took 8.25 seconds to spawn the instance on the hypervisor.
May 28 03:05:00.649539 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:00.818859 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:05:01.082755 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<2f113470-8b6b-4ddc-b8c8-7f3cfa95803f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:05:01.092769 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:05:01.093111 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:01.093263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:01.093599 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:01.093786 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:05:01.114038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:01.114038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:01.114421 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:01.114546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:01.115696 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:01.115696 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:01.131664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:01.131664 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:01.131664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:01.131664 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:01.144041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0] added
May 28 03:05:01.144041 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:01.144041 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:01.144041 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:01.144041 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:01.144041 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:01.144041 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:01.144433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:01.144433 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:01.144534 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:01.150762 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0] added
May 28 03:05:01.150762 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:01.150762 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:01.150762 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:01.150762 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:01.150762 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:01.150762 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:01.151103 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:01.151103 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:01.151723 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:01.160283 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Took 20.61 seconds to build instance.
May 28 03:05:01.161856 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Took 0.59 seconds to detach 1 volumes for instance.
May 28 03:05:01.163822 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Deleting volume: 827eac3f-e35b-4ade-a140-b62fff706262 {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:05:01.666404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b888fd4-88a4-4579-a8a8-e4785d3e6b31 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:01.670418 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:01.670750 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:01.714621 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:01.899283 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004058360000271932 future=<Future at 0x7e4b406355b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:01.899650 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Emitting event <LifecycleEvent: 1779937486.898761, 185fd29d-4f07-4f32-8674-c734cdccc83d => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:01.899810 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:01.900010 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] VM Stopped (Lifecycle Event)
May 28 03:05:01.901077 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.927468753999847 future=<Future at 0x7e4b4052fe00 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:01.901180 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.927309895999997 future=<Future at 0x7e4b4052fe00 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:02.146140 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:02.152459 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:02.161961 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:02.161961 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:02.167651 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:02.167651 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.174214 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:02.179885 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.180619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsi session list stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.193219 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:02.199924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.199924 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.199924 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.199924 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.199924 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:02.200411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsi session list stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.200411 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.200411 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.200411 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.200411 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:02.226663 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.40.100,3260]
May 28 03:05:02.226663 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.40.100,3260] successful.
May 28 03:05:02.226663 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.235130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.50.100,3260]
May 28 03:05:02.235130 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.50.100,3260] successful.
May 28 03:05:02.235130 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.241036 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.248026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:02.257899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.257899 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.257899 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.257899 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.257899 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.257899 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.257899 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:02.258288 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsi session list stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.258288 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.258288 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.258288 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.258288 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.258288 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.258288 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:02.258514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:02.258514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:02.259325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] HCTL ('8', '-', '-', 0) found on session 57 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:02.259458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:02.264913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.264913 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.264913 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.264913 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.264913 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.264913 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.264913 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:02.265181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsi session list stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.265181 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:02.265181 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.265181 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:02.265181 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.265181 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:02.265181 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:02.265484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:02.265775 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:02.267429 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] HCTL ('9', '-', '-', 0) found on session 58 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:02.267574 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:02.280750 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching for a device in session 57 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:02.281101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:02.284663 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching for a device in session 58 and hctl ['9', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:02.404033 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-20c708b7-be16-4ab6-a5d0-1251ffd0b5a8 tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: 185fd29d-4f07-4f32-8674-c734cdccc83d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:02.492217 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:02.638567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:02.686286 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.654s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:02.686820 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.972s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:02.687262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:05:02.741339 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-changed-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:02.741464 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Refreshing instance network info cache due to event network-changed-7e63aace-4454-4768-9919-9a82614e388b. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:05:02.741664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] Acquiring lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:05:02.741789 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] Acquired lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:05:02.741915 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Refreshing network info cache for port 7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:05:03.196455 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:05:03.196455 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:05:03.196610 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:03.196905 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:03.245490 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:03.286889 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching for a device in session 58 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:03.287259 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:03.306051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:03.306051 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:03.329024 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51c000d2ac2941a8ad517313e98a3c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38899ad6345442358b17adfcc1ba57a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:05:03.350986 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:03.662146 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:03.701154 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:05:03.780739 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:03.780947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:03.781183 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:03.781380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:03.781649 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:03.784557 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Terminating instance
May 28 03:05:03.809640 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:03.901761 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Successfully created port: 75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:05:03.907757 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Updated VIF entry in instance network info cache for port 7e63aace-4454-4768-9919-9a82614e388b. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:05:03.908002 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Updating instance_info_cache with network_info: [{"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:04.132640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Found WWN 3300000004425203b for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:05:04.132916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:04.134660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000004425203b', 'path': '/dev/dm-0', 'multipath_id': '3300000004425203b'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:04.134660 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004425203b', 'path': '/dev/dm-0', 'multipath_id': '3300000004425203b'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:05:04.205886 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:05:04.288626 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:05:04.313965 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:04.320102 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.631s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:04.336002 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:04.393328 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Deleted allocations for instance ada45e15-d8ee-4ad0-b222-30f543ee7089
May 28 03:05:04.409952 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d07c11a8-f683-48d8-9c92-c6fba2d32106 req-1ab649cb-f9ca-473f-92fb-f9cfc15fbc5f service nova] Releasing lock "refresh_cache-4a5225e8-8a5f-4192-91ac-513d048c59eb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:05:04.483505 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:04.490553 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:04.496534 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Successfully updated port: 75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:05:04.554499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:04.554499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing instance network info cache due to event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:05:04.554499 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] Acquiring lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:05:04.554499 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] Acquired lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:05:04.554499 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing network info cache for port 75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:05:04.634424 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999703946000182 future=<Future at 0x7e4b4055e420 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:04.638935 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1883072808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1883072808',id=19,image_ref='9edb83a3-a56b-42e2-9ac8-94d7eacc68f9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1874979258',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:40Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-2kvbn7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member',shelved_at='2026-05-28T03:04:27.602926',shelved_host='np0000001589',shelved_image_id='9edb83a3-a56b-42e2-9ac8-94d7eacc68f9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=2f113470-8b6b-4ddc-b8c8-7f3cfa95803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:05:04.639214 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:04.640202 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:04.642992 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Instance destroyed successfully.
May 28 03:05:04.643426 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:04.644909 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'resources' on Instance uuid 9d7ee143-ce2c-4b61-952a-87eab2cf22bb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:04.648574 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9045960f-5a5a-4051-ad94-d6fda47f79ae req-54570887-de25-4a93-9844-5927eff66c4e service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:04.650315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9045960f-5a5a-4051-ad94-d6fda47f79ae req-54570887-de25-4a93-9844-5927eff66c4e service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:04.650315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9045960f-5a5a-4051-ad94-d6fda47f79ae req-54570887-de25-4a93-9844-5927eff66c4e service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:04.650315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9045960f-5a5a-4051-ad94-d6fda47f79ae req-54570887-de25-4a93-9844-5927eff66c4e service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:04.650527 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9045960f-5a5a-4051-ad94-d6fda47f79ae req-54570887-de25-4a93-9844-5927eff66c4e service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] No waiting events found dispatching network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:04.650527 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9045960f-5a5a-4051-ad94-d6fda47f79ae req-54570887-de25-4a93-9844-5927eff66c4e service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:04.880513 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:04.998725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:05:05.057643 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:05.115752 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:05:05.147849 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<2f113470-8b6b-4ddc-b8c8-7f3cfa95803f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:05:05.149196 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] End _get_guest_xml xml=<domain type="qemu">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <uuid>2f113470-8b6b-4ddc-b8c8-7f3cfa95803f</uuid>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <name>instance-00000013</name>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1883072808</nova:name>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:05:00</nova:creationTime>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:user uuid="84aa869713da4347914ce6054de5ea1e">tempest-AttachVolumeShelveTestJSON-653410335-project-member</nova:user>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:project uuid="c470ae60a73f43d183ba78fe4ed0d29b">tempest-AttachVolumeShelveTestJSON-653410335</nova:project>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         <nova:port uuid="f680b933-10c8-4f0f-86e7-65aa46fd953d">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <system>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <entry name="serial">2f113470-8b6b-4ddc-b8c8-7f3cfa95803f</entry>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <entry name="uuid">2f113470-8b6b-4ddc-b8c8-7f3cfa95803f</entry>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </system>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <os>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   </os>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <features>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   </features>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   <devices>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </disk>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </disk>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <alias name="ua-f9248077-253b-40f9-be56-ac1428bf3fa0"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <target dev="vdc" bus="virtio"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <serial>f9248077-253b-40f9-be56-ac1428bf3fa0</serial>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </disk>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:de:6d:95"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <target dev="tapf680b933-10"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </interface>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/console.log" append="off"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </serial>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <video>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </video>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </rng>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:   </devices>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]: </domain>
May 28 03:05:05.149196 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:05:05.151257 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Preparing to wait for external event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:05:05.151257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:05.151257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:05.151257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:05.155761 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-562629376',display_name='tempest-ServerActionsTestOtherA-server-562629376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-562629376',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:31Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-vldvpmto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=9d7ee143-ce2c-4b61-952a-87eab2cf22bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:05:05.155971 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "address": "fa:16:3e:ec:c2:ea", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap655008ea-4b", "ovs_interfaceid": "655008ea-4b6e-4f49-8d26-86c4c4aff849", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:05.156534 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:05.156733 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:05:05.157896 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1883072808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1883072808',id=19,image_ref='9edb83a3-a56b-42e2-9ac8-94d7eacc68f9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1874979258',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:03:40Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-2kvbn7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member',shelved_at='2026-05-28T03:04:27.602926',shelved_host='np0000001589',shelved_image_id='9edb83a3-a56b-42e2-9ac8-94d7eacc68f9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:04:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=2f113470-8b6b-4ddc-b8c8-7f3cfa95803f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:05:05.158069 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:05.158607 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:05.158698 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:05:05.159892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:05.160145 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:05.160395 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:05:05.161110 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:05.161281 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap655008ea-4b, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:05.168694 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:05.171255 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:05.171435 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=769dfadc-43af-4fb6-99d3-96b8380a4219) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:05.173759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:05.175505 np0000001589 nova-compute[98297]: INFO os_vif [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:c2:ea,bridge_name='br-int',has_traffic_filtering=True,id=655008ea-4b6e-4f49-8d26-86c4c4aff849,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap655008ea-4b')
May 28 03:05:05.176290 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:05.176467 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f160ef6d-03ef-55d3-83ca-4be32b0eb2e2', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:05.182017 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:05:05.182931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:05.182931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:05.183087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:05.184038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:05.184038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27cefffc-a717-431f-8c2e-14173adab86d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:05:05.184038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:05:05.186842 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:05.186842 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf680b933-10, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:05.186842 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf680b933-10, col_values=(('qos', UUID('079f672f-c7be-4f02-881c-42cec490437e')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:05.186842 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf680b933-10, col_values=(('external_ids', {'iface-id': 'f680b933-10c8-4f0f-86e7-65aa46fd953d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:6d:95', 'vm-uuid': '2f113470-8b6b-4ddc-b8c8-7f3cfa95803f'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:05.187303 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:05.188187 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:05.197436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:05.200373 np0000001589 nova-compute[98297]: INFO os_vif [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10')
May 28 03:05:05.214018 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:05:05.216144 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:05:05.217527 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Creating image(s)
May 28 03:05:05.217527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:05.217527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:05.217955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:05.218600 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:05.227194 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:05.229898 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:05.229898 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:05.229898 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:05.229898 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:05.229898 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:05.229898 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:05.229898 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsi session list stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: tcp: [56] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d (non-flash)
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:05.230699 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '58')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:05:05.230699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '56')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:05.231970 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:05.253819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d', '55')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:05.255694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40547ec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'): ({'sdp'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:05:05.256050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Removing multipathed devices sdp, sds {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:05:05.256432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Flush multipath device 33000000077063afb {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:05:05.291477 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:05.313331 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:05.314688 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:05.315194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:05.315730 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:05.316212 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:05.319146 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:05.319146 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:05.371138 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:05.403502 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ed4d6aa-d2a1-435a-adfa-74a97638e218 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ada45e15-d8ee-4ad0-b222-30f543ee7089" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.686s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:05.413994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:05.414211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:05.428543 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if SCSI volumes sdp, sds have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:05:05.428847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] SCSI volumes sdp, sds have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:05:05.433874 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Checking to see if device paths {'sdp', 'sds'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:05:05.445056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Device paths {'sdp', 'sds'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:05:05.445606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:05:05.458492 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:05.472747 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk 1073741824" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:05.473207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:05.473764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:05.488183 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260]
May 28 03:05:05.488183 np0000001589 nova-compute[98297]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.40.100,3260] successful.
May 28 03:05:05.488183 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:05.503568 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:05.514655 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:05.555689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260]
May 28 03:05:05.555689 np0000001589 nova-compute[98297]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-27cefffc-a717-431f-8c2e-14173adab86d, portal: 192.168.50.100,3260] successful.
May 28 03:05:05.555689 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:05.569390 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:05.569820 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:05:05.570079 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:05.584483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:05.585611 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:05.585874 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] <== disconnect_volume: return (403ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:05.586189 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:05:05.587596 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Deleting instance files /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb_del
May 28 03:05:05.589600 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Deletion of /opt/stack/data/nova/instances/9d7ee143-ce2c-4b61-952a-87eab2cf22bb_del complete
May 28 03:05:05.667560 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:05.667904 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Cannot resize image /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:05:05.668348 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:05:05.668559 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Ensure instance console log exists: /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:05:05.668894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:05.669148 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:05.669403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:05.794461 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b79eb55f-bf51-40f0-884c-e91662a5e1c4 req-b5406652-3aea-4565-93e7-5d5767462cf8 service nova] Releasing lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:05:05.797343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquired lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:05:05.797343 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:05:06.107745 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Took 1.82 seconds to destroy the instance on the hypervisor.
May 28 03:05:06.112831 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:05:06.113177 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:05:06.113346 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:05:06.113716 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:06.190054 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:06.564547 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:05:06.687339 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c42f15a-88ba-4d03-823f-1bd8f286d47e req-10993273-9411-4757-b11f-8fec186cbf43 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-deleted-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:06.687698 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-4c42f15a-88ba-4d03-823f-1bd8f286d47e req-10993273-9411-4757-b11f-8fec186cbf43 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Neutron deleted interface 655008ea-4b6e-4f49-8d26-86c4c4aff849; detaching it from the instance and deleting it from the info cache
May 28 03:05:06.688995 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c42f15a-88ba-4d03-823f-1bd8f286d47e req-10993273-9411-4757-b11f-8fec186cbf43 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Detach interface failed, port_id=655008ea-4b6e-4f49-8d26-86c4c4aff849, reason: Instance 9d7ee143-ce2c-4b61-952a-87eab2cf22bb could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:05:06.725257 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:06.725396 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:06.725530 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:06.725671 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No VIF found with MAC fa:16:3e:de:6d:95, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:05:06.726292 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Using config drive
May 28 03:05:06.751257 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b9c1b46-dfee-4549-83d4-2acac9634927 req-2a826d4f-34af-4349-bc91-989000576369 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:06.751257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b9c1b46-dfee-4549-83d4-2acac9634927 req-2a826d4f-34af-4349-bc91-989000576369 service nova] Acquiring lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:06.751257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b9c1b46-dfee-4549-83d4-2acac9634927 req-2a826d4f-34af-4349-bc91-989000576369 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:06.751257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7b9c1b46-dfee-4549-83d4-2acac9634927 req-2a826d4f-34af-4349-bc91-989000576369 service nova] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:06.751257 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b9c1b46-dfee-4549-83d4-2acac9634927 req-2a826d4f-34af-4349-bc91-989000576369 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] No waiting events found dispatching network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:06.751257 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b9c1b46-dfee-4549-83d4-2acac9634927 req-2a826d4f-34af-4349-bc91-989000576369 service nova] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Received event network-vif-unplugged-655008ea-4b6e-4f49-8d26-86c4c4aff849 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:06.803832 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:06.973394 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:06.973677 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:06.973822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:06.974008 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:06.976249 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:06.977268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:06.980729 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Terminating instance
May 28 03:05:07.131878 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:07.229047 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'ec2_ids' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:07.480805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Releasing lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:05:07.481113 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance network_info: |[{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:05:07.483848 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Start _get_guest_xml network_info=[{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:05:07.486904 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:05:07.487626 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:05:07.489661 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-197666698', uuid='ce889453-d238-4bd1-b6b7-88c0ac65a869'), owner=OwnerMeta(userid='51c000d2ac2941a8ad517313e98a3c14', username='tempest-ServerStableDeviceRescueTest-846481241-project-member', projectid='38899ad6345442358b17adfcc1ba57a7', projectname='tempest-ServerStableDeviceRescueTest-846481241'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937507.488963) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:05:07.491858 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:05:07.492405 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:05:07.494632 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:05:07.494929 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:05:07.496440 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:05:07.496905 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:05:07.497176 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:05:07.497963 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:05:07.498492 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:05:07.499407 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:05:07.499407 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:05:07.499407 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:05:07.499407 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:05:07.499584 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:05:07.499584 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:05:07.499751 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:05:07.522016 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-197666698',display_name='tempest-ServerStableDeviceRescueTest-server-197666698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverstabledevicerescuetest-server-197666698',id=25,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Rwh/1DBZW4ET9PMngZjI2tFG3gaSx0f2my4NydSbzlpMQD8jwfKjT5W77Qn23eIfcPL8BcQtHkPU9YetpUHDmKNGmcu3YcJx8R7RTB2RK2rvUbbv49yWyj9+1boe1XQ==',key_name='tempest-keypair-1487384353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38899ad6345442358b17adfcc1ba57a7',ramdisk_id='',reservation_id='r-kj0o62kr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-846481241',owner_user_name='tempest-ServerStableDeviceRescueTest-846481241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51c000d2ac2941a8ad517313e98a3c14',uuid=ce889453-d238-4bd1-b6b7-88c0ac65a869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:05:07.522372 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converting VIF {"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:07.522772 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:07.523307 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'pci_devices' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:07.526087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:07.529586 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:07.553690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:07.556373 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:07.587801 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:07.588472 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:07.635836 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Took 1.52 seconds to deallocate network for instance.
May 28 03:05:07.643532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:07.736430 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<2f113470-8b6b-4ddc-b8c8-7f3cfa95803f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:05:07.736430 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'keypairs' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:07.825479 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99964445400019 future=<Future at 0x7e4b406c72c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:07.832433 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Instance destroyed successfully.
May 28 03:05:07.832962 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lazy-loading 'resources' on Instance uuid ad211867-f4ec-4773-bca9-5383cde1e916 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:08.027126 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] End _get_guest_xml xml=<domain type="qemu">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <uuid>ce889453-d238-4bd1-b6b7-88c0ac65a869</uuid>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <name>instance-00000019</name>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-197666698</nova:name>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:05:07</nova:creationTime>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:user uuid="51c000d2ac2941a8ad517313e98a3c14">tempest-ServerStableDeviceRescueTest-846481241-project-member</nova:user>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:project uuid="38899ad6345442358b17adfcc1ba57a7">tempest-ServerStableDeviceRescueTest-846481241</nova:project>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         <nova:port uuid="75347773-ab8a-4c09-88b9-fed091f53c27">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <system>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <entry name="serial">ce889453-d238-4bd1-b6b7-88c0ac65a869</entry>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <entry name="uuid">ce889453-d238-4bd1-b6b7-88c0ac65a869</entry>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </system>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <os>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   </os>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <features>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   </features>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   <devices>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </disk>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </disk>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:67:17:a7"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <target dev="tap75347773-ab"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </interface>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/console.log" append="off"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </serial>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <video>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </video>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </rng>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:   </devices>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]: </domain>
May 28 03:05:08.027126 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Preparing to wait for external event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-197666698',display_name='tempest-ServerStableDeviceRescueTest-server-197666698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverstabledevicerescuetest-server-197666698',id=25,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Rwh/1DBZW4ET9PMngZjI2tFG3gaSx0f2my4NydSbzlpMQD8jwfKjT5W77Qn23eIfcPL8BcQtHkPU9YetpUHDmKNGmcu3YcJx8R7RTB2RK2rvUbbv49yWyj9+1boe1XQ==',key_name='tempest-keypair-1487384353',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38899ad6345442358b17adfcc1ba57a7',ramdisk_id='',reservation_id='r-kj0o62kr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-846481241',owner_user_name='tempest-ServerStableDeviceRescueTest-846481241-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:05:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51c000d2ac2941a8ad517313e98a3c14',uuid=ce889453-d238-4bd1-b6b7-88c0ac65a869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converting VIF {"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:08.028996 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:05:08.030522 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.030850 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:08.031117 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:05:08.035465 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.036777 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e591eb0-fceb-52e6-adbe-e583d69badb4', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:08.037705 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.039458 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:08.050682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.052411 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.052623 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75347773-ab, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:08.052957 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75347773-ab, col_values=(('qos', UUID('c55699b5-5448-4996-b826-e27d713994d9')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:08.053136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75347773-ab, col_values=(('external_ids', {'iface-id': '75347773-ab8a-4c09-88b9-fed091f53c27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:17:a7', 'vm-uuid': 'ce889453-d238-4bd1-b6b7-88c0ac65a869'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:08.053972 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.055037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:08.068870 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.069672 np0000001589 nova-compute[98297]: INFO os_vif [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab')
May 28 03:05:08.200935 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Took 0.57 seconds to detach 1 volumes for instance.
May 28 03:05:08.203109 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Deleting volume: 27cefffc-a717-431f-8c2e-14173adab86d {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:05:08.239668 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<2f113470-8b6b-4ddc-b8c8-7f3cfa95803f> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:05:08.242255 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:08.337717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-129358001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverbootfromvolumestablerescuetest-server-129358001',id=12,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:02:19Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea07081265c14a80b849530dbb4de34a',ramdisk_id='',reservation_id='r-t0qwf0qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:02:30Z,user_data=None,user_id='ca35293e06644323b1379cbcfa028d87',uuid=ad211867-f4ec-4773-bca9-5383cde1e916,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:05:08.337952 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converting VIF {"id": "45ca207b-12db-4df0-9d88-83d537d0bb64", "address": "fa:16:3e:c3:f9:40", "network": {"id": "35266a00-c3eb-439e-89fc-e10345067f2f", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1507408145-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea07081265c14a80b849530dbb4de34a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ca207b-12", "ovs_interfaceid": "45ca207b-12db-4df0-9d88-83d537d0bb64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:08.338506 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f9:40,bridge_name='br-int',has_traffic_filtering=True,id=45ca207b-12db-4df0-9d88-83d537d0bb64,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ca207b-12') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:08.338734 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f9:40,bridge_name='br-int',has_traffic_filtering=True,id=45ca207b-12db-4df0-9d88-83d537d0bb64,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ca207b-12') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:05:08.340653 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.340899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45ca207b-12, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:08.342007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.342977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:08.352529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.353262 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.353487 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5dc3b699-e220-42ea-8f8e-3af63a6cb56a) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:08.354064 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.355254 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:08.363717 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.365725 np0000001589 nova-compute[98297]: INFO os_vif [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f9:40,bridge_name='br-int',has_traffic_filtering=True,id=45ca207b-12db-4df0-9d88-83d537d0bb64,network=Network(35266a00-c3eb-439e-89fc-e10345067f2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ca207b-12')
May 28 03:05:08.366038 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Deleting instance files /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916_del
May 28 03:05:08.366858 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Deletion of /opt/stack/data/nova/instances/ad211867-f4ec-4773-bca9-5383cde1e916_del complete
May 28 03:05:08.391861 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Creating config drive at /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config
May 28 03:05:08.397192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4rle76fr {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:08.451697 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4rle76fr" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:08.763904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:08.764125 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:08.876934 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:08.877182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:08.877477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:08.877617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:08.877816 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] No waiting events found dispatching network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:08.877957 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:08.878088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:08.878601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] Acquiring lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:08.878770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:08.879192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] Lock "ad211867-f4ec-4773-bca9-5383cde1e916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:08.879192 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] No waiting events found dispatching network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:08.879192 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c25634b3-b0e8-427a-a9eb-52150db205d8 req-089a9391-9fa4-4666-bdd5-34736f858f3b service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-unplugged-45ca207b-12db-4df0-9d88-83d537d0bb64 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:08.883957 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 03:05:08.884565 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:05:08.884736 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:05:08.884847 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:05:08.885875 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:08.916291 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:08.953619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:09.009951 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:09.085113 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:09.412818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:09.417960 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:09.418295 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:09.438645 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:09.443710 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:09.465911 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:09.473569 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:09.590392 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:09.590666 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:09.590841 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No VIF found with MAC fa:16:3e:67:17:a7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:05:09.592502 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Using config drive
May 28 03:05:09.617400 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:09.617586 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:09.617703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:09.617835 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:09.617936 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:09.621343 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Terminating instance
May 28 03:05:09.909592 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937509.9091036, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:09.909787 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Started (Lifecycle Event)
May 28 03:05:09.921574 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:10.099253 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:10.124762 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:05:10.163498 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:10.166134 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:10.189635 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:10.190975 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:10.228094 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:10.272754 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:10.311307 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Creating config drive at /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config
May 28 03:05:10.316354 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps4rvo1q2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:10.378846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps4rvo1q2" returned: 0 in 0.062s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:10.413298 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:10.416411 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937510.4158967, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:10.416523 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Paused (Lifecycle Event)
May 28 03:05:10.430041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.666s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:10.520829 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Deleted allocations for instance 9d7ee143-ce2c-4b61-952a-87eab2cf22bb
May 28 03:05:10.621249 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Instance destroyed successfully.
May 28 03:05:10.621249 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lazy-loading 'resources' on Instance uuid f0381f84-64fa-4a31-862b-b4feb19c1713 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:10.775966 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Took 1.89 seconds to deallocate network for instance.
May 28 03:05:10.927094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:10.930809 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:05:10.983526 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:10.985538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:10.985538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:10.985538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:10.988786 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Processing event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:05:10.990609 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:10.990609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:10.990609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:10.990609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:10.990879 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:05:10.991088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] No waiting events found dispatching network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:10.991408 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received unexpected event network-vif-plugged-f680b933-10c8-4f0f-86e7-65aa46fd953d for instance with vm_state shelved_offloaded and task_state spawning.
May 28 03:05:10.991603 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dee27226-89ca-4d97-a7a6-9ef8a5969fc6 req-d8b8d691-2c93-42b1-bb18-ab14337dc275 service nova] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Received event network-vif-deleted-45ca207b-12db-4df0-9d88-83d537d0bb64 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:11.000441 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:05:11.002787 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance spawned successfully.
May 28 03:05:11.016216 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.051863 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.054721 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.124854 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-764140910',display_name='tempest-instance-764140910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-instance-764140910',id=22,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsZyZErdaGW+a839XxQQXS3yxhGzxILmfQd7Z3yDuwRPwVUQXkBL0qpI//uzHZ7RvhHGb6Av9qDBPtQiqnv3IUmmNxL1gIXbY4pZATte20nTm2C3RuTOl5dg/QhCRY96w==',key_name='tempest-keypair-1722015577',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:30Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a0972fc130247a8b4956e1141cf7aaa',ramdisk_id='',reservation_id='r-9dipbudx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-2039328368',owner_user_name='tempest-VolumesBackupsTest-2039328368-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b9f2bdea5b14acaa744ac48348a2eac',uuid=f0381f84-64fa-4a31-862b-b4feb19c1713,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:05:11.125132 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Converting VIF {"id": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "address": "fa:16:3e:5f:66:5d", "network": {"id": "5087992a-6f74-48dd-acbc-6c94037d1443", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1944894830-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6a0972fc130247a8b4956e1141cf7aaa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapae2981b3-9f", "ovs_interfaceid": "ae2981b3-9f2c-4589-a68c-242af62e9df4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:11.126043 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:66:5d,bridge_name='br-int',has_traffic_filtering=True,id=ae2981b3-9f2c-4589-a68c-242af62e9df4,network=Network(5087992a-6f74-48dd-acbc-6c94037d1443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2981b3-9f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:11.127969 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:66:5d,bridge_name='br-int',has_traffic_filtering=True,id=ae2981b3-9f2c-4589-a68c-242af62e9df4,network=Network(5087992a-6f74-48dd-acbc-6c94037d1443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2981b3-9f') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:05:11.130419 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.130725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae2981b3-9f, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:11.132471 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.133457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:11.136731 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.136804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=917fc71c-4eee-4e17-a563-5211dd9be0ba) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:11.137524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.138858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:11.140078 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.147424 np0000001589 nova-compute[98297]: INFO os_vif [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:66:5d,bridge_name='br-int',has_traffic_filtering=True,id=ae2981b3-9f2c-4589-a68c-242af62e9df4,network=Network(5087992a-6f74-48dd-acbc-6c94037d1443),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae2981b3-9f')
May 28 03:05:11.151852 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:05:11.153031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:11.153031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:11.153031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:11.153468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '704e10fe-5a86-44ac-9b08-b34bfbe27d10', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:05:11.154364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:05:11.158252 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.189674 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:11.189674 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:11.189674 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:11.189674 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:11.189674 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:11.189893 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsi session list stdout=tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:11.189893 np0000001589 nova-compute[98297]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:11.189893 np0000001589 nova-compute[98297]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:11.189893 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:11.189893 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:11.190247 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '58')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:05:11.190604 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '54')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:11.191253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10', '53')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:11.191989 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40531f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:05:11.192212 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Removing multipathed devices sde, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:05:11.192557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Flush multipath device 330000000e155b7f2 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:05:11.246427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:11.281155 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:11.284514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:11.284704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:11.338767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Checking to see if SCSI volumes sde, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:05:11.338767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] SCSI volumes sde, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:05:11.338767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Checking to see if device paths {'sde', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:05:11.354536 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Device paths {'sde', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:05:11.354694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:05:11.372715 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:11.394791 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.433832 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.40.100,3260]
May 28 03:05:11.433832 np0000001589 nova-compute[98297]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.40.100,3260] successful.
May 28 03:05:11.433832 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:11.436609 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:05:11.437008 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999820203000127 future=<Future at 0x7e4b6467a5d0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:11.437547 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937511.437372, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:11.437698 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Resumed (Lifecycle Event)
May 28 03:05:11.452144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:11.471258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:11.504566 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.512584 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.516743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.50.100,3260]
May 28 03:05:11.516743 np0000001589 nova-compute[98297]: Logout of [sid: 53, target: iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10, portal: 192.168.50.100,3260] successful.
May 28 03:05:11.516743 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:11.534134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-66af6aac-0e7c-4a49-9e35-8fe936735349 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "9d7ee143-ce2c-4b61-952a-87eab2cf22bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.753s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:11.536980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:11.541754 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:11.542001 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:11.542601 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] <== disconnect_volume: return (389ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:11.542708 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:05:11.542972 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Deleting instance files /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713_del
May 28 03:05:11.544161 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Deletion of /opt/stack/data/nova/instances/f0381f84-64fa-4a31-862b-b4feb19c1713_del complete
May 28 03:05:11.587345 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:11.846331 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:11.846563 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:11.943453 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:11.947038 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:05:12.052812 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Took 1.93 seconds to destroy the instance on the hypervisor.
May 28 03:05:12.053367 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:05:12.053597 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:05:12.053766 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:05:12.054020 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:12.066727 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-120202ad-47cb-473e-8384-6b6894fa54e5 req-97ba823b-ba39-43b0-a9ec-f417e912b53f service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-vif-unplugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:12.069293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-120202ad-47cb-473e-8384-6b6894fa54e5 req-97ba823b-ba39-43b0-a9ec-f417e912b53f service nova] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:12.069293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-120202ad-47cb-473e-8384-6b6894fa54e5 req-97ba823b-ba39-43b0-a9ec-f417e912b53f service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:12.069293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-120202ad-47cb-473e-8384-6b6894fa54e5 req-97ba823b-ba39-43b0-a9ec-f417e912b53f service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:12.069293 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-120202ad-47cb-473e-8384-6b6894fa54e5 req-97ba823b-ba39-43b0-a9ec-f417e912b53f service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] No waiting events found dispatching network-vif-unplugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:12.069652 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-120202ad-47cb-473e-8384-6b6894fa54e5 req-97ba823b-ba39-43b0-a9ec-f417e912b53f service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-vif-unplugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:12.101527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f4d72ce6-64b4-43a1-a080-599576be6e42 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 34.048s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:12.202550 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:12.349234 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:12.450120 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937512.4498105, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:12.450572 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Started (Lifecycle Event)
May 28 03:05:12.649697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:12.743385 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1332fd62-7b6b-436e-99fb-ff319caa6114 req-fbf5a7d3-e902-49d3-8f9e-607927e5cbc9 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-vif-deleted-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:12.743541 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-1332fd62-7b6b-436e-99fb-ff319caa6114 req-fbf5a7d3-e902-49d3-8f9e-607927e5cbc9 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Neutron deleted interface ae2981b3-9f2c-4589-a68c-242af62e9df4; detaching it from the instance and deleting it from the info cache
May 28 03:05:12.744593 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1332fd62-7b6b-436e-99fb-ff319caa6114 req-fbf5a7d3-e902-49d3-8f9e-607927e5cbc9 service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Detach interface failed, port_id=ae2981b3-9f2c-4589-a68c-242af62e9df4, reason: Instance f0381f84-64fa-4a31-862b-b4feb19c1713 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:05:12.828862 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.000337318999982017 future=<Future at 0x7e4b4052fe00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:12.829489 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Emitting event <LifecycleEvent: 1779937497.8283854, ada45e15-d8ee-4ad0-b222-30f543ee7089 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:12.829692 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:12.829914 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] VM Stopped (Lifecycle Event)
May 28 03:05:12.830967 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.803155269000172 future=<Future at 0x7e4b4055e420 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:12.831078 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.803026257000056 future=<Future at 0x7e4b4055e420 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:12.858129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.573s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:12.946027 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Deleted allocations for instance ad211867-f4ec-4773-bca9-5383cde1e916
May 28 03:05:12.955037 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:12.958372 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937512.95796, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:12.958814 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Paused (Lifecycle Event)
May 28 03:05:13.182466 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:13.332937 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: ada45e15-d8ee-4ad0-b222-30f543ee7089] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:13.366067 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:13.366312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:13.366555 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:13.366721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:13.366881 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:13.369127 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Terminating instance
May 28 03:05:13.464132 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:13.467187 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:05:13.684313 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Took 1.63 seconds to deallocate network for instance.
May 28 03:05:13.872515 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:05:13.893491 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:13.894632 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:13.925331 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:13.930986 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:13.957762 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-26d00ae5-ad0b-4926-8f70-9a8deb0c3041 tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Lock "ad211867-f4ec-4773-bca9-5383cde1e916" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.984s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:13.960346 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:13.973039 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:05:14.146610 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-vif-unplugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:14.147256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] Acquiring lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:14.147256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:14.147256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:14.147256 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] No waiting events found dispatching network-vif-unplugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:14.147566 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Received event network-vif-unplugged-ae2981b3-9f2c-4589-a68c-242af62e9df4 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:14.147566 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:14.147566 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:14.147770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:14.147770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:14.148370 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] No waiting events found dispatching network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:14.148370 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-13b321cb-9ff3-4739-8c3b-86ad664193eb req-46888446-eee8-4c2c-9627-5891db94b22a service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:14.223395 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999490616000003 future=<Future at 0x7e4b4079c680 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:14.228775 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Instance destroyed successfully.
May 28 03:05:14.229422 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lazy-loading 'resources' on Instance uuid c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:14.250165 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Took 0.57 seconds to detach 1 volumes for instance.
May 28 03:05:14.551911 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:14.552361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:14.733582 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:00:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1204278745',display_name='tempest-ServerActionsTestOtherA-server-1204278745',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestothera-server-1204278745',id=3,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG3MITar0+89no3iP1gn3/5/FKxX4SGGuGn/G57dN8AlLKHP7w/1qEJDQbnmC4ojOhBT3vruwHLwVgsUbSYBIA1Dlc8e+unjq46ethPEjfsBcZNkkFIkY719HwsIv0y9Q==',key_name='tempest-keypair-1271620586',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:00:24Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d2ef1b6a03d428d94b2072c01964b49',ramdisk_id='',reservation_id='r-i0stx5mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1968473744',owner_user_name='tempest-ServerActionsTestOtherA-1968473744-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2776d33c40e0490eb87787c8dafc8066',uuid=c20b05b1-2a9f-4e55-9f36-6b5e472e11e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:05:14.733849 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converting VIF {"id": "daff420e-0782-4f0a-8b29-86782a4461e0", "address": "fa:16:3e:d6:5b:eb", "network": {"id": "a4ca3722-8a71-41f7-a766-6332ec554d01", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-876105163-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d2ef1b6a03d428d94b2072c01964b49", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaff420e-07", "ovs_interfaceid": "daff420e-0782-4f0a-8b29-86782a4461e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:14.734660 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=daff420e-0782-4f0a-8b29-86782a4461e0,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaff420e-07') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:14.734981 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=daff420e-0782-4f0a-8b29-86782a4461e0,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaff420e-07') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:05:14.736078 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:14.736287 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaff420e-07, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:14.747892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:14.748020 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:14.748317 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:14.749496 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:14.749635 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfc1bd08-6dad-4626-813c-5b368de74940) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:14.750109 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:14.750593 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:14.751173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:14.752890 np0000001589 nova-compute[98297]: INFO os_vif [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:5b:eb,bridge_name='br-int',has_traffic_filtering=True,id=daff420e-0782-4f0a-8b29-86782a4461e0,network=Network(a4ca3722-8a71-41f7-a766-6332ec554d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaff420e-07')
May 28 03:05:14.753162 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Deleting instance files /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4_del
May 28 03:05:14.753866 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Deletion of /opt/stack/data/nova/instances/c20b05b1-2a9f-4e55-9f36-6b5e472e11e4_del complete
May 28 03:05:14.760897 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:14.761069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:15.053642 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:05:15.111971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:15.112141 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:15.259866 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 03:05:15.260764 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:05:15.260764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:05:15.260823 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:05:15.260987 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:15.378860 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:15.603130 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:15.618503 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:15.626261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:15.724950 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-785eccf9-5908-4100-b87f-8e5f5935cc41 req-41898497-c57f-4ecb-a8fa-9964f5af66fc service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-deleted-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:15.724950 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-785eccf9-5908-4100-b87f-8e5f5935cc41 req-41898497-c57f-4ecb-a8fa-9964f5af66fc service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Neutron deleted interface daff420e-0782-4f0a-8b29-86782a4461e0; detaching it from the instance and deleting it from the info cache
May 28 03:05:15.725787 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-785eccf9-5908-4100-b87f-8e5f5935cc41 req-41898497-c57f-4ecb-a8fa-9964f5af66fc service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Detach interface failed, port_id=daff420e-0782-4f0a-8b29-86782a4461e0, reason: Instance c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:05:16.127811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.367s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:16.130315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.502s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:16.132312 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:05:16.132493 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Claim successful on node np0000001589
May 28 03:05:16.136442 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:16.190623 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Deleted allocations for instance f0381f84-64fa-4a31-862b-b4feb19c1713
May 28 03:05:16.228539 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88ddd2ff-f537-4ebd-a7d7-22d23d782b20 req-83e7af50-4687-4a87-9253-2f02e0097a82 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:16.229691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88ddd2ff-f537-4ebd-a7d7-22d23d782b20 req-83e7af50-4687-4a87-9253-2f02e0097a82 service nova] Acquiring lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:16.229691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88ddd2ff-f537-4ebd-a7d7-22d23d782b20 req-83e7af50-4687-4a87-9253-2f02e0097a82 service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:16.229691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88ddd2ff-f537-4ebd-a7d7-22d23d782b20 req-83e7af50-4687-4a87-9253-2f02e0097a82 service nova] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:16.229691 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88ddd2ff-f537-4ebd-a7d7-22d23d782b20 req-83e7af50-4687-4a87-9253-2f02e0097a82 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] No waiting events found dispatching network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:16.229691 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88ddd2ff-f537-4ebd-a7d7-22d23d782b20 req-83e7af50-4687-4a87-9253-2f02e0097a82 service nova] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Received event network-vif-unplugged-daff420e-0782-4f0a-8b29-86782a4461e0 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:16.645259 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Took 1.38 seconds to deallocate network for instance.
May 28 03:05:17.128888 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-773a4601-907d-49c1-ac20-327c0e25715f req-b3ab6e65-217b-4ae3-b3b6-ace551dc0d3d service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:17.130392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-773a4601-907d-49c1-ac20-327c0e25715f req-b3ab6e65-217b-4ae3-b3b6-ace551dc0d3d service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:17.130392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-773a4601-907d-49c1-ac20-327c0e25715f req-b3ab6e65-217b-4ae3-b3b6-ace551dc0d3d service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:17.130392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-773a4601-907d-49c1-ac20-327c0e25715f req-b3ab6e65-217b-4ae3-b3b6-ace551dc0d3d service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:17.130392 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-773a4601-907d-49c1-ac20-327c0e25715f req-b3ab6e65-217b-4ae3-b3b6-ace551dc0d3d service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Processing event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:05:17.130392 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance event wait completed in 5 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:05:17.134947 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937517.1321578, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:17.134947 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Resumed (Lifecycle Event)
May 28 03:05:17.138566 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:05:17.141200 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance spawned successfully.
May 28 03:05:17.141200 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:05:17.151576 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:17.205640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9c9be33-cc80-4ec7-a0bb-d937306622bb tempest-VolumesBackupsTest-2039328368 tempest-VolumesBackupsTest-2039328368-project-member] Lock "f0381f84-64fa-4a31-862b-b4feb19c1713" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.588s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:17.497780 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:17.498052 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:17.639656 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:17.641093 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:05:17.647298 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:17.650064 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:17.650270 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:17.650487 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:17.650709 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:17.650944 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:17.651168 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:18.002262 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:18.143140 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:05:18.159902 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Took 12.94 seconds to spawn the instance on the hypervisor.
May 28 03:05:18.159902 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:18.510599 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.383s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:18.511078 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:05:18.513095 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.361s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:18.668503 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Took 18.71 seconds to build instance.
May 28 03:05:18.863552 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:18.864549 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:19.019058 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:05:19.019384 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:05:19.020057 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:19.020146 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:19.102581 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db2de4ba77e418598d962bc8fa90cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50654591a7494ff3aa75740735c011e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:05:19.172261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.225s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:19.189079 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a5f55163-9e92-45f2-8679-3703e1bbdf7e req-901da14c-72d0-4451-aa01-120e2a437d31 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:19.190860 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a5f55163-9e92-45f2-8679-3703e1bbdf7e req-901da14c-72d0-4451-aa01-120e2a437d31 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:19.191249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a5f55163-9e92-45f2-8679-3703e1bbdf7e req-901da14c-72d0-4451-aa01-120e2a437d31 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:19.191355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a5f55163-9e92-45f2-8679-3703e1bbdf7e req-901da14c-72d0-4451-aa01-120e2a437d31 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:19.194241 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a5f55163-9e92-45f2-8679-3703e1bbdf7e req-901da14c-72d0-4451-aa01-120e2a437d31 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:19.194241 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a5f55163-9e92-45f2-8679-3703e1bbdf7e req-901da14c-72d0-4451-aa01-120e2a437d31 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state active and task_state None.
May 28 03:05:19.366140 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:19.522544 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:05:19.634699 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00042027499989671924 future=<Future at 0x7e4b4055e420 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:19.634948 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] Emitting event <LifecycleEvent: 1779937504.634043, 9d7ee143-ce2c-4b61-952a-87eab2cf22bb => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:19.635164 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] VM Stopped (Lifecycle Event)
May 28 03:05:19.636283 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:19.636344 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.1887105010000596 future=<Future at 0x7e4b406c72c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:19.636530 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.188602379000031 future=<Future at 0x7e4b406c72c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:19.710220 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Successfully created port: 28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:05:19.750485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:19.874060 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.361s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:19.953118 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Deleted allocations for instance c20b05b1-2a9f-4e55-9f36-6b5e472e11e4
May 28 03:05:20.031108 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:05:20.138112 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] [instance: 9d7ee143-ce2c-4b61-952a-87eab2cf22bb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:20.287854 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:20.288038 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing instance network info cache due to event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:05:20.288179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] Acquiring lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:05:20.288321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] Acquired lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:05:20.288446 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing network info cache for port 75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:05:20.325634 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Successfully updated port: 28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:05:20.375716 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-changed-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:20.375899 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Refreshing instance network info cache due to event network-changed-28e0891b-94fd-4c84-afaf-4db9e9df9eb5. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:05:20.376097 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] Acquiring lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:05:20.376245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] Acquired lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:05:20.376434 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Refreshing network info cache for port 28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:05:20.790214 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:20.827806 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:05:20.879298 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:20.963886 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5f952f57-1b18-4e3f-8fdf-9a8bf1cde364 tempest-ServerActionsTestOtherA-1968473744 tempest-ServerActionsTestOtherA-1968473744-project-member] Lock "c20b05b1-2a9f-4e55-9f36-6b5e472e11e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.598s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:20.969408 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:05:21.041925 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:05:21.043418 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:05:21.043656 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Creating image(s)
May 28 03:05:21.044213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:21.044562 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:21.045103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:21.045685 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:21.048291 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:21.055063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:21.162849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:21.166248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:21.166248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:21.166248 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:21.167182 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:05:21.167704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:21.187058 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:21.226550 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:21.251135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:21.254246 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:21.315866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk 1073741824" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:21.317823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:21.317823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:21.411377 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:21.413922 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:05:21.414522 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:21.443674 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updated VIF entry in instance network info cache for port 75347773-ab8a-4c09-88b9-fed091f53c27. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:05:21.444589 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:21.511645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:21.512095 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Cannot resize image /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:05:21.512572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:05:21.512809 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Ensure instance console log exists: /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:05:21.513156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:21.513472 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:21.513672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:21.694614 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c725b700-d3fe-4029-be9d-8f0dfa53ea25 req-14eaa39a-48bb-491a-a056-46db8e67605b service nova] Releasing lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:05:21.696664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquired lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:05:21.696664 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:05:21.826879 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:21.827181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:21.950104 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-afd4dd64-8e1b-43d3-b549-c2f6c1dc3d5d req-3582a9a1-2d1e-4c16-b416-df2cc5a6ddac service nova] Releasing lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:05:22.260452 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:05:22.332755 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'flavor' on Instance uuid 6aeff63a-cb33-4923-91c2-08b7756e9a0c {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:22.423868 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:22.576821 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:22.650710 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:22.826132 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0009717629998249322 future=<Future at 0x7e4b406c72c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:22.826543 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Emitting event <LifecycleEvent: 1779937507.8249853, ad211867-f4ec-4773-bca9-5383cde1e916 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:22.826707 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] VM Stopped (Lifecycle Event)
May 28 03:05:22.827788 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:22.828402 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.608511507000003 future=<Future at 0x7e4b6467a5d0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:22.828402 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.6084065100001226 future=<Future at 0x7e4b6467a5d0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:22.837780 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Ignoring supplied device name: /dev/vdb
May 28 03:05:23.079984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Releasing lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:05:23.079984 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance network_info: |[{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:05:23.081493 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Start _get_guest_xml network_info=[{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:05:23.083987 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:05:23.085490 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-150448903', uuid='6894ded6-c069-4e38-b230-5e7435bbee38'), owner=OwnerMeta(userid='6db2de4ba77e418598d962bc8fa90cb1', username='tempest-ServerActionsTestOtherB-278131468-project-member', projectid='50654591a7494ff3aa75740735c011e0', projectname='tempest-ServerActionsTestOtherB-278131468'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937523.0849679) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:05:23.086456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:05:23.086853 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:05:23.087809 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:05:23.088062 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:05:23.089261 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:05:23.089643 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:05:23.089861 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:05:23.090023 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:05:23.090240 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:05:23.090405 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:05:23.090555 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:05:23.090772 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:05:23.090960 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:05:23.091178 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:05:23.091422 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:05:23.091629 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:05:23.106123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:05:23.106479 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:23.107062 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:23.107681 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lazy-loading 'pci_devices' on Instance uuid 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:23.330691 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: ad211867-f4ec-4773-bca9-5383cde1e916] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:23.340849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:23.462842 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:23.614651 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] End _get_guest_xml xml=<domain type="qemu">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <uuid>6894ded6-c069-4e38-b230-5e7435bbee38</uuid>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <name>instance-0000001a</name>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsTestOtherB-server-150448903</nova:name>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:05:23</nova:creationTime>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:user uuid="6db2de4ba77e418598d962bc8fa90cb1">tempest-ServerActionsTestOtherB-278131468-project-member</nova:user>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:project uuid="50654591a7494ff3aa75740735c011e0">tempest-ServerActionsTestOtherB-278131468</nova:project>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         <nova:port uuid="28e0891b-94fd-4c84-afaf-4db9e9df9eb5">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <system>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <entry name="serial">6894ded6-c069-4e38-b230-5e7435bbee38</entry>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <entry name="uuid">6894ded6-c069-4e38-b230-5e7435bbee38</entry>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </system>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <os>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   </os>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <features>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   </features>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   <devices>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </disk>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </disk>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:42:03:f7"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <target dev="tap28e0891b-94"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </interface>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/console.log" append="off"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </serial>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <video>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </video>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </rng>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:   </devices>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]: </domain>
May 28 03:05:23.614651 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Preparing to wait for external event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:05:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:23.622173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57ae47fb-140d-5225-b4b6-1dbf86c9cfd3', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:23.623702 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:23.625498 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:23.628001 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:23.629415 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e0891b-94, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:23.629415 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e0891b-94, col_values=(('qos', UUID('c5199ec6-1657-4822-aa60-7dae6e4c1145')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:23.629415 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e0891b-94, col_values=(('external_ids', {'iface-id': '28e0891b-94fd-4c84-afaf-4db9e9df9eb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:03:f7', 'vm-uuid': '6894ded6-c069-4e38-b230-5e7435bbee38'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:23.629887 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:23.631356 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:23.653660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:23.655281 np0000001589 nova-compute[98297]: INFO os_vif [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94')
May 28 03:05:24.467004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:24.467531 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:24.468124 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Attaching volume 5c6721d6-653c-418a-8449-71319a7a0b9c to /dev/vdb
May 28 03:05:24.531775 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:24.545086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:05:24.573215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:24.627035 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:05:24.627360 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:05:24.642446 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:05:24.644655 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe32:c016', 'fe80::e88a:9dff:fe29:20d6', 'fe80::fc16:3eff:fe29:c86d', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fede:6d95', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1'] 
May 28 03:05:24.644916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:05:24.645023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:05:24.649569 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:24.649783 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Updating existing volume attachment record: 0ed4910f-d18e-4126-9581-e992a37e6882 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:05:25.190247 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:25.190409 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:25.190519 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No VIF found with MAC fa:16:3e:42:03:f7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:05:25.191072 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Using config drive
May 28 03:05:25.242709 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:05:25.243221 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:25.243447 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:25.244055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:25.244631 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:05:25.261491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:25.261963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:25.262682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:25.262941 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:25.263952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:25.264276 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:25.277930 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:25.277930 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:25.284460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:25.284460 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:25.299554 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c] added
May 28 03:05:25.299554 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:25.299554 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:25.299554 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:25.299554 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:25.299554 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:25.299554 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:25.300706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:25.300706 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:25.300706 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:25.302673 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c] added
May 28 03:05:25.302673 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:25.302673 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:25.302673 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:25.302673 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:25.302673 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:25.302673 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:25.302911 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:25.303012 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:25.304022 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:25.699017 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:25.873118 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Creating config drive at /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config
May 28 03:05:25.877116 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbtraihgp {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:25.935151 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbtraihgp" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:26.301426 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:26.305418 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:26.319328 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:26.319328 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:26.321491 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:26.321491 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.335094 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.341729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.351448 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.351448 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.351448 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.351448 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:26.351758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.351758 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.351758 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.351758 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:26.365846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.365846 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.365846 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.365846 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:26.365846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.365846 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.365846 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.365846 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:26.392743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.40.100,3260]
May 28 03:05:26.392743 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.40.100,3260] successful.
May 28 03:05:26.392743 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.413599 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.423784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.50.100,3260]
May 28 03:05:26.423784 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.50.100,3260] successful.
May 28 03:05:26.423784 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.435320 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:26.435320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:26.435607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:26.436074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] HCTL ('10', '-', '-', 0) found on session 60 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:26.436177 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:26.439451 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0017854489999535872 future=<Future at 0x7e4b6467a5d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:26.439451 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:26.440192 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.782976809000047 future=<Future at 0x7e4b4079c680 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:26.440603 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.782257001000062 future=<Future at 0x7e4b4079c680 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:26.441667 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Emitting event <LifecycleEvent: 1779937511.4367287, f0381f84-64fa-4a31-862b-b4feb19c1713 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:26.441667 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] VM Stopped (Lifecycle Event)
May 28 03:05:26.444531 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:26.456299 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:26.470399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching for a device in session 60 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:26.470399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:26.471787 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.471787 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.471787 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.471787 np0000001589 nova-compute[98297]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.471787 np0000001589 nova-compute[98297]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.471787 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:26.471980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.471980 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:26.471980 np0000001589 nova-compute[98297]: tcp: [59] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-704e10fe-5a86-44ac-9b08-b34bfbe27d10 (non-flash)
May 28 03:05:26.471980 np0000001589 nova-compute[98297]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.471980 np0000001589 nova-compute[98297]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:26.471980 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:26.474484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.211s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:26.474600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:26.475268 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] HCTL ('11', '-', '-', 0) found on session 61 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:26.475426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:26.503214 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:26.510883 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Searching for a device in session 61 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:26.511144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:26.618418 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:26.839713 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3da22750-4e83-45cc-95c4-f3899912988a req-0e5b65ad-a26e-433c-baad-cb8fce9f0af6 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:26.839713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3da22750-4e83-45cc-95c4-f3899912988a req-0e5b65ad-a26e-433c-baad-cb8fce9f0af6 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:26.839713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3da22750-4e83-45cc-95c4-f3899912988a req-0e5b65ad-a26e-433c-baad-cb8fce9f0af6 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:26.839713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3da22750-4e83-45cc-95c4-f3899912988a req-0e5b65ad-a26e-433c-baad-cb8fce9f0af6 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:26.840407 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3da22750-4e83-45cc-95c4-f3899912988a req-0e5b65ad-a26e-433c-baad-cb8fce9f0af6 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Processing event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:05:26.949206 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fdb6aa64-0f96-4a2d-acbb-cfe5567b0b5c tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: f0381f84-64fa-4a31-862b-b4feb19c1713] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:26.989661 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:26.994780 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:27.024199 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:27.264130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:05:27.554051 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937527.553685, 6894ded6-c069-4e38-b230-5e7435bbee38 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:27.554754 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:05:27.555678 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Started (Lifecycle Event)
May 28 03:05:27.557757 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:05:27.559649 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance spawned successfully.
May 28 03:05:27.560335 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:05:27.650760 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:28.060080 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:28.065249 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:05:28.067850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:28.067850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:28.067850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:28.069701 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:28.069701 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:28.070783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:05:28.137748 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:28.138029 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:05:28.278423 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Found WWN 330000000b95535d4 for multipath device dm-4 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:05:28.278682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:28.278868 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000b95535d4', 'path': '/dev/dm-4', 'multipath_id': '330000000b95535d4'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:28.278981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b95535d4', 'path': '/dev/dm-4', 'multipath_id': '330000000b95535d4'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:05:28.281098 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'flavor' on Instance uuid 6aeff63a-cb33-4923-91c2-08b7756e9a0c {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:28.575348 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:05:28.577995 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Took 7.54 seconds to spawn the instance on the hypervisor.
May 28 03:05:28.578827 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:28.579374 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937528.5786927, 6894ded6-c069-4e38-b230-5e7435bbee38 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:28.580032 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Paused (Lifecycle Event)
May 28 03:05:28.630889 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:28.784428 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Attempting to attach volume 5c6721d6-653c-418a-8449-71319a7a0b9c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:05:28.785572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:05:28.785572 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:28.785572 np0000001589 nova-compute[98297]:   <alias name="ua-5c6721d6-653c-418a-8449-71319a7a0b9c"/>
May 28 03:05:28.785572 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-4"/>
May 28 03:05:28.785572 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:05:28.785572 np0000001589 nova-compute[98297]:   <serial>5c6721d6-653c-418a-8449-71319a7a0b9c</serial>
May 28 03:05:28.785572 np0000001589 nova-compute[98297]: </disk>
May 28 03:05:28.785572 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:05:28.933297 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b6f7b2f1-c213-4379-b84a-f59574982092 req-62913636-cbeb-4b80-ab06-c8b5be470a97 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:28.933886 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b6f7b2f1-c213-4379-b84a-f59574982092 req-62913636-cbeb-4b80-ab06-c8b5be470a97 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:28.933946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b6f7b2f1-c213-4379-b84a-f59574982092 req-62913636-cbeb-4b80-ab06-c8b5be470a97 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:28.934107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b6f7b2f1-c213-4379-b84a-f59574982092 req-62913636-cbeb-4b80-ab06-c8b5be470a97 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:28.934292 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b6f7b2f1-c213-4379-b84a-f59574982092 req-62913636-cbeb-4b80-ab06-c8b5be470a97 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:28.934527 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-b6f7b2f1-c213-4379-b84a-f59574982092 req-62913636-cbeb-4b80-ab06-c8b5be470a97 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state active and task_state None.
May 28 03:05:29.082318 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:29.083757 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937529.0835578, 6894ded6-c069-4e38-b230-5e7435bbee38 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:29.084564 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Resumed (Lifecycle Event)
May 28 03:05:29.090598 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Took 13.53 seconds to build instance.
May 28 03:05:29.226445 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0033679999999094434 future=<Future at 0x7e4b4079c680 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:29.227071 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:29.228877 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Emitting event <LifecycleEvent: 1779937514.2227952, c20b05b1-2a9f-4e55-9f36-6b5e472e11e4 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:29.228877 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] VM Stopped (Lifecycle Event)
May 28 03:05:29.585949 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:29.588306 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:05:29.591891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-35301555-c3b8-444d-86a0-6299f1896fd9 tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.040s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:29.731178 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-14668b7a-157d-44a8-ad74-1486876b6c2f tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: c20b05b1-2a9f-4e55-9f36-6b5e472e11e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:30.137795 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:30.138292 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:30.138292 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:05:30.138450 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:05:30.231140 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-changed-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:30.231582 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Refreshing instance network info cache due to event network-changed-28e0891b-94fd-4c84-afaf-4db9e9df9eb5. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:05:30.232978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] Acquiring lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:05:30.232978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] Acquired lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:05:30.232978 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Refreshing network info cache for port 28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:05:30.453641 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:30.453757 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:30.453864 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:30.453976 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No VIF found with MAC fa:16:3e:32:c0:16, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:05:30.735332 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:31.137961 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:31.138310 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:05:31.165033 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:31.330487 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updated VIF entry in instance network info cache for port 28e0891b-94fd-4c84-afaf-4db9e9df9eb5. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:05:31.330731 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:31.834480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3700cee-50ad-43a7-8a54-78e89c934c3c req-8a0f496d-33f5-450a-b6d7-f829d69d7334 service nova] Releasing lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:05:32.030684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7c81ed31-52ec-4b2b-8a5e-48de82cbc31b tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.563s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:32.133971 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:32.134272 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:05:32.139248 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:32.641842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:32.642138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:32.643247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:32.643247 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:05:32.651896 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:33.633142 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:33.683780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:33.792451 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:33.794124 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:33.894562 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:33.898418 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:33.994204 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:33.995250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.094562 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.095848 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:05:34.099743 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.199201 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.200132 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.286733 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.287163 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:05:34.289952 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.375093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.375565 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.456072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.459074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.543346 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.543855 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.636883 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.639498 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:05:34.640742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:34.679977 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.039s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:05:34.680545 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=12365MB free_disk=74.16226577758789GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:05:34.680774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:34.681307 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:35.741099 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:05:35.741480 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:05:35.741480 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 4a5225e8-8a5f-4192-91ac-513d048c59eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:05:35.741480 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ce889453-d238-4bd1-b6b7-88c0ac65a869 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:05:35.741480 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 6894ded6-c069-4e38-b230-5e7435bbee38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:05:35.741676 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:05:35.741791 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:05:34 up 33 min,  2 users,  load average: 6.99, 5.98, 3.23\n', 'num_instances': '5', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '5', 'num_proj_e00f74b8638345979e76606cba0149ce': '1', 'io_workload': '0', 'num_proj_989151e14dc44db3b75763b654bb2199': '1', 'num_proj_38899ad6345442358b17adfcc1ba57a7': '1', 'num_proj_50654591a7494ff3aa75740735c011e0': '1', 'num_proj_c470ae60a73f43d183ba78fe4ed0d29b': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:05:36.024710 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:36.024935 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:36.528051 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:37.036550 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:05:37.039471 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.356s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:37.039471 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:05:37.654973 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:37.935118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:37.935851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:38.039159 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:38.039608 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:38.039914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:38.040121 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:05:38.040503 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.10 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:05:38.438327 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Detaching volume 5c6721d6-653c-418a-8449-71319a7a0b9c
May 28 03:05:38.484721 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Attempting to driver detach volume 5c6721d6-653c-418a-8449-71319a7a0b9c from mountpoint /dev/vdb
May 28 03:05:38.489635 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Found disk vdb by alias ua-5c6721d6-653c-418a-8449-71319a7a0b9c {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:05:38.492085 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Found disk vdb by alias ua-5c6721d6-653c-418a-8449-71319a7a0b9c {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:05:38.492275 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Attempting to detach device vdb from instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:05:38.493126 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:05:38.493126 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:38.493126 np0000001589 nova-compute[98297]:   <alias name="ua-5c6721d6-653c-418a-8449-71319a7a0b9c"/>
May 28 03:05:38.493126 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-4"/>
May 28 03:05:38.493126 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:05:38.493126 np0000001589 nova-compute[98297]:   <serial>5c6721d6-653c-418a-8449-71319a7a0b9c</serial>
May 28 03:05:38.493126 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:05:38.493126 np0000001589 nova-compute[98297]: </disk>
May 28 03:05:38.493126 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:05:38.498196 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully detached device vdb from instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c from the persistent domain config.
May 28 03:05:38.498196 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] (1/8): Attempting to detach device vdb with device alias ua-5c6721d6-653c-418a-8449-71319a7a0b9c from instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:05:38.498196 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:05:38.498196 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:38.498196 np0000001589 nova-compute[98297]:   <alias name="ua-5c6721d6-653c-418a-8449-71319a7a0b9c"/>
May 28 03:05:38.498196 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-4"/>
May 28 03:05:38.498196 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:05:38.498196 np0000001589 nova-compute[98297]:   <serial>5c6721d6-653c-418a-8449-71319a7a0b9c</serial>
May 28 03:05:38.498196 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:05:38.498196 np0000001589 nova-compute[98297]: </disk>
May 28 03:05:38.498196 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:05:38.632988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:39.049092 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937539.0487244, 6aeff63a-cb33-4923-91c2-08b7756e9a0c => ua-5c6721d6-653c-418a-8449-71319a7a0b9c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:05:39.053663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-5c6721d6-653c-418a-8449-71319a7a0b9c for instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:05:39.054837 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully detached device vdb from instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c from the live domain config.
May 28 03:05:39.055634 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:05:39.055931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:39.056064 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:40.027171 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:40.027362 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:40.209397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.153s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:40.209958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:05:40.210136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:05:40.240005 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:40.240005 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:40.240005 np0000001589 nova-compute[98297]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:40.240005 np0000001589 nova-compute[98297]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:40.240005 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:40.240005 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:40.240005 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:40.240279 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:40.240279 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:40.240279 np0000001589 nova-compute[98297]: tcp: [60] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:40.240279 np0000001589 nova-compute[98297]: tcp: [61] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c (non-flash)
May 28 03:05:40.240279 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:40.240279 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:40.240279 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:40.240407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', '60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', '61'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018', '63')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:05:40.240547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', '60')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:40.241754 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', '61')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:40.242761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b405b54e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:05:40.243093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Removing multipathed devices sde, sdf {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:05:40.243394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Flush multipath device 330000000b95535d4 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:05:40.280543 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:40.326825 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:40.372760 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:05:40.372921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:05:40.374172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:05:40.394080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:05:40.394080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:05:40.403949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:40.439411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.40.100,3260]
May 28 03:05:40.439411 np0000001589 nova-compute[98297]: Logout of [sid: 60, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.40.100,3260] successful.
May 28 03:05:40.439411 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:40.455960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:40.467813 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:40.500016 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.50.100,3260]
May 28 03:05:40.500016 np0000001589 nova-compute[98297]: Logout of [sid: 61, target: iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, portal: 192.168.50.100,3260] successful.
May 28 03:05:40.500016 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:40.519343 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:40.519660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:40.519830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== disconnect_volume: return (1464ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:40.519975 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:05:40.531818 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:41.083475 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'flavor' on Instance uuid 6aeff63a-cb33-4923-91c2-08b7756e9a0c {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:41.540757 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:42.098422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ca6653c4-410e-406a-97ae-5a19e9bb9976 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.163s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:42.099112 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 4.059s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:42.099359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:42.099506 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:42.099607 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:42.101275 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Terminating instance
May 28 03:05:42.606256 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:05:42.619760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:42.619953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:42.620124 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attaching volume f09c89d6-a259-4506-8984-0764bdb08167 to /dev/vdb
May 28 03:05:42.632034 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.636254 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.657669 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.667219 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.688152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.692442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.711689 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:42.727136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:05:42.758951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:42.800850 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:05:42.801214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:05:42.816442 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:05:42.820158 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe29:c86d', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fede:6d95', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1', 'fe80::fc16:3eff:fe42:3f7', 'fe80::48fd:4bff:fea3:f8b1'] 
May 28 03:05:42.821674 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:05:42.821861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:05:42.822298 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:42.822690 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Updating existing volume attachment record: 7f6c51b6-be5f-4b0b-a93c-8764ed0f71bc {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:05:42.874219 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c955b9a-d32f-4a17-85bd-37767df5d1b4 req-29df6fae-51c5-42a0-8e5d-68452584b748 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-vif-unplugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:42.874529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c955b9a-d32f-4a17-85bd-37767df5d1b4 req-29df6fae-51c5-42a0-8e5d-68452584b748 service nova] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:42.874705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c955b9a-d32f-4a17-85bd-37767df5d1b4 req-29df6fae-51c5-42a0-8e5d-68452584b748 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:42.876264 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c955b9a-d32f-4a17-85bd-37767df5d1b4 req-29df6fae-51c5-42a0-8e5d-68452584b748 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:42.876454 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c955b9a-d32f-4a17-85bd-37767df5d1b4 req-29df6fae-51c5-42a0-8e5d-68452584b748 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] No waiting events found dispatching network-vif-unplugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:42.876622 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c955b9a-d32f-4a17-85bd-37767df5d1b4 req-29df6fae-51c5-42a0-8e5d-68452584b748 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-vif-unplugged-720e400f-ae4a-4fab-a504-d914c0ad1119 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:42.933813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.943252 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:42.980306 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999648111999932 future=<Future at 0x7e4b407afa40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:42.980306 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998175316000015 future=<Future at 0x7e4b407afa40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:42.980678 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.997334251999973 future=<Future at 0x7e4b407afa40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:42.986094 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Instance destroyed successfully.
May 28 03:05:42.987555 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lazy-loading 'resources' on Instance uuid 6aeff63a-cb33-4923-91c2-08b7756e9a0c {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:43.395450 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:05:43.395803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f09c89d6-a259-4506-8984-0764bdb08167', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:43.395957 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:43.396333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:43.396531 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f09c89d6-a259-4506-8984-0764bdb08167', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:05:43.410666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:43.411492 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:43.412034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:43.412800 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:43.412981 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:43.413398 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:43.428905 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:43.428905 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:43.431065 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:43.431065 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167] added
May 28 03:05:43.446757 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:43.446757 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:43.446757 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:43.448709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167] added
May 28 03:05:43.448709 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:43.448709 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:43.448709 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:43.448709 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:43.448709 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:43.448709 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:43.448938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:43.449094 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:43.449268 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:43.491135 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:04:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2011550058',display_name='tempest-VolumesSnapshotTestJSON-instance-2011550058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumessnapshottestjson-instance-2011550058',id=23,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWM+HHij8glvOy33J4kSWmumbKMnMZ8n0WNPBTPGYTIccbmdf4JQOutuESra/Odo9sIIKNzUKtVPeLD1Y4JTZpVYQPXZWySsUmJiXsASWogu0j+Zv+y/ZHcf1TGMvgdWw==',key_name='tempest-keypair-857640879',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:04:44Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e00f74b8638345979e76606cba0149ce',ramdisk_id='',reservation_id='r-ksavz0yb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1234909468',owner_user_name='tempest-VolumesSnapshotTestJSON-1234909468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:04:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49a98ac8a8a84d1496b8b48952956e32',uuid=6aeff63a-cb33-4923-91c2-08b7756e9a0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:05:43.491378 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converting VIF {"id": "720e400f-ae4a-4fab-a504-d914c0ad1119", "address": "fa:16:3e:32:c0:16", "network": {"id": "017439b1-0daa-4440-aa9d-8ece19b68945", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1465701780-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e00f74b8638345979e76606cba0149ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap720e400f-ae", "ovs_interfaceid": "720e400f-ae4a-4fab-a504-d914c0ad1119", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:43.492156 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:c0:16,bridge_name='br-int',has_traffic_filtering=True,id=720e400f-ae4a-4fab-a504-d914c0ad1119,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720e400f-ae') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:43.492470 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:c0:16,bridge_name='br-int',has_traffic_filtering=True,id=720e400f-ae4a-4fab-a504-d914c0ad1119,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720e400f-ae') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:05:43.494020 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:43.494719 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap720e400f-ae, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:43.496824 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:43.496824 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:43.496824 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:43.497626 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:43.497794 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf796189-8546-498d-b29f-7778a466291c) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:43.499120 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:43.499120 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:43.499120 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:43.502184 np0000001589 nova-compute[98297]: INFO os_vif [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:c0:16,bridge_name='br-int',has_traffic_filtering=True,id=720e400f-ae4a-4fab-a504-d914c0ad1119,network=Network(017439b1-0daa-4440-aa9d-8ece19b68945),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap720e400f-ae')
May 28 03:05:43.503487 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:05:43.503821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:43.503970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:44.447136 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:44.449737 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:44.461071 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:44.461071 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:44.463432 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:44.463432 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.475985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.481396 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.491096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.491096 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.491096 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.491096 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.491096 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:44.491881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.491881 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.491881 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.491881 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.491881 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:44.496517 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.496517 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.496517 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.496517 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.496517 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:44.496744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.496744 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.496744 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.496744 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.496744 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:44.525213 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.50.100,3260]
May 28 03:05:44.525213 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.50.100,3260] successful.
May 28 03:05:44.525213 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.531190 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.40.100,3260]
May 28 03:05:44.531190 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.40.100,3260] successful.
May 28 03:05:44.531190 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.539843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.544100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.554843 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:44.554843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:44.556346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('10', '-', '-', 0) found on session 64 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:44.556346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:44.565089 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.565089 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.565089 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.565089 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.565089 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.565089 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.565089 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:44.565360 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.565360 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:44.565360 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:44.565360 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:44.565360 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.565360 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:44.565360 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:44.565585 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:44.565657 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:44.569274 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('11', '-', '-', 0) found on session 65 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:44.569274 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:44.569274 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 64 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:44.569274 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f09c89d6-a259-4506-8984-0764bdb08167', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:44.583237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 65 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:44.583237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f09c89d6-a259-4506-8984-0764bdb08167', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:44.941428 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ad81f58d-ab16-4a3f-a927-576dd6002ee7 req-4ac4fd08-985c-45d4-a002-9280633ce164 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-vif-unplugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:44.942372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ad81f58d-ab16-4a3f-a927-576dd6002ee7 req-4ac4fd08-985c-45d4-a002-9280633ce164 service nova] Acquiring lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:44.942623 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ad81f58d-ab16-4a3f-a927-576dd6002ee7 req-4ac4fd08-985c-45d4-a002-9280633ce164 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:44.942803 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ad81f58d-ab16-4a3f-a927-576dd6002ee7 req-4ac4fd08-985c-45d4-a002-9280633ce164 service nova] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:44.942978 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ad81f58d-ab16-4a3f-a927-576dd6002ee7 req-4ac4fd08-985c-45d4-a002-9280633ce164 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] No waiting events found dispatching network-vif-unplugged-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:05:44.943177 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ad81f58d-ab16-4a3f-a927-576dd6002ee7 req-4ac4fd08-985c-45d4-a002-9280633ce164 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-vif-unplugged-720e400f-ae4a-4fab-a504-d914c0ad1119 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:05:45.413010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:05:46.430904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found WWN 33000000098999db5 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:05:46.432098 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:46.432098 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000098999db5', 'path': '/dev/dm-1', 'multipath_id': '33000000098999db5'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:46.432098 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000098999db5', 'path': '/dev/dm-1', 'multipath_id': '33000000098999db5'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:05:46.432311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.928s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:46.432734 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5c6721d6-653c-418a-8449-71319a7a0b9c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:05:46.432897 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:05:46.436392 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:46.460749 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:46.460749 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:46.460749 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:46.460749 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:46.460749 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:46.460749 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:46.460749 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:46.461391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:46.461391 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:46.461391 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:46.461391 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:46.461391 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:46.461391 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:46.461391 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:46.461391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '65')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:05:46.461677 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:46.461677 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:05:46.461677 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:46.461841 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5c6721d6-653c-418a-8449-71319a7a0b9c') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:05:46.461841 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b405332e0>, {}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:05:46.462981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Disconnecting from: [] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:05:46.462981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:46.462981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] <== disconnect_volume: return (2958ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:46.462981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:05:46.462981 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Deleting instance files /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c_del
May 28 03:05:46.464407 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Deletion of /opt/stack/data/nova/instances/6aeff63a-cb33-4923-91c2-08b7756e9a0c_del complete
May 28 03:05:46.941492 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attempting to attach volume f09c89d6-a259-4506-8984-0764bdb08167 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:05:46.947004 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:05:46.947004 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:46.947004 np0000001589 nova-compute[98297]:   <alias name="ua-f09c89d6-a259-4506-8984-0764bdb08167"/>
May 28 03:05:46.947004 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:05:46.947004 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:05:46.947004 np0000001589 nova-compute[98297]:   <serial>f09c89d6-a259-4506-8984-0764bdb08167</serial>
May 28 03:05:46.947004 np0000001589 nova-compute[98297]: </disk>
May 28 03:05:46.947004 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:05:46.977698 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Took 4.37 seconds to destroy the instance on the hypervisor.
May 28 03:05:46.981695 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:05:46.983189 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:05:46.983386 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:05:46.983751 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:47.060624 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:47.518715 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-762ec32c-55e4-4869-9899-b267d1758938 req-57962144-f068-4873-8fe1-06e691c2b4e2 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Received event network-vif-deleted-720e400f-ae4a-4fab-a504-d914c0ad1119 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:47.519528 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-762ec32c-55e4-4869-9899-b267d1758938 req-57962144-f068-4873-8fe1-06e691c2b4e2 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Neutron deleted interface 720e400f-ae4a-4fab-a504-d914c0ad1119; detaching it from the instance and deleting it from the info cache
May 28 03:05:47.521344 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-762ec32c-55e4-4869-9899-b267d1758938 req-57962144-f068-4873-8fe1-06e691c2b4e2 service nova] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Detach interface failed, port_id=720e400f-ae4a-4fab-a504-d914c0ad1119, reason: Instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:05:47.707980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:47.946381 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:47.952373 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:48.452718 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Took 1.47 seconds to deallocate network for instance.
May 28 03:05:48.466744 np0000001589 nova-compute[98297]: WARNING nova.volume.cinder [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Attachment 0ed4910f-d18e-4126-9581-e992a37e6882 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0ed4910f-d18e-4126-9581-e992a37e6882. (HTTP 404) (Request-ID: req-817ac5ba-62e8-461c-b101-257220ae7957)
May 28 03:05:48.466944 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Took 0.01 seconds to detach 1 volumes for instance.
May 28 03:05:48.499194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:48.611134 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:48.611488 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:48.611488 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:48.611569 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No VIF found with MAC fa:16:3e:29:c8:6d, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:05:48.805859 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:48.973379 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:48.973595 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:49.164723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:49.165723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:49.205053 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:49.205270 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:49.670190 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Detaching volume f9248077-253b-40f9-be56-ac1428bf3fa0
May 28 03:05:49.708154 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:49.717607 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Attempting to driver detach volume f9248077-253b-40f9-be56-ac1428bf3fa0 from mountpoint /dev/vdc
May 28 03:05:49.719445 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Found disk vdc by alias ua-f9248077-253b-40f9-be56-ac1428bf3fa0 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:05:49.720529 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Found disk vdc by alias ua-f9248077-253b-40f9-be56-ac1428bf3fa0 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:05:49.720733 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Attempting to detach device vdc from instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:05:49.721339 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:05:49.721339 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:49.721339 np0000001589 nova-compute[98297]:   <alias name="ua-f9248077-253b-40f9-be56-ac1428bf3fa0"/>
May 28 03:05:49.721339 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:05:49.721339 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:05:49.721339 np0000001589 nova-compute[98297]:   <serial>f9248077-253b-40f9-be56-ac1428bf3fa0</serial>
May 28 03:05:49.721339 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:05:49.721339 np0000001589 nova-compute[98297]: </disk>
May 28 03:05:49.721339 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:05:49.731044 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully detached device vdc from instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f from the persistent domain config.
May 28 03:05:49.731169 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] (1/8): Attempting to detach device vdc with device alias ua-f9248077-253b-40f9-be56-ac1428bf3fa0 from instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:05:49.731416 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:05:49.731416 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:49.731416 np0000001589 nova-compute[98297]:   <alias name="ua-f9248077-253b-40f9-be56-ac1428bf3fa0"/>
May 28 03:05:49.731416 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:05:49.731416 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:05:49.731416 np0000001589 nova-compute[98297]:   <serial>f9248077-253b-40f9-be56-ac1428bf3fa0</serial>
May 28 03:05:49.731416 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:05:49.731416 np0000001589 nova-compute[98297]: </disk>
May 28 03:05:49.731416 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:05:50.178836 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22d3e19f-c827-4784-900b-630fc8e1d51c tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.558s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:50.217551 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.244s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:50.280742 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Deleted allocations for instance 6aeff63a-cb33-4923-91c2-08b7756e9a0c
May 28 03:05:50.382977 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937550.3826032, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => ua-f9248077-253b-40f9-be56-ac1428bf3fa0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:05:50.384239 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-f9248077-253b-40f9-be56-ac1428bf3fa0 for instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:05:50.386176 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully detached device vdc from instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f from the live domain config.
May 28 03:05:50.386940 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:05:50.387209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:50.387386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:50.387739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:50.387993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f9248077-253b-40f9-be56-ac1428bf3fa0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:05:50.388107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:05:50.399511 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:50.413672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:50.413672 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:50.413672 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:50.413672 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:50.413672 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:50.413672 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:50.413672 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:50.413960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsi session list stdout=tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:50.413960 np0000001589 nova-compute[98297]: tcp: [58] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0 (non-flash)
May 28 03:05:50.413960 np0000001589 nova-compute[98297]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5 (non-flash)
May 28 03:05:50.413960 np0000001589 nova-compute[98297]: tcp: [63] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018 (non-flash)
May 28 03:05:50.413960 np0000001589 nova-compute[98297]: tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:50.413960 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:50.413960 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:50.413960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '57'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '58'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-50d68e0f-7eae-4ed8-a288-1a857d5d0ce5', '62'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ab889403-69a6-4093-b30a-4b2029962018', '63'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '65')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:05:50.414172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '57')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:50.414874 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0', '58')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:05:50.415687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b405799e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'): ({'sdd'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:05:50.415855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Removing multipathed devices sdd, sdc {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:05:50.416078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flush multipath device 3300000004425203b {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:05:50.452758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:50.493710 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:05:50.530795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:05:50.530980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:05:50.531836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:05:50.544164 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:05:50.544394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:05:50.559613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:50.592597 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.40.100,3260]
May 28 03:05:50.592597 np0000001589 nova-compute[98297]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.40.100,3260] successful.
May 28 03:05:50.592597 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:50.611578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:50.624501 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:50.657457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.50.100,3260]
May 28 03:05:50.657457 np0000001589 nova-compute[98297]: Logout of [sid: 58, target: iqn.2023-03.storpool.com:os--volume-f9248077-253b-40f9-be56-ac1428bf3fa0, portal: 192.168.50.100,3260] successful.
May 28 03:05:50.657457 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:50.672681 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:50.673167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:50.673167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] <== disconnect_volume: return (285ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:50.673167 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:05:51.222550 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'flavor' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:51.293036 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ef75e3ac-39ab-491b-9311-82ac83f54803 tempest-VolumesSnapshotTestJSON-1234909468 tempest-VolumesSnapshotTestJSON-1234909468-project-member] Lock "6aeff63a-cb33-4923-91c2-08b7756e9a0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.194s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:51.367118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:51.367756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:51.755966 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:05:51.871154 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:52.235781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-226345b0-5b70-4372-b29d-14b2dc495da0 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.070s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:52.472427 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:52.472697 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:52.472968 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:52.473174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:52.473374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:52.476168 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Terminating instance
May 28 03:05:52.710441 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:52.877550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:52.982318 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:05:53.000285 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.006047 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.018211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.030753 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.049646 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.055049 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.314049 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999758818999908 future=<Future at 0x7e4b64635790 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:53.317223 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Instance destroyed successfully.
May 28 03:05:53.317534 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'resources' on Instance uuid 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:53.500748 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.706843 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.820605 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:03:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1883072808',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1883072808',id=19,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDvX0yrsEjRQhKUbSQ0Yc3XjjtKhz/ncFm0Sil9E7SkHBYBK2NYUZQUu5nNL7aJJoGiJCfA7/qOELTS3lioIxM8ke4WsLvemWlzkT5i0Ad/EzJNrjkuhp15FoZFMIFek2Q==',key_name='tempest-keypair-1874979258',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:05:11Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-2kvbn7mi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:05:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=2f113470-8b6b-4ddc-b8c8-7f3cfa95803f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:05:53.820878 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "address": "fa:16:3e:de:6d:95", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf680b933-10", "ovs_interfaceid": "f680b933-10c8-4f0f-86e7-65aa46fd953d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:05:53.821242 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:05:53.821455 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:05:53.823416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.824058 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf680b933-10, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:53.826196 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:53.826718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:53.826833 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=079f672f-c7be-4f02-881c-42cec490437e) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:05:53.828088 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:05:53.829820 np0000001589 nova-compute[98297]: INFO os_vif [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:6d:95,bridge_name='br-int',has_traffic_filtering=True,id=f680b933-10c8-4f0f-86e7-65aa46fd953d,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf680b933-10')
May 28 03:05:53.830046 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Deleting instance files /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f_del
May 28 03:05:53.841180 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Deletion of /opt/stack/data/nova/instances/2f113470-8b6b-4ddc-b8c8-7f3cfa95803f_del complete
May 28 03:05:53.979719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:53.980148 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:53.980273 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attaching volume a664fd81-bb04-48af-ac5e-f1d04629e1c4 to /dev/vdc
May 28 03:05:54.029137 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:54.041452 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:05:54.069096 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:05:54.111109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:05:54.111351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:05:54.120123 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:05:54.121279 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe29:c86d', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1', 'fe80::fc16:3eff:fe42:3f7', 'fe80::48fd:4bff:fea3:f8b1'] 
May 28 03:05:54.121416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:05:54.121514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:05:54.121747 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:54.121999 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Updating existing volume attachment record: e2f0b391-012b-4f61-891f-e217da7f5746 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:05:54.348976 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 03:05:54.351374 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:05:54.351770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:05:54.351934 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:05:54.352289 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:54.487794 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:05:54.678943 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:05:54.679304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:05:54.679459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:54.679873 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:54.680038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:05:54.690275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:54.690648 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:54.690840 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:54.691428 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:05:54.693804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:05:54.694001 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:54.702753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:54.702753 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:54.706413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:05:54.706413 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:54.715372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4] added
May 28 03:05:54.715372 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:54.715372 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:54.715372 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:54.715372 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:54.715372 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:54.715372 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:54.715735 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:54.715807 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:54.715990 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:54.716815 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4] added
May 28 03:05:54.716815 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:05:54.716815 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:54.716815 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:54.716815 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:05:54.716815 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:05:54.716815 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:54.716976 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:05:54.717122 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0231(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:05:54.717251 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:05:55.109521 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5a9a4dd6-bfdc-486b-bed1-504443ce3538 req-57f74fdf-e8c6-4921-b115-47c87fafc01e service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Received event network-vif-deleted-f680b933-10c8-4f0f-86e7-65aa46fd953d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:05:55.109879 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-5a9a4dd6-bfdc-486b-bed1-504443ce3538 req-57f74fdf-e8c6-4921-b115-47c87fafc01e service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Neutron deleted interface f680b933-10c8-4f0f-86e7-65aa46fd953d; detaching it from the instance and deleting it from the info cache
May 28 03:05:55.112313 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5a9a4dd6-bfdc-486b-bed1-504443ce3538 req-57f74fdf-e8c6-4921-b115-47c87fafc01e service nova] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Detach interface failed, port_id=f680b933-10c8-4f0f-86e7-65aa46fd953d, reason: Instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:05:55.423568 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:55.562566 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:05:55.717544 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:05:55.719871 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:55.734264 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:55.734264 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:05:55.738242 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:05:55.738242 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.749956 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.754811 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.762575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.762575 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.762575 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:55.762575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.762575 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.762575 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:55.767938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.767938 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.767938 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:55.767938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.767938 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.767938 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:55.797760 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.40.100,3260]
May 28 03:05:55.797760 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.40.100,3260] successful.
May 28 03:05:55.797760 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.808065 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.50.100,3260]
May 28 03:05:55.808065 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.50.100,3260] successful.
May 28 03:05:55.808065 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.808734 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.818922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:05:55.825906 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.825906 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.825906 np0000001589 nova-compute[98297]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.825906 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.825906 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:55.826057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.826057 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.826057 np0000001589 nova-compute[98297]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.826057 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.826057 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:55.826443 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:55.826597 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:55.827327 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('7', '-', '-', 0) found on session 66 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:55.827327 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:05:55.836386 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:05:55.836386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] HCTL ('8', '-', '-', 0) found on session 67 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:05:55.836926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:05:55.846358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 66 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:55.846459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:55.858722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 67 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:56.064877 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Took 1.71 seconds to deallocate network for instance.
May 28 03:05:56.570644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:56.571065 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:56.856333 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:56.856584 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:56.858907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Searching for a device in session 67 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:05:56.858907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:05:57.060474 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:57.060670 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:57.360637 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:57.562611 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:05:57.708368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found WWN 3300000000dd1c1ab for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:05:57.708830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:05:57.708928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000000dd1c1ab', 'path': '/dev/dm-0', 'multipath_id': '3300000000dd1c1ab'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:05:57.709079 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000dd1c1ab', 'path': '/dev/dm-0', 'multipath_id': '3300000000dd1c1ab'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:05:57.709350 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:57.712100 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:05:57.798012 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:57.866999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.296s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:57.911571 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Deleted allocations for instance 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f
May 28 03:05:57.978322 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003735770001185301 future=<Future at 0x7e4b407afa40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:57.978466 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:57.978545 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.335295349000035 future=<Future at 0x7e4b64635790 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:57.978545 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.33521464699993 future=<Future at 0x7e4b64635790 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:05:57.980004 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] Emitting event <LifecycleEvent: 1779937542.9777493, 6aeff63a-cb33-4923-91c2-08b7756e9a0c => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:05:57.980004 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] VM Stopped (Lifecycle Event)
May 28 03:05:58.105165 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:05:58.105376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:05:58.109358 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:05:58.109524 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Claim successful on node np0000001589
May 28 03:05:58.214729 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attempting to attach volume a664fd81-bb04-48af-ac5e-f1d04629e1c4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:05:58.215766 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:05:58.215766 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:05:58.215766 np0000001589 nova-compute[98297]:   <alias name="ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4"/>
May 28 03:05:58.215766 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:05:58.215766 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:05:58.215766 np0000001589 nova-compute[98297]:   <serial>a664fd81-bb04-48af-ac5e-f1d04629e1c4</serial>
May 28 03:05:58.215766 np0000001589 nova-compute[98297]: </disk>
May 28 03:05:58.215766 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:05:58.302934 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] instance snapshotting
May 28 03:05:58.392552 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Beginning live snapshot process
May 28 03:05:58.482450 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b6c161be-7cf2-404b-b626-6a72b58d5cbb tempest-TaggedBootDevicesTest_v242-1074514621 tempest-TaggedBootDevicesTest_v242-1074514621-project-member] [instance: 6aeff63a-cb33-4923-91c2-08b7756e9a0c] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:05:58.828654 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:05:58.918648 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b780eb04-2431-4374-b0c6-03a8cff80bb7 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "2f113470-8b6b-4ddc-b8c8-7f3cfa95803f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.446s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:05:59.338742 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:05:59.338924 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:05:59.841687 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:05:59.866285 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:59.866448 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:59.866636 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:59.866636 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:05:59.866834 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] No VIF found with MAC fa:16:3e:29:c8:6d, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:05:59.904638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:00.018978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json -f qcow2" returned: 0 in 0.114s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:00.019474 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:00.105920 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json -f qcow2" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:00.106793 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:00.109398 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:00.109765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:00.194371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:00.194839 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqzvo7h37/b6df03cad0a247f294daef62c4527eaf.delta 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:00.247426 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqzvo7h37/b6df03cad0a247f294daef62c4527eaf.delta 1073741824" returned: 0 in 0.052s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:00.248208 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 03:06:00.352715 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.247s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:00.353272 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:06:00.546932 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] COPY block job progress, current cursor: 0 final cursor: 76611584 {{(pid=98297) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 03:06:00.863262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:06:00.863262 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:06:00.863262 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:00.863262 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:00.967703 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b36f423650a4e81a1983750d01cb19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941dc23a662045ee85f2a771bdbdae83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:06:01.047865 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] COPY block job progress, current cursor: 76611584 final cursor: 76611584 {{(pid=98297) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 03:06:01.049513 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 03:06:01.092206 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:06:01.092502 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqzvo7h37/b6df03cad0a247f294daef62c4527eaf.delta /opt/stack/data/nova/instances/snapshots/tmpqzvo7h37/b6df03cad0a247f294daef62c4527eaf {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:01.359196 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqzvo7h37/b6df03cad0a247f294daef62c4527eaf.delta /opt/stack/data/nova/instances/snapshots/tmpqzvo7h37/b6df03cad0a247f294daef62c4527eaf" returned: 0 in 0.266s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:01.363159 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Snapshot extracted, beginning image upload
May 28 03:06:01.367038 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:06:01.437401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f304a1a5-0897-4200-81dd-47f75406b4fb tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.457s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:01.483707 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Successfully created port: 9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:06:01.792683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:01.793035 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:01.871347 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:06:02.031239 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Successfully updated port: 9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:06:02.089737 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-changed-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:02.090090 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Refreshing instance network info cache due to event network-changed-9407337f-d5d5-40de-8d12-ba9bd9e9b885. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:02.090334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] Acquiring lock "refresh_cache-cfabfa9d-c2fe-41cc-92f4-adca28b33725" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:02.090469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] Acquired lock "refresh_cache-cfabfa9d-c2fe-41cc-92f4-adca28b33725" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:02.090619 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Refreshing network info cache for port 9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:02.121998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:02.122195 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:02.295747 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:06:02.537241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "refresh_cache-cfabfa9d-c2fe-41cc-92f4-adca28b33725" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:02.594721 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:02.627513 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Detaching volume f09c89d6-a259-4506-8984-0764bdb08167
May 28 03:06:02.676135 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attempting to driver detach volume f09c89d6-a259-4506-8984-0764bdb08167 from mountpoint /dev/vdb
May 28 03:06:02.680704 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found disk vdb by alias ua-f09c89d6-a259-4506-8984-0764bdb08167 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:06:02.682084 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found disk vdb by alias ua-f09c89d6-a259-4506-8984-0764bdb08167 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:06:02.682277 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Attempting to detach device vdb from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:06:02.682513 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:06:02.682513 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:02.682513 np0000001589 nova-compute[98297]:   <alias name="ua-f09c89d6-a259-4506-8984-0764bdb08167"/>
May 28 03:06:02.682513 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:06:02.682513 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:06:02.682513 np0000001589 nova-compute[98297]:   <serial>f09c89d6-a259-4506-8984-0764bdb08167</serial>
May 28 03:06:02.682513 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:06:02.682513 np0000001589 nova-compute[98297]: </disk>
May 28 03:06:02.682513 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:06:02.688182 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully detached device vdb from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the persistent domain config.
May 28 03:06:02.688352 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] (1/8): Attempting to detach device vdb with device alias ua-f09c89d6-a259-4506-8984-0764bdb08167 from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:06:02.688594 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:06:02.688594 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:02.688594 np0000001589 nova-compute[98297]:   <alias name="ua-f09c89d6-a259-4506-8984-0764bdb08167"/>
May 28 03:06:02.688594 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:06:02.688594 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:06:02.688594 np0000001589 nova-compute[98297]:   <serial>f09c89d6-a259-4506-8984-0764bdb08167</serial>
May 28 03:06:02.688594 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:06:02.688594 np0000001589 nova-compute[98297]: </disk>
May 28 03:06:02.688594 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:06:02.692686 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:02.710901 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:02.856923 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:02.872439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:02.872844 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:02.875539 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:06:02.875682 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Claim successful on node np0000001589
May 28 03:06:02.886341 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:06:02.887375 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:06:02.887632 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Creating image(s)
May 28 03:06:02.888155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:02.888346 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "/opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:02.888885 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "/opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:02.889493 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:02.893581 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:02.896907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:02.981192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:02.981590 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:02.982134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:02.982520 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:02.985504 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:02.985504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:03.067545 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:03.068012 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:03.118644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk 1073741824" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:03.119160 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.137s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:03.119684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:03.214387 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937563.2137284, 4a5225e8-8a5f-4192-91ac-513d048c59eb => ua-f09c89d6-a259-4506-8984-0764bdb08167> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:06:03.216327 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f09c89d6-a259-4506-8984-0764bdb08167 for instance 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:06:03.221411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:03.222149 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:06:03.222472 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:03.238122 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully detached device vdb from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the live domain config.
May 28 03:06:03.242657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:06:03.243626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f09c89d6-a259-4506-8984-0764bdb08167', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:03.244968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:03.244968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:03.245553 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f09c89d6-a259-4506-8984-0764bdb08167', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:06:03.245950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:06:03.270537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:06:03.270537 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:06:03.270537 np0000001589 nova-compute[98297]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:03.270537 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:03.270537 np0000001589 nova-compute[98297]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0004836-8416-4d60-a689-5313ab39541c (non-flash)
May 28 03:06:03.270537 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:03.270779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [64] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:06:03.270779 np0000001589 nova-compute[98297]: tcp: [65] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167 (non-flash)
May 28 03:06:03.270779 np0000001589 nova-compute[98297]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:03.270779 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:03.270779 np0000001589 nova-compute[98297]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0004836-8416-4d60-a689-5313ab39541c (non-flash)
May 28 03:06:03.270779 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:03.270779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '64'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0004836-8416-4d60-a689-5313ab39541c', '68')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:06:03.270964 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '65')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:03.271822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167', '64')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:03.272495 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646cb920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:06:03.272711 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Removing multipathed devices sdf, sde {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:06:03.272942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flush multipath device 33000000098999db5 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:06:03.320754 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:03.324069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:03.324484 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Cannot resize image /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:06:03.324851 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:06:03.325038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Ensure instance console log exists: /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:06:03.325325 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:03.325594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:03.325728 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:03.358866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15f41e35-68e5-44ee-9b8e-d266d69e4f60 req-1e487919-bfbf-4abe-ad0e-12eddcbbede8 service nova] Releasing lock "refresh_cache-cfabfa9d-c2fe-41cc-92f4-adca28b33725" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:03.359417 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquired lock "refresh_cache-cfabfa9d-c2fe-41cc-92f4-adca28b33725" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:03.359606 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:03.368239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:03.414076 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:06:03.414334 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:06:03.415305 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:06:03.428533 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:06:03.428781 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:06:03.442654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:03.482788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.40.100,3260]
May 28 03:06:03.482788 np0000001589 nova-compute[98297]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.40.100,3260] successful.
May 28 03:06:03.482788 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:03.507242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:03.520500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:03.559757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.50.100,3260]
May 28 03:06:03.559757 np0000001589 nova-compute[98297]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-f09c89d6-a259-4506-8984-0764bdb08167, portal: 192.168.50.100,3260] successful.
May 28 03:06:03.559757 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:03.574347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:03.574862 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:03.574862 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== disconnect_volume: return (331ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:03.575067 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:06:03.829942 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:03.956180 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:04.131747 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:04.182827 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:04.253840 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:04.254120 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:04.259968 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Snapshot image upload complete
May 28 03:06:04.260264 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-12677c44-27da-49cb-b4e6-0a8ba5bd4362 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Took 5.96 seconds to snapshot the instance on the hypervisor.
May 28 03:06:04.348329 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Updating instance_info_cache with network_info: [{"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:04.757115 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:04.762426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:04.852478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Releasing lock "refresh_cache-cfabfa9d-c2fe-41cc-92f4-adca28b33725" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:04.852808 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Instance network_info: |[{"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:06:04.854505 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Start _get_guest_xml network_info=[{"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:04.858097 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:04.859372 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-502742940', uuid='cfabfa9d-c2fe-41cc-92f4-adca28b33725'), owner=OwnerMeta(userid='4b36f423650a4e81a1983750d01cb19d', username='tempest-VolumesActionsTest-137056366-project-member', projectid='941dc23a662045ee85f2a771bdbdae83', projectname='tempest-VolumesActionsTest-137056366'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937564.8589306) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:04.860320 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:04.860619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:04.861575 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:04.861747 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:04.862617 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:04.862907 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:04.863039 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:04.863131 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:04.863255 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:04.863348 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:04.863440 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:04.863576 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:04.863670 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:04.863804 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:04.863903 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:04.864011 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:04.879940 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-502742940',display_name='tempest-VolumesActionsTest-instance-502742940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-502742940',id=27,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941dc23a662045ee85f2a771bdbdae83',ramdisk_id='',reservation_id='r-7iqy6t93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137056366',owner_user_name='tempest-VolumesActionsTest-137056366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:02Z,user_data=None,user_id='4b36f423650a4e81a1983750d01cb19d',uuid=cfabfa9d-c2fe-41cc-92f4-adca28b33725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:04.880178 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Converting VIF {"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:04.880933 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:dc:1f,bridge_name='br-int',has_traffic_filtering=True,id=9407337f-d5d5-40de-8d12-ba9bd9e9b885,network=Network(6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9407337f-d5') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:04.881448 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lazy-loading 'pci_devices' on Instance uuid cfabfa9d-c2fe-41cc-92f4-adca28b33725 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:05.142093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a150da63-0c70-4940-bb3a-8045f368aabd tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.019s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:05.268033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.395s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:05.268788 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:06:05.386750 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <uuid>cfabfa9d-c2fe-41cc-92f4-adca28b33725</uuid>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <name>instance-0000001b</name>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesActionsTest-instance-502742940</nova:name>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:04</nova:creationTime>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:user uuid="4b36f423650a4e81a1983750d01cb19d">tempest-VolumesActionsTest-137056366-project-member</nova:user>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:project uuid="941dc23a662045ee85f2a771bdbdae83">tempest-VolumesActionsTest-137056366</nova:project>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         <nova:port uuid="9407337f-d5d5-40de-8d12-ba9bd9e9b885">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <entry name="serial">cfabfa9d-c2fe-41cc-92f4-adca28b33725</entry>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <entry name="uuid">cfabfa9d-c2fe-41cc-92f4-adca28b33725</entry>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk.config"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:68:dc:1f"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <target dev="tap9407337f-d5"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/console.log" append="off"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:05.386750 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:05.388812 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Preparing to wait for external event network-vif-plugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:06:05.388812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:05.388812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:05.388812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:05.388812 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-502742940',display_name='tempest-VolumesActionsTest-instance-502742940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-502742940',id=27,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941dc23a662045ee85f2a771bdbdae83',ramdisk_id='',reservation_id='r-7iqy6t93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-137056366',owner_user_name='tempest-VolumesActionsTest-137056366-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:02Z,user_data=None,user_id='4b36f423650a4e81a1983750d01cb19d',uuid=cfabfa9d-c2fe-41cc-92f4-adca28b33725,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:06:05.388812 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Converting VIF {"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:05.388812 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:dc:1f,bridge_name='br-int',has_traffic_filtering=True,id=9407337f-d5d5-40de-8d12-ba9bd9e9b885,network=Network(6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9407337f-d5') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:05.389203 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:dc:1f,bridge_name='br-int',has_traffic_filtering=True,id=9407337f-d5d5-40de-8d12-ba9bd9e9b885,network=Network(6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9407337f-d5') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:06:05.389773 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:05.390102 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:05.390419 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:06:05.392902 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:05.393269 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '774f7ac4-db89-581c-b763-5de041e535c1', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:05.394058 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:05.395012 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:05.395709 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:05.400035 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:05.400207 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9407337f-d5, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:05.400566 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9407337f-d5, col_values=(('qos', UUID('8184e230-3903-44c2-8698-c6a52798bb8e')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:05.400812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9407337f-d5, col_values=(('external_ids', {'iface-id': '9407337f-d5d5-40de-8d12-ba9bd9e9b885', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:dc:1f', 'vm-uuid': 'cfabfa9d-c2fe-41cc-92f4-adca28b33725'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:05.401725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:05.403367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:05.409015 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:05.409871 np0000001589 nova-compute[98297]: INFO os_vif [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:dc:1f,bridge_name='br-int',has_traffic_filtering=True,id=9407337f-d5d5-40de-8d12-ba9bd9e9b885,network=Network(6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9407337f-d5')
May 28 03:06:05.505981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:05.506190 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:05.780341 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:06:05.780530 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:06:05.780792 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:05.780994 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:05.862410 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84aa869713da4347914ce6054de5ea1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c470ae60a73f43d183ba78fe4ed0d29b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:06:05.902033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:05.902200 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:06.010265 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Detaching volume a664fd81-bb04-48af-ac5e-f1d04629e1c4
May 28 03:06:06.051712 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Attempting to driver detach volume a664fd81-bb04-48af-ac5e-f1d04629e1c4 from mountpoint /dev/vdc
May 28 03:06:06.056378 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found disk vdc by alias ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:06:06.057683 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Found disk vdc by alias ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:06:06.057683 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Attempting to detach device vdc from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:06:06.057683 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:06:06.057683 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:06.057683 np0000001589 nova-compute[98297]:   <alias name="ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4"/>
May 28 03:06:06.057683 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:06:06.057683 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:06:06.057683 np0000001589 nova-compute[98297]:   <serial>a664fd81-bb04-48af-ac5e-f1d04629e1c4</serial>
May 28 03:06:06.057683 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:06:06.057683 np0000001589 nova-compute[98297]: </disk>
May 28 03:06:06.057683 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:06:06.067070 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully detached device vdc from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the persistent domain config.
May 28 03:06:06.067070 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] (1/8): Attempting to detach device vdc with device alias ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4 from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:06:06.067070 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:06:06.067070 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:06.067070 np0000001589 nova-compute[98297]:   <alias name="ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4"/>
May 28 03:06:06.067070 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:06:06.067070 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:06:06.067070 np0000001589 nova-compute[98297]:   <serial>a664fd81-bb04-48af-ac5e-f1d04629e1c4</serial>
May 28 03:06:06.067070 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:06:06.067070 np0000001589 nova-compute[98297]: </disk>
May 28 03:06:06.067070 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:06:06.283454 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:06:06.363385 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Successfully created port: bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:06:06.405690 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'flavor' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:06.642112 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937566.641732, 4a5225e8-8a5f-4192-91ac-513d048c59eb => ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:06:06.644730 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-a664fd81-bb04-48af-ac5e-f1d04629e1c4 for instance 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:06:06.647331 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully detached device vdc from instance 4a5225e8-8a5f-4192-91ac-513d048c59eb from the live domain config.
May 28 03:06:06.648064 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:06:06.648520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:06.649248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:06.649248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:06.649571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a664fd81-bb04-48af-ac5e-f1d04629e1c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:06:06.650047 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0004836-8416-4d60-a689-5313ab39541c (non-flash)
May 28 03:06:06.679464 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsi session list stdout=tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: tcp: [67] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4 (non-flash)
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e0004836-8416-4d60-a689-5313ab39541c (non-flash)
May 28 03:06:06.679464 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', '66'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e0004836-8416-4d60-a689-5313ab39541c', '68')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', '66')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4', '67')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:06.679464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64558ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:06:06.682784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:06:06.682784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Flush multipath device 3300000000dd1c1ab {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:06:06.726112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:06.768970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:06.787412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:06:06.822595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:06:06.822829 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:06:06.823474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:06:06.837688 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:06:06.837857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:06:06.853470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:06.884470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.40.100,3260]
May 28 03:06:06.884470 np0000001589 nova-compute[98297]: Logout of [sid: 66, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.40.100,3260] successful.
May 28 03:06:06.884470 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:06.903550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:06.918712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:06.924952 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:06.924952 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:06.925114 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] No VIF found with MAC fa:16:3e:68:dc:1f, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:06.925571 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Using config drive
May 28 03:06:06.954423 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.50.100,3260]
May 28 03:06:06.954423 np0000001589 nova-compute[98297]: Logout of [sid: 67, target: iqn.2023-03.storpool.com:os--volume-a664fd81-bb04-48af-ac5e-f1d04629e1c4, portal: 192.168.50.100,3260] successful.
May 28 03:06:06.954423 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:06.969025 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Successfully updated port: bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:06:06.970873 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:06.971377 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:06.971633 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] <== disconnect_volume: return (322ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:06.971866 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:06:07.183523 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:07.183523 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing instance network info cache due to event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:07.183523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] Acquiring lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:07.183523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] Acquired lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:07.183523 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing network info cache for port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:07.411617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:07.430759 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:07.474917 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:07.532431 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'flavor' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:07.554419 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Creating config drive at /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk.config
May 28 03:06:07.559980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5e63lqkf {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:07.614513 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5e63lqkf" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:07.687262 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:07.722103 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:07.768315 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:07.802517 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:06:07.805573 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:06:07.805864 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Creating image(s)
May 28 03:06:07.811474 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:07.811693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:07.812473 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:07.813787 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:07.819953 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:07.823072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:07.933892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.111s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:07.934444 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:07.934938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:07.935884 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:07.939211 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:07.939606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:08.007217 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:08.049381 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:08.049381 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:08.114820 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk 1073741824" returned: 0 in 0.066s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:08.115324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:08.115744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:08.168696 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:08.197814 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:08.219721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:08.220240 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:06:08.220470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:08.309029 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:08.314449 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0006149749999622145 future=<Future at 0x7e4b64635790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:08.314632 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:08.318249 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Emitting event <LifecycleEvent: 1779937553.3137321, 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:08.318249 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] VM Stopped (Lifecycle Event)
May 28 03:06:08.319630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:08.321931 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Cannot resize image /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:06:08.322310 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:06:08.322879 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Ensure instance console log exists: /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:06:08.322879 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:08.322978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:08.323064 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:08.512212 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a9e01f3c-f734-4e42-9717-aa26f1a18a6b req-335884d9-68e6-47e9-a30a-d4cf9aeeb938 service nova] Releasing lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:08.512706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquired lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:08.514331 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:08.546213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f872d28-30ed-4421-8ef6-00b331a02d96 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.040s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:08.552971 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:08.553085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:08.563963 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c094e89b-bf66-471f-a36c-e2b8dc7637a9 req-821e1f38-e9c3-40d3-b4d4-3b14d36a972a service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-vif-plugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:08.564252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c094e89b-bf66-471f-a36c-e2b8dc7637a9 req-821e1f38-e9c3-40d3-b4d4-3b14d36a972a service nova] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:08.564489 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c094e89b-bf66-471f-a36c-e2b8dc7637a9 req-821e1f38-e9c3-40d3-b4d4-3b14d36a972a service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:08.564754 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c094e89b-bf66-471f-a36c-e2b8dc7637a9 req-821e1f38-e9c3-40d3-b4d4-3b14d36a972a service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:08.565292 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c094e89b-bf66-471f-a36c-e2b8dc7637a9 req-821e1f38-e9c3-40d3-b4d4-3b14d36a972a service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Processing event network-vif-plugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:06:08.583274 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:08.589277 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:08.589277 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:08.592193 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:08.592193 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Attaching volume 55c9f28b-10c1-47c2-ae01-040e34795991 to /dev/vdb
May 28 03:06:08.620705 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:08.662829 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:08.680673 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:06:08.712436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:08.769026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:06:08.769098 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:06:08.781272 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:06:08.782063 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe29:c86d', 'fe80::f8a7:3dff:fea5:b4c6', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1', 'fe80::fc16:3eff:fe42:3f7', 'fe80::48fd:4bff:fea3:f8b1', 'fe80::fc16:3eff:fe68:dc1f', 'fe80::c84d:73ff:fe23:51ca'] 
May 28 03:06:08.782188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:06:08.782306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:06:08.783410 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:08.783596 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating existing volume attachment record: 9d34bc4c-92bd-430f-b74c-b0e6f45d1ee1 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:06:08.822729 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: 2f113470-8b6b-4ddc-b8c8-7f3cfa95803f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:08.835210 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:08.946945 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:09.059308 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lazy-loading 'flavor' on Instance uuid 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:09.129693 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937569.1292386, cfabfa9d-c2fe-41cc-92f4-adca28b33725 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:09.130309 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:06:09.130576 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] VM Started (Lifecycle Event)
May 28 03:06:09.133356 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:06:09.135361 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Instance spawned successfully.
May 28 03:06:09.135683 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:06:09.140115 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:09.265925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:09.265925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:09.265925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:09.265925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:09.265925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:09.269610 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Terminating instance
May 28 03:06:09.356705 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:06:09.357074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:09.357339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:09.357750 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:09.358036 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:06:09.371051 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:09.371633 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:09.371633 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:09.372778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:09.373318 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:09.374272 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:09.384307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:09.384307 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:09.389809 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:09.395933 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:09.395933 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:09.405732 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991] added
May 28 03:06:09.405732 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:09.405732 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:09.405732 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:09.405732 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:09.405732 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:09.405732 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:09.406012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:09.406599 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:09.406599 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:09.408656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991] added
May 28 03:06:09.408656 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:09.408656 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:09.408656 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:09.408656 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:09.408656 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:09.408656 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:09.408855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:09.408974 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:09.409090 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:09.633774 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:09.638069 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:09.650624 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:09.650770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:09.651100 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:09.651466 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:09.651614 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:09.651906 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:09.711785 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:09.772716 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:06:09.796113 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:09.797416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:09.817507 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:09.826858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:09.856856 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:09.862201 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.069779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:10.112824 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Instance destroyed successfully.
May 28 03:06:10.113150 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lazy-loading 'resources' on Instance uuid 4a5225e8-8a5f-4192-91ac-513d048c59eb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:10.141358 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:06:10.141582 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937570.1414351, cfabfa9d-c2fe-41cc-92f4-adca28b33725 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:10.141702 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] VM Paused (Lifecycle Event)
May 28 03:06:10.151337 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8478dae0-33b7-4e2b-bda7-1752bbf81133 req-5fa06909-7a6a-4564-98be-d961cb613be0 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-vif-unplugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:10.151426 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8478dae0-33b7-4e2b-bda7-1752bbf81133 req-5fa06909-7a6a-4564-98be-d961cb613be0 service nova] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:10.151624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8478dae0-33b7-4e2b-bda7-1752bbf81133 req-5fa06909-7a6a-4564-98be-d961cb613be0 service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:10.152049 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8478dae0-33b7-4e2b-bda7-1752bbf81133 req-5fa06909-7a6a-4564-98be-d961cb613be0 service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:10.152191 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8478dae0-33b7-4e2b-bda7-1752bbf81133 req-5fa06909-7a6a-4564-98be-d961cb613be0 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] No waiting events found dispatching network-vif-unplugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:10.152361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8478dae0-33b7-4e2b-bda7-1752bbf81133 req-5fa06909-7a6a-4564-98be-d961cb613be0 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-vif-unplugged-7e63aace-4454-4768-9919-9a82614e388b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:06:10.160251 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Took 7.27 seconds to spawn the instance on the hypervisor.
May 28 03:06:10.160373 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:10.213815 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Releasing lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:10.214156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance network_info: |[{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:06:10.215782 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Start _get_guest_xml network_info=[{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:10.218972 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:10.220551 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1400263001', uuid='94a458ec-8795-4832-93b3-cfda54f6444a'), owner=OwnerMeta(userid='84aa869713da4347914ce6054de5ea1e', username='tempest-AttachVolumeShelveTestJSON-653410335-project-member', projectid='c470ae60a73f43d183ba78fe4ed0d29b', projectname='tempest-AttachVolumeShelveTestJSON-653410335'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937570.2200997) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:10.222016 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:10.223302 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:10.226181 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:10.226634 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:10.227443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:10.227808 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:10.228005 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:10.228146 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:10.228337 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:10.228489 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:10.228647 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:10.228842 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:10.228989 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:10.229135 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:10.229874 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:10.229874 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:10.246138 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400263001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1400263001',id=28,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVVpdtpOMxw/GKIxCBvmnegmXanZB2Fx0ZByBEF5idz8qrnymJWQfBuAXPG0Bpxss5nXmXH32bO2I4hzMRCO1JRvOBtV1lIDSVolJiyfWpU902TGoqcIuDGx+v6E6uKQA==',key_name='tempest-keypair-1934369707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-fw9ni99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=94a458ec-8795-4832-93b3-cfda54f6444a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:10.246385 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:10.247362 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:10.247983 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:10.402944 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.406832 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:10.411331 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:10.418261 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:10.418261 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:10.425819 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:10.425819 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.431245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.438874 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.445380 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:06:10.445380 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:10.445593 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:06:10.445593 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:10.445776 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:06:10.445776 np0000001589 nova-compute[98297]: 
May 28 03:06:10.452100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:06:10.452100 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:10.452100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:06:10.452100 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:10.452100 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:06:10.452100 np0000001589 nova-compute[98297]: 
May 28 03:06:10.475053 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.40.100,3260]
May 28 03:06:10.475053 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.40.100,3260] successful.
May 28 03:06:10.475053 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.486889 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.50.100,3260]
May 28 03:06:10.486889 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.50.100,3260] successful.
May 28 03:06:10.486889 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.492656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.503126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:10.511790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.511790 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.511790 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:10.511934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.511934 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.511934 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:10.512170 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:10.512301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:10.516330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] HCTL ('7', '-', '-', 0) found on session 69 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:10.516330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:10.519563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.519563 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.519563 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:10.520027 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.520027 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:10.520027 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:10.520557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:10.521160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:10.522408 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] HCTL ('8', '-', '-', 0) found on session 70 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:10.522676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:10.531584 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching for a device in session 69 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:10.532169 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:10.548911 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching for a device in session 70 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:10.548911 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:10.616467 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:04:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1091621589',display_name='tempest-AttachVolumeTestJSON-server-1091621589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumetestjson-server-1091621589',id=24,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlF0XXl20zPLD7Ond0vj+wiN0ftezGjLzoeyQXL6qliOZBs9ZQvSBFaFzyAFJsFFZxgxHnWqtk/CxWshyOKJU/PWdG5NZ8ojPEukWlwcO4HT10Wj3c4fpcH0PwD0vc51A==',key_name='tempest-keypair-1760421558',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:05:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='989151e14dc44db3b75763b654bb2199',ramdisk_id='',reservation_id='r-hg01y9qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695798121',owner_user_name='tempest-AttachVolumeTestJSON-695798121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41af6183ea4b4a668518493baf359999',uuid=4a5225e8-8a5f-4192-91ac-513d048c59eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:06:10.616467 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converting VIF {"id": "7e63aace-4454-4768-9919-9a82614e388b", "address": "fa:16:3e:29:c8:6d", "network": {"id": "65abd08b-760b-4d2c-9c43-580b117ad429", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-684510449-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "989151e14dc44db3b75763b654bb2199", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e63aace-44", "ovs_interfaceid": "7e63aace-4454-4768-9919-9a82614e388b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:10.616806 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:c8:6d,bridge_name='br-int',has_traffic_filtering=True,id=7e63aace-4454-4768-9919-9a82614e388b,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e63aace-44') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:10.616875 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:c8:6d,bridge_name='br-int',has_traffic_filtering=True,id=7e63aace-4454-4768-9919-9a82614e388b,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e63aace-44') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:06:10.619554 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.624424 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e63aace-44, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:10.626037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.626549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:10.627950 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.630250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.630250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2bb3171f-ccf8-4c0d-9e0b-336b7c08b344) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:10.630250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.631337 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:10.636064 np0000001589 nova-compute[98297]: INFO os_vif [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:c8:6d,bridge_name='br-int',has_traffic_filtering=True,id=7e63aace-4454-4768-9919-9a82614e388b,network=Network(65abd08b-760b-4d2c-9c43-580b117ad429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e63aace-44')
May 28 03:06:10.636893 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Deleting instance files /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb_del
May 28 03:06:10.637093 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Deletion of /opt/stack/data/nova/instances/4a5225e8-8a5f-4192-91ac-513d048c59eb_del complete
May 28 03:06:10.643928 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:10.648145 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937570.647794, cfabfa9d-c2fe-41cc-92f4-adca28b33725 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:10.648418 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] VM Resumed (Lifecycle Event)
May 28 03:06:10.668248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cd078b24-01e1-4449-8f07-eb702aac66da req-050df515-af8a-416a-b73d-f22a52f3c4a6 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-vif-plugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:10.668780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd078b24-01e1-4449-8f07-eb702aac66da req-050df515-af8a-416a-b73d-f22a52f3c4a6 service nova] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:10.669107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd078b24-01e1-4449-8f07-eb702aac66da req-050df515-af8a-416a-b73d-f22a52f3c4a6 service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:10.669341 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd078b24-01e1-4449-8f07-eb702aac66da req-050df515-af8a-416a-b73d-f22a52f3c4a6 service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:10.669604 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cd078b24-01e1-4449-8f07-eb702aac66da req-050df515-af8a-416a-b73d-f22a52f3c4a6 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] No waiting events found dispatching network-vif-plugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:10.674012 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-cd078b24-01e1-4449-8f07-eb702aac66da req-050df515-af8a-416a-b73d-f22a52f3c4a6 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received unexpected event network-vif-plugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 for instance with vm_state active and task_state None.
May 28 03:06:10.677395 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Took 12.61 seconds to build instance.
May 28 03:06:10.750773 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <uuid>94a458ec-8795-4832-93b3-cfda54f6444a</uuid>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <name>instance-0000001c</name>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1400263001</nova:name>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:10</nova:creationTime>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:user uuid="84aa869713da4347914ce6054de5ea1e">tempest-AttachVolumeShelveTestJSON-653410335-project-member</nova:user>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:project uuid="c470ae60a73f43d183ba78fe4ed0d29b">tempest-AttachVolumeShelveTestJSON-653410335</nova:project>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         <nova:port uuid="bb7f8de4-e376-4c53-ac5b-b210ba6a74e2">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <entry name="serial">94a458ec-8795-4832-93b3-cfda54f6444a</entry>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <entry name="uuid">94a458ec-8795-4832-93b3-cfda54f6444a</entry>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:eb:12:d7"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <target dev="tapbb7f8de4-e3"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/console.log" append="off"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:10.750773 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:10.753663 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Preparing to wait for external event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:06:10.753663 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:10.753663 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:10.753663 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:10.753663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400263001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1400263001',id=28,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVVpdtpOMxw/GKIxCBvmnegmXanZB2Fx0ZByBEF5idz8qrnymJWQfBuAXPG0Bpxss5nXmXH32bO2I4hzMRCO1JRvOBtV1lIDSVolJiyfWpU902TGoqcIuDGx+v6E6uKQA==',key_name='tempest-keypair-1934369707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-fw9ni99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=94a458ec-8795-4832-93b3-cfda54f6444a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:06:10.755320 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:10.755320 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:10.755320 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:06:10.755569 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.755806 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:10.756018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:06:10.756880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.756939 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8067dc0a-ee3d-56a3-9208-fd6bde46c34d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:10.757926 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.758695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:10.759097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.761352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.761477 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb7f8de4-e3, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:10.761763 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb7f8de4-e3, col_values=(('qos', UUID('5ebc27ec-606c-4f9f-ac39-44b0fbb7a1bc')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:10.761898 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb7f8de4-e3, col_values=(('external_ids', {'iface-id': 'bb7f8de4-e376-4c53-ac5b-b210ba6a74e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:12:d7', 'vm-uuid': '94a458ec-8795-4832-93b3-cfda54f6444a'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:10.762594 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.764014 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:10.771305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:10.772766 np0000001589 nova-compute[98297]: INFO os_vif [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3')
May 28 03:06:11.143505 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 03:06:11.144337 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:06:11.144337 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:06:11.144490 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:06:11.144596 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:11.151199 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:11.155075 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:11.183278 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8654766-3152-49b4-a719-88802cd657c5 tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.122s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:11.226111 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:11.301774 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:11.313519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:11.313812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:11.314094 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Attaching volume 90d2e13b-48b8-4a20-9f03-b9845c81d39b to /dev/vdb
May 28 03:06:11.375114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:06:11.382636 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:11.410191 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:06:11.445295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:11.500866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:06:11.500866 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:06:11.511396 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:06:11.512772 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1', 'fe80::fc16:3eff:fe42:3f7', 'fe80::48fd:4bff:fea3:f8b1', 'fe80::fc16:3eff:fe68:dc1f', 'fe80::c84d:73ff:fe23:51ca'] 
May 28 03:06:11.512772 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:06:11.513141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:06:11.513141 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:11.514803 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating existing volume attachment record: 0664b7a9-2b0b-4e81-a233-bdbc7db8d579 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:06:11.658470 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999600832999704 future=<Future at 0x7e4b40403830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:11.658844 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999256970999795 future=<Future at 0x7e4b40403830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:11.658880 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999130133999643 future=<Future at 0x7e4b40403830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:12.088034 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:06:12.088730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:12.088730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:12.192729 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:12.230421 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fb1f773b-5e77-44f8-a660-7290a87954cd req-14ce5116-902d-460c-bf8d-5b9072f797b4 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-vif-unplugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:12.230421 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb1f773b-5e77-44f8-a660-7290a87954cd req-14ce5116-902d-460c-bf8d-5b9072f797b4 service nova] Acquiring lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:12.230633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb1f773b-5e77-44f8-a660-7290a87954cd req-14ce5116-902d-460c-bf8d-5b9072f797b4 service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:12.230689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb1f773b-5e77-44f8-a660-7290a87954cd req-14ce5116-902d-460c-bf8d-5b9072f797b4 service nova] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:12.230829 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fb1f773b-5e77-44f8-a660-7290a87954cd req-14ce5116-902d-460c-bf8d-5b9072f797b4 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] No waiting events found dispatching network-vif-unplugged-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:12.230959 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fb1f773b-5e77-44f8-a660-7290a87954cd req-14ce5116-902d-460c-bf8d-5b9072f797b4 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-vif-unplugged-7e63aace-4454-4768-9919-9a82614e388b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:06:12.291307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:12.291413 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:12.291518 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No VIF found with MAC fa:16:3e:eb:12:d7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:12.292058 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Using config drive
May 28 03:06:12.389735 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Found WWN 330000000e37b5d04 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:06:12.390128 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:12.390333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000e37b5d04', 'path': '/dev/dm-0', 'multipath_id': '330000000e37b5d04'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:12.390466 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e37b5d04', 'path': '/dev/dm-0', 'multipath_id': '330000000e37b5d04'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:06:12.390902 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.302s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:12.391131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:06:12.392644 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'flavor' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:12.402793 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:12.403437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:12.404660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:12.405351 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:12.408316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:12.408316 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:12.421088 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:12.421088 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:12.427373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:12.427373 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:12.435175 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b] added
May 28 03:06:12.435175 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:12.435175 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:12.435175 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:12.435175 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:12.435175 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:12.435175 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:12.435429 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:12.435551 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:12.435667 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:12.440071 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b] added
May 28 03:06:12.440071 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:12.440071 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:12.440071 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:12.440071 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:12.440071 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:12.440071 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:12.440237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:12.440428 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0341(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:12.440583 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:12.697902 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Took 1.55 seconds to deallocate network for instance.
May 28 03:06:12.723843 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:12.748595 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4da13694-9914-4292-9ecc-93e7f49a0e88 req-048c6bb9-d9af-44da-99c3-3dd57d519cc4 service nova] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Received event network-vif-deleted-7e63aace-4454-4768-9919-9a82614e388b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:12.800871 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:12.895161 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Attempting to attach volume 55c9f28b-10c1-47c2-ae01-040e34795991 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:06:12.896732 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:06:12.896732 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:12.896732 np0000001589 nova-compute[98297]:   <alias name="ua-55c9f28b-10c1-47c2-ae01-040e34795991"/>
May 28 03:06:12.896732 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:06:12.896732 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:06:12.896732 np0000001589 nova-compute[98297]:   <serial>55c9f28b-10c1-47c2-ae01-040e34795991</serial>
May 28 03:06:12.896732 np0000001589 nova-compute[98297]: </disk>
May 28 03:06:12.896732 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:06:12.926118 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Creating config drive at /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config
May 28 03:06:12.931368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx6anq04h {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:12.989068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx6anq04h" returned: 0 in 0.057s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:13.204963 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:13.205157 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:13.331818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.437294 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:13.441356 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:13.454215 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:13.454215 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:13.460550 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:13.460550 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.470703 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.482909 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.488886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.488886 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.488886 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:13.489074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.489074 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.489074 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:13.504616 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.504616 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.504616 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:13.504815 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.504815 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.504815 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:13.516322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.525232 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260]
May 28 03:06:13.525232 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260] successful.
May 28 03:06:13.525232 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.529041 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:13.529392 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:13.540486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.545706 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.547648 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.554352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260]
May 28 03:06:13.554352 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260] successful.
May 28 03:06:13.554352 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.560730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.560730 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.560730 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.560730 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.560730 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:13.560982 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.560982 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.560982 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.560982 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.560982 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:13.561363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:13.561864 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:13.562590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] HCTL ('9', '-', '-', 0) found on session 71 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:13.562691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:13.574717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:13.583404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching for a device in session 71 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:13.583404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:13.590539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.590539 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.590539 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.590539 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.590539 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:13.590783 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.590783 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:13.590783 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.590783 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:13.590783 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:13.591050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:13.591188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:13.591906 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] HCTL ('10', '-', '-', 0) found on session 72 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:13.592040 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:13.607888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching for a device in session 72 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:13.608153 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:13.669025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.960420 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.963569 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.968791 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:13.993733 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:14.034339 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:14.405424 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:06:14.410503 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937574.4101045, 94a458ec-8795-4832-93b3-cfda54f6444a => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:14.410778 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Started (Lifecycle Event)
May 28 03:06:14.543439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.338s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:14.559988 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:14.560119 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:14.560211 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:14.560347 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No VIF found with MAC fa:16:3e:67:17:a7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:14.610993 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Deleted allocations for instance 4a5225e8-8a5f-4192-91ac-513d048c59eb
May 28 03:06:14.914108 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:14.916063 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937574.915865, 94a458ec-8795-4832-93b3-cfda54f6444a => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:14.916188 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Paused (Lifecycle Event)
May 28 03:06:15.211484 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:15.420116 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:15.431068 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:15.431068 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Found WWN 330000000bbb95063 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:06:15.431068 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:15.431068 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== connect_volume: return (3341ms) {'type': 'block', 'scsi_wwn': '330000000bbb95063', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb95063'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:15.431068 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bbb95063', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb95063'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:06:15.436362 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lazy-loading 'flavor' on Instance uuid 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:15.475388 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:15.619519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75121fae-6662-48c3-b79b-fe29546b92f9 tempest-AttachVolumeTestJSON-695798121 tempest-AttachVolumeTestJSON-695798121-project-member] Lock "4a5225e8-8a5f-4192-91ac-513d048c59eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.354s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:15.763976 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:15.932999 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:06:15.939977 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Attempting to attach volume 90d2e13b-48b8-4a20-9f03-b9845c81d39b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:06:15.945457 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:06:15.945457 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:15.945457 np0000001589 nova-compute[98297]:   <alias name="ua-90d2e13b-48b8-4a20-9f03-b9845c81d39b"/>
May 28 03:06:15.945457 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:06:15.945457 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:06:15.945457 np0000001589 nova-compute[98297]:   <serial>90d2e13b-48b8-4a20-9f03-b9845c81d39b</serial>
May 28 03:06:15.945457 np0000001589 nova-compute[98297]: </disk>
May 28 03:06:15.945457 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:06:16.118480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-160a9ec8-6aba-4a06-8cc7-d654b4ec959a tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.530s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:16.617519 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Rescuing
May 28 03:06:16.617864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:16.617976 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquired lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:16.618131 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:16.762261 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f55037d6-51a3-4a9a-af4f-c2bc3cfb7c05 req-fa99e04f-3b9e-4f87-ac97-87acc6d0b6aa service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:16.762261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f55037d6-51a3-4a9a-af4f-c2bc3cfb7c05 req-fa99e04f-3b9e-4f87-ac97-87acc6d0b6aa service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:16.762261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f55037d6-51a3-4a9a-af4f-c2bc3cfb7c05 req-fa99e04f-3b9e-4f87-ac97-87acc6d0b6aa service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:16.762261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f55037d6-51a3-4a9a-af4f-c2bc3cfb7c05 req-fa99e04f-3b9e-4f87-ac97-87acc6d0b6aa service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:16.762261 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f55037d6-51a3-4a9a-af4f-c2bc3cfb7c05 req-fa99e04f-3b9e-4f87-ac97-87acc6d0b6aa service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Processing event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:06:16.763207 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:06:16.767735 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937576.767487, 94a458ec-8795-4832-93b3-cfda54f6444a => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:16.767935 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Resumed (Lifecycle Event)
May 28 03:06:16.769088 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:06:16.773561 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance spawned successfully.
May 28 03:06:16.773864 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:06:16.849081 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:16.849278 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:16.849444 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:16.849563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:16.849683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:16.851850 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Terminating instance
May 28 03:06:17.121994 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:17.274505 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:17.287257 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:17.291422 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:17.291550 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:17.291914 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:17.292170 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:17.292479 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:17.292764 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:17.303406 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.354642 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:06:17.377785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.381218 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.409000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.409000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.433282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.439065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.622357 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:17.622743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:17.622743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:17.622743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No VIF found with MAC fa:16:3e:42:03:f7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:17.625626 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:17.714644 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Instance destroyed successfully.
May 28 03:06:17.718254 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lazy-loading 'resources' on Instance uuid cfabfa9d-c2fe-41cc-92f4-adca28b33725 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:17.726485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:17.790025 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:06:17.790415 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99980679999976 future=<Future at 0x7e4b645ffc80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:17.798174 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:17.812654 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Took 10.01 seconds to spawn the instance on the hypervisor.
May 28 03:06:17.813953 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:18.218243 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-502742940',display_name='tempest-VolumesActionsTest-instance-502742940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-502742940',id=27,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:10Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941dc23a662045ee85f2a771bdbdae83',ramdisk_id='',reservation_id='r-7iqy6t93',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-137056366',owner_user_name='tempest-VolumesActionsTest-137056366-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:10Z,user_data=None,user_id='4b36f423650a4e81a1983750d01cb19d',uuid=cfabfa9d-c2fe-41cc-92f4-adca28b33725,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:06:18.218705 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Converting VIF {"id": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "address": "fa:16:3e:68:dc:1f", "network": {"id": "6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-374962467-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "941dc23a662045ee85f2a771bdbdae83", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9407337f-d5", "ovs_interfaceid": "9407337f-d5d5-40de-8d12-ba9bd9e9b885", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:18.219314 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:dc:1f,bridge_name='br-int',has_traffic_filtering=True,id=9407337f-d5d5-40de-8d12-ba9bd9e9b885,network=Network(6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9407337f-d5') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:18.219613 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:dc:1f,bridge_name='br-int',has_traffic_filtering=True,id=9407337f-d5d5-40de-8d12-ba9bd9e9b885,network=Network(6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9407337f-d5') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:06:18.223430 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:18.223707 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9407337f-d5, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:18.224687 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:18.227306 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:18.229292 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:18.229471 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8184e230-3903-44c2-8698-c6a52798bb8e) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:18.231066 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:18.231666 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:18.233670 np0000001589 nova-compute[98297]: INFO os_vif [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:dc:1f,bridge_name='br-int',has_traffic_filtering=True,id=9407337f-d5d5-40de-8d12-ba9bd9e9b885,network=Network(6eb282d1-5bdf-43c6-8c0a-f49af3a1d64c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9407337f-d5')
May 28 03:06:18.233974 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Deleting instance files /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725_del
May 28 03:06:18.234536 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Deletion of /opt/stack/data/nova/instances/cfabfa9d-c2fe-41cc-92f4-adca28b33725_del complete
May 28 03:06:18.300461 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Releasing lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:18.325270 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Took 15.52 seconds to build instance.
May 28 03:06:18.739380 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 03:06:18.740169 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:06:18.740405 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:06:18.740477 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:06:18.740675 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:18.827740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1bd9b1be-a7b1-4a29-85fb-4af5a57cc3f8 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.035s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:18.873360 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] No waiting events found dispatching network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received unexpected event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 for instance with vm_state active and task_state None.
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-vif-unplugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] No waiting events found dispatching network-vif-unplugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-vif-unplugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-vif-unplugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Acquiring lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] No waiting events found dispatching network-vif-unplugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:18.876205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0dee8574-b084-44aa-96c6-a7a7550842d5 req-24dc8e65-3e05-4751-8fd4-32ceef6f1971 service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-vif-unplugged-9407337f-d5d5-40de-8d12-ba9bd9e9b885 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:06:18.916198 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:19.194618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-84cd03df-e706-4e7f-ab4e-316a73b5c15b tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.881s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:19.343760 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-83584ba5-a338-4272-b27a-a5eca8336af9 req-56011447-7eac-42af-8124-c91212e1734b service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Received event network-vif-deleted-9407337f-d5d5-40de-8d12-ba9bd9e9b885 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:19.343760 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-83584ba5-a338-4272-b27a-a5eca8336af9 req-56011447-7eac-42af-8124-c91212e1734b service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Neutron deleted interface 9407337f-d5d5-40de-8d12-ba9bd9e9b885; detaching it from the instance and deleting it from the info cache
May 28 03:06:19.346145 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-83584ba5-a338-4272-b27a-a5eca8336af9 req-56011447-7eac-42af-8124-c91212e1734b service nova] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Detach interface failed, port_id=9407337f-d5d5-40de-8d12-ba9bd9e9b885, reason: Instance cfabfa9d-c2fe-41cc-92f4-adca28b33725 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:06:19.784125 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:19.977827 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:19.980696 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:20.009070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:20.040960 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:20.289438 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Took 1.55 seconds to deallocate network for instance.
May 28 03:06:20.318700 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99965400400015 future=<Future at 0x7e4b645343b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:20.320002 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance destroyed successfully.
May 28 03:06:20.320149 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'numa_topology' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:20.800373 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:20.800373 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:20.827127 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Attempting a stable device rescue
May 28 03:06:20.987603 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98297) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 03:06:20.991098 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:20.991098 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing instance network info cache due to event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:20.991098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] Acquiring lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:20.991098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] Acquired lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:20.991502 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing network info cache for port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:21.000496 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:06:21.000589 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Creating image(s)
May 28 03:06:21.001327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:21.001488 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:21.002030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:21.002196 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'trusted_certs' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:21.153107 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:21.153367 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:21.423485 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:21.423701 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:21.425938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:21.425938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:21.425938 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:21.425938 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state active and task_state rescuing.
May 28 03:06:21.426251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:21.426293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:21.426606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:21.426606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:21.426719 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:21.426878 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-14e9ea2b-eb74-4604-bfcd-9b5601ae8fbc req-c7306db3-3f60-4a92-9a83-99e7cecb22a0 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state active and task_state rescuing.
May 28 03:06:21.499756 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:21.506788 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:21.507110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "b353f98382673f82c320294c51cc1de5d0eedd3d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:21.507541 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "b353f98382673f82c320294c51cc1de5d0eedd3d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:21.656267 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:22.139859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Stashing vm_state: active {{(pid=98297) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 03:06:22.166510 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.366s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:22.299367 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Deleted allocations for instance cfabfa9d-c2fe-41cc-92f4-adca28b33725
May 28 03:06:22.424462 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:22.427154 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:22.427436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:22.456278 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:22.546697 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.part --force-share --output=json" returned: 0 in 0.119s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:22.547530 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] 35c3b5ec-ea40-40f7-a747-0e4e696b8903 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:06:22.547791 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:06:22.548524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.part /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:22.660789 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updated VIF entry in instance network info cache for port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:06:22.661154 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:22.704010 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:22.704088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:22.727859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.part /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.converted" returned: 0 in 0.179s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:22.727859 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:22.744459 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:22.852598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d.converted --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:22.853292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "b353f98382673f82c320294c51cc1de5d0eedd3d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.346s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:22.854218 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:22.859069 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:22.860785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "b353f98382673f82c320294c51cc1de5d0eedd3d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:22.861414 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "b353f98382673f82c320294c51cc1de5d0eedd3d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:22.861939 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:22.866851 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:22.867572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:22.885758 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:22.975841 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:22.976239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d,backing_fmt=raw /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.rescue {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:23.004614 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:23.005572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:23.057003 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b353f98382673f82c320294c51cc1de5d0eedd3d,backing_fmt=raw /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.rescue" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:23.057585 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "b353f98382673f82c320294c51cc1de5d0eedd3d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:23.057837 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'migration_context' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:23.163961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-43bc954f-e758-4b2d-80cc-e2f07bc16d7d req-027e60a3-f8e5-4c1b-a3b6-abf0e1c496d6 service nova] Releasing lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:23.212339 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:06:23.212527 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Claim successful on node np0000001589
May 28 03:06:23.230844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:23.318724 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4fde0561-3116-4855-a190-7cb5ad81a40a tempest-VolumesActionsTest-137056366 tempest-VolumesActionsTest-137056366-project-member] Lock "cfabfa9d-c2fe-41cc-92f4-adca28b33725" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.469s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:23.333841 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:23.512599 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:06:23.559963 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:23.560247 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:06:23.565726 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Start _get_guest_xml network_info=[{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "vif_mac": "fa:16:3e:67:17:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '35c3b5ec-ea40-40f7-a747-0e4e696b8903', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '9d34bc4c-92bd-430f-b74c-b0e6f45d1ee1', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'ce889453-d238-4bd1-b6b7-88c0ac65a869', 'attached_at': '', 'detached_at': '', 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'serial': '55c9f28b-10c1-47c2-ae01-040e34795991'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:23.565979 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'resources' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:23.718546 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating resource usage from migration 0d3a6311-e5fa-450e-96c7-05a090cbb047
May 28 03:06:24.020339 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:24.020803 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:24.068910 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:24.072840 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:24.073926 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-197666698', uuid='ce889453-d238-4bd1-b6b7-88c0ac65a869'), owner=OwnerMeta(userid='51c000d2ac2941a8ad517313e98a3c14', username='tempest-ServerStableDeviceRescueTest-846481241-project-member', projectid='38899ad6345442358b17adfcc1ba57a7', projectname='tempest-ServerStableDeviceRescueTest-846481241'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "vif_mac": "fa:16:3e:67:17:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937584.0735915) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:24.075424 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:24.075785 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:24.078001 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:24.078192 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:24.079192 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:24.079547 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:24.079725 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:24.079855 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:24.080016 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:24.080124 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:24.080262 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:24.080443 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:24.080573 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:24.080699 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:24.080938 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:24.081083 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:24.081264 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:24.087851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:24.525563 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:24.585518 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:24.599704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:24.724437 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config --force-share --output=json" returned: 0 in 0.121s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:24.725215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:24.725633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:24.726314 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:24.726848 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:06:24.728426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:24.728426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:24.728426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:24.728426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:06:24.751145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:24.751495 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:24.751660 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:24.752106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:24.752434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:24.752568 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:24.769325 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:24.769325 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:24.773783 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:24.773783 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:24.787216 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:24.798136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:24.802954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.802954 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.802954 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.802954 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.802954 np0000001589 nova-compute[98297]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a88891-b3e3-43b8-a442-2bb34a62b1c8 (non-flash)
May 28 03:06:24.802954 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:24.805038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.805038 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.805038 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.805038 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.805038 np0000001589 nova-compute[98297]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a88891-b3e3-43b8-a442-2bb34a62b1c8 (non-flash)
May 28 03:06:24.805038 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:24.805038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.052s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:24.805038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:24.807057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] HCTL ('8', '0', '0', 0) found on session 70 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:24.807244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:24.815612 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.815612 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.815612 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.815612 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.815612 np0000001589 nova-compute[98297]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a88891-b3e3-43b8-a442-2bb34a62b1c8 (non-flash)
May 28 03:06:24.815612 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:24.815859 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.815859 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:24.815859 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.815859 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:24.815859 np0000001589 nova-compute[98297]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a88891-b3e3-43b8-a442-2bb34a62b1c8 (non-flash)
May 28 03:06:24.815859 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:24.816045 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:24.816568 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:24.817844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching for a device in session 70 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:24.817844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] HCTL ('7', '0', '0', 0) found on session 69 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:24.819297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:24.819297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:24.828519 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Searching for a device in session 69 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:24.828657 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:25.035569 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.331s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:25.035759 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Migrating
May 28 03:06:25.037161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.948s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:25.037161 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:06:25.046045 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:06:25.046045 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Claim successful on node np0000001589
May 28 03:06:25.557861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:25.558314 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquired lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:25.558314 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:25.753478 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:06:26.061686 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:26.285400 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:26.289460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:26.504122 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:26.555517 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:26.555873 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:26.660027 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004936940003972268 future=<Future at 0x7e4b40403830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:26.660027 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:26.660027 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.131371062999733 future=<Future at 0x7e4b645ffc80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:26.660027 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Emitting event <LifecycleEvent: 1779937571.6579278, 4a5225e8-8a5f-4192-91ac-513d048c59eb => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:26.660027 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.130736857999636 future=<Future at 0x7e4b645ffc80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:26.660027 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] VM Stopped (Lifecycle Event)
May 28 03:06:26.679209 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:26.776680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Found WWN 330000000e37b5d04 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:06:26.777000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.049s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:26.777192 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] <== connect_volume: return (2049ms) {'type': 'block', 'scsi_wwn': '330000000e37b5d04', 'path': '/dev/dm-0', 'multipath_id': '330000000e37b5d04'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:26.777392 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e37b5d04', 'path': '/dev/dm-0', 'multipath_id': '330000000e37b5d04'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:06:26.792075 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:06:27.058415 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:27.162382 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: 4a5225e8-8a5f-4192-91ac-513d048c59eb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:27.181814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Releasing lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:27.287617 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-197666698',display_name='tempest-ServerStableDeviceRescueTest-server-197666698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverstabledevicerescuetest-server-197666698',id=25,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Rwh/1DBZW4ET9PMngZjI2tFG3gaSx0f2my4NydSbzlpMQD8jwfKjT5W77Qn23eIfcPL8BcQtHkPU9YetpUHDmKNGmcu3YcJx8R7RTB2RK2rvUbbv49yWyj9+1boe1XQ==',key_name='tempest-keypair-1487384353',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:05:18Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38899ad6345442358b17adfcc1ba57a7',ramdisk_id='',reservation_id='r-kj0o62kr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-846481241',owner_user_name='tempest-ServerStableDeviceRescueTest-846481241-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51c000d2ac2941a8ad517313e98a3c14',uuid=ce889453-d238-4bd1-b6b7-88c0ac65a869,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "vif_mac": "fa:16:3e:67:17:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:27.287920 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converting VIF {"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "vif_mac": "fa:16:3e:67:17:a7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:27.288803 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:27.290163 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'pci_devices' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:27.375243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:27.564447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.529s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:27.564999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.192s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:27.565219 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:06:27.570044 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:06:27.570264 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Claim successful on node np0000001589
May 28 03:06:27.727426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:27.792736 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:27.793871 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <uuid>ce889453-d238-4bd1-b6b7-88c0ac65a869</uuid>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <name>instance-00000019</name>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-197666698</nova:name>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:24</nova:creationTime>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:user uuid="51c000d2ac2941a8ad517313e98a3c14">tempest-ServerStableDeviceRescueTest-846481241-project-member</nova:user>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:project uuid="38899ad6345442358b17adfcc1ba57a7">tempest-ServerStableDeviceRescueTest-846481241</nova:project>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         <nova:port uuid="75347773-ab8a-4c09-88b9-fed091f53c27">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <entry name="serial">ce889453-d238-4bd1-b6b7-88c0ac65a869</entry>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <entry name="uuid">ce889453-d238-4bd1-b6b7-88c0ac65a869</entry>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <alias name="ua-55c9f28b-10c1-47c2-ae01-040e34795991"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <serial>55c9f28b-10c1-47c2-ae01-040e34795991</serial>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.rescue"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <target dev="vdc" bus="virtio"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <boot order="1"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:67:17:a7"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <target dev="tap75347773-ab"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/console.log" append="off"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:27.793871 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:27.797809 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance destroyed successfully.
May 28 03:06:28.070797 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:06:28.071037 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:06:28.071379 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:28.071675 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:28.164311 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '789a34f4e22e4235b9437415b1b4295f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80ff1bde877e4c3d9883c34167e979ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:06:28.232145 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:28.575128 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:06:28.700902 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Starting migrate_disk_and_power_off {{(pid=98297) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 03:06:28.729731 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Successfully created port: 3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:06:28.743051 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:28.759669 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:28.763359 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:28.795360 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:28.798695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:28.935999 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7265cfd0-2a1f-4773-9b79-b4b6b579948a req-711e2eeb-1f4e-4d6a-a942-13233e0ace44 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:28.936150 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7265cfd0-2a1f-4773-9b79-b4b6b579948a req-711e2eeb-1f4e-4d6a-a942-13233e0ace44 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:28.936332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7265cfd0-2a1f-4773-9b79-b4b6b579948a req-711e2eeb-1f4e-4d6a-a942-13233e0ace44 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:28.936441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7265cfd0-2a1f-4773-9b79-b4b6b579948a req-711e2eeb-1f4e-4d6a-a942-13233e0ace44 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:28.936565 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7265cfd0-2a1f-4773-9b79-b4b6b579948a req-711e2eeb-1f4e-4d6a-a942-13233e0ace44 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:28.936653 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-7265cfd0-2a1f-4773-9b79-b4b6b579948a req-711e2eeb-1f4e-4d6a-a942-13233e0ace44 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state active and task_state resize_migrating.
May 28 03:06:29.020804 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:29.020804 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:29.053991 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998694081000394 future=<Future at 0x7e4b6457e660 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:29.055303 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance destroyed successfully.
May 28 03:06:29.056367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:05:28Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:06:29.056698 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:29.057062 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:29.057175 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:06:29.058681 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:29.058828 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e0891b-94, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:29.059880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:29.061523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:29.066117 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:29.067912 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:29.067912 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5199ec6-1657-4822-aa60-7dae6e4c1145) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:29.067912 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:29.068089 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:29.073275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:29.076076 np0000001589 nova-compute[98297]: INFO os_vif [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94')
May 28 03:06:29.076335 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:06:29.076566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:29.076670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:29.084203 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:06:29.138154 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:29.138549 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:06:29.323742 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:29.323885 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:29.323988 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:29.324087 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:29.324194 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] No VIF found with MAC fa:16:3e:67:17:a7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:29.324843 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Using config drive
May 28 03:06:29.356770 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Successfully updated port: 3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:06:29.413738 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-changed-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:29.413843 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Refreshing instance network info cache due to event network-changed-3c087db3-1b24-4587-ae88-e36dceb37f8f. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:29.414010 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] Acquiring lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:29.414301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] Acquired lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:29.414425 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Refreshing network info cache for port 3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:29.523866 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:29.827528 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'ec2_ids' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:29.859467 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:29.916081 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:29.983566 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:30.032526 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.468s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:30.033040 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:06:30.095972 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:06:30.097006 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:06:30.097240 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Creating image(s)
May 28 03:06:30.097711 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "/opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:30.097967 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "/opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:30.098587 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "/opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:30.099072 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:30.103270 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:30.104617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:30.124467 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:30.207602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.103s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:30.209247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:30.209247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:30.209247 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:30.211569 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:30.212207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:30.299557 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:30.299960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:30.335550 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:30.335976 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'keypairs' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:30.359086 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk 1073741824" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:30.359530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:30.359814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:30.460425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:30.460878 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:06:30.461138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:30.545506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:06:30.547321 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:06:30.548449 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:30.548518 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:30.550783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:30.551475 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Cannot resize image /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:06:30.551792 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:06:30.551967 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Ensure instance console log exists: /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:06:30.552241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:30.552483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:30.552581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:30.633988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c775f17d-98d1-4889-9c5e-76df015e7e4f req-4c5ed134-8670-4b36-ba44-9d4b6ff87187 service nova] Releasing lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:30.635128 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48dc5997377e4ca8936b8d440a8fa401', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd36cb845b9943e18abc432b1d7baf7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:06:30.636632 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquired lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:30.636911 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:30.843461 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:30.845575 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:30.994006 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Creating config drive at /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config.rescue
May 28 03:06:31.006242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbkczjcd7 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:31.041057 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ab07f1e-14eb-4df8-9156-dff8ed97df11 req-f06120a5-b3d8-4a72-82b7-9bdb3f5d5e1b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:31.041530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ab07f1e-14eb-4df8-9156-dff8ed97df11 req-f06120a5-b3d8-4a72-82b7-9bdb3f5d5e1b service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:31.041931 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ab07f1e-14eb-4df8-9156-dff8ed97df11 req-f06120a5-b3d8-4a72-82b7-9bdb3f5d5e1b service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:31.042118 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ab07f1e-14eb-4df8-9156-dff8ed97df11 req-f06120a5-b3d8-4a72-82b7-9bdb3f5d5e1b service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:31.042347 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ab07f1e-14eb-4df8-9156-dff8ed97df11 req-f06120a5-b3d8-4a72-82b7-9bdb3f5d5e1b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:31.042536 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-1ab07f1e-14eb-4df8-9156-dff8ed97df11 req-f06120a5-b3d8-4a72-82b7-9bdb3f5d5e1b service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state active and task_state resize_migrating.
May 28 03:06:31.052862 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:06:31.080450 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbkczjcd7" returned: 0 in 0.076s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:31.132076 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Successfully created port: 086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:06:31.137776 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:31.138002 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:06:31.138341 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:06:31.219744 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:31.377898 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:31.546732 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:31.560038 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:06:31.571251 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating instance_info_cache with network_info: [{"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:31.575282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:31.689580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:31.787916 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Successfully updated port: 086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:06:31.845548 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-changed-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:31.845937 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Refreshing instance network info cache due to event network-changed-086a2600-25e8-4ce1-8098-cb8646b0c6ad. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:31.846009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] Acquiring lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:31.846112 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] Acquired lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:31.846481 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Refreshing network info cache for port 086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:31.914723 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:31.917166 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:31.919988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:31.942816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:31.952501 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.876s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:31.953015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:06:31.953140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:06:31.987425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:31.987425 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:31.987425 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:31.987425 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:31.987425 np0000001589 nova-compute[98297]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a88891-b3e3-43b8-a442-2bb34a62b1c8 (non-flash)
May 28 03:06:31.987425 np0000001589 nova-compute[98297]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:31.987425 np0000001589 nova-compute[98297]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:31.987425 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: tcp: [72] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: tcp: [73] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3a88891-b3e3-43b8-a442-2bb34a62b1c8 (non-flash)
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: tcp: [74] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: tcp: [75] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:31.987706 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:31.987706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '71'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '72'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3a88891-b3e3-43b8-a442-2bb34a62b1c8', '73'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '74'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '75')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:06:31.987929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '71')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:31.988719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '72')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:31.989468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40547880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:06:31.989683 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:06:31.989931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flush multipath device 330000000bbb95063 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:06:32.021359 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:32.059627 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:32.071063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Releasing lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:32.071333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Instance network_info: |[{"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:06:32.073609 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Start _get_guest_xml network_info=[{"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:32.078668 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:32.080172 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-1612521818', uuid='7aaca677-0143-4ffd-8206-e47614601132'), owner=OwnerMeta(userid='789a34f4e22e4235b9437415b1b4295f', username='tempest-SnapshotDataIntegrityTests-1722793703-project-member', projectid='80ff1bde877e4c3d9883c34167e979ce', projectname='tempest-SnapshotDataIntegrityTests-1722793703'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937592.0797534) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:32.081339 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:32.081686 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:32.082445 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:32.082612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:32.084165 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:32.084537 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:32.084739 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:32.084840 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:32.084968 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:32.085051 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:32.085134 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:32.085301 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:32.085406 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:32.085502 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:32.085593 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:32.085704 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:32.094998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1612521818',display_name='tempest-SnapshotDataIntegrityTests-server-1612521818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-snapshotdataintegritytests-server-1612521818',id=29,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMuq7EtsCr7amxzbNook/UsIVApikWXdLv/f3GEVgcHYOVYE9T5FAHgY3DjaxT2+djl6yBEulP8ER2flSKQtBhbUnHX3TudxBMme/fsu/6FO/uVB/tIPQWFoFDNa+IBgA==',key_name='tempest-keypair-479045458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80ff1bde877e4c3d9883c34167e979ce',ramdisk_id='',reservation_id='r-a9ujc4w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1722793703',owner_user_name='tempest-SnapshotDataIntegrityTests-1722793703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789a34f4e22e4235b9437415b1b4295f',uuid=7aaca677-0143-4ffd-8206-e47614601132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:32.095262 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Converting VIF {"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:32.096904 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=3c087db3-1b24-4587-ae88-e36dceb37f8f,network=Network(7db0c81f-9026-4a18-9d89-174bcfbaed72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c087db3-1b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:32.096904 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'pci_devices' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:32.108219 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:06:32.108942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:06:32.109977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:06:32.121014 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:06:32.121381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:06:32.132353 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:32.138278 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:32.138547 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:32.138815 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:06:32.161569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 71, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260]
May 28 03:06:32.161569 np0000001589 nova-compute[98297]: Logout of [sid: 71, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260] successful.
May 28 03:06:32.161569 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:32.180139 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:32.190782 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:32.218028 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 72, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260]
May 28 03:06:32.218028 np0000001589 nova-compute[98297]: Logout of [sid: 72, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260] successful.
May 28 03:06:32.218028 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:32.233243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:32.233518 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:32.233852 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== disconnect_volume: return (3157ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:32.233999 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:06:32.237017 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.291176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:32.330811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.331337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.351807 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:32.388696 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for ce889453-d238-4bd1-b6b7-88c0ac65a869 due to new event <LifecycleEvent: 1779937592.3883038, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:06:32.391406 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937592.3883038, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:32.392076 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Resumed (Lifecycle Event)
May 28 03:06:32.396978 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-60dc3e30-7e83-49db-a977-9a02864ce13e tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:32.435795 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:32.447244 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.447489 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:06:32.447995 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_resize/disk /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.545790 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "cp -r /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_resize/disk /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.546160 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_resize/disk.config /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.585863 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:06:32.586458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:06:32.586948 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Creating image(s)
May 28 03:06:32.588309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "/opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:32.588964 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "/opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:32.590274 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "/opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:32.591105 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:32.594496 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:32.598280 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.605052 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "cp -r /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_resize/disk.config /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.619826 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_resize/disk.info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.623240 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <uuid>7aaca677-0143-4ffd-8206-e47614601132</uuid>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <name>instance-0000001d</name>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1612521818</nova:name>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:32</nova:creationTime>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:user uuid="789a34f4e22e4235b9437415b1b4295f">tempest-SnapshotDataIntegrityTests-1722793703-project-member</nova:user>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:project uuid="80ff1bde877e4c3d9883c34167e979ce">tempest-SnapshotDataIntegrityTests-1722793703</nova:project>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         <nova:port uuid="3c087db3-1b24-4587-ae88-e36dceb37f8f">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <entry name="serial">7aaca677-0143-4ffd-8206-e47614601132</entry>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <entry name="uuid">7aaca677-0143-4ffd-8206-e47614601132</entry>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk.config"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:b4:4e:d6"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <target dev="tap3c087db3-1b"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/console.log" append="off"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:32.623240 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:32.625279 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Preparing to wait for external event network-vif-plugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:06:32.640490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:32.641378 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:32.642018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:32.646441 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1612521818',display_name='tempest-SnapshotDataIntegrityTests-server-1612521818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-snapshotdataintegritytests-server-1612521818',id=29,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMuq7EtsCr7amxzbNook/UsIVApikWXdLv/f3GEVgcHYOVYE9T5FAHgY3DjaxT2+djl6yBEulP8ER2flSKQtBhbUnHX3TudxBMme/fsu/6FO/uVB/tIPQWFoFDNa+IBgA==',key_name='tempest-keypair-479045458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80ff1bde877e4c3d9883c34167e979ce',ramdisk_id='',reservation_id='r-a9ujc4w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1722793703',owner_user_name='tempest-SnapshotDataIntegrityTests-1722793703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789a34f4e22e4235b9437415b1b4295f',uuid=7aaca677-0143-4ffd-8206-e47614601132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:06:32.646985 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Converting VIF {"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:32.649202 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=3c087db3-1b24-4587-ae88-e36dceb37f8f,network=Network(7db0c81f-9026-4a18-9d89-174bcfbaed72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c087db3-1b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:32.649864 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=3c087db3-1b24-4587-ae88-e36dceb37f8f,network=Network(7db0c81f-9026-4a18-9d89-174bcfbaed72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c087db3-1b') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:06:32.650667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:32.651640 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:32.652535 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:06:32.656329 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:32.659118 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df1daf82-c4e7-59d2-bea5-79c0e9f52a0b', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:32.661450 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:32.664709 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:32.667858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:32.668309 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c087db3-1b, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:32.669032 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c087db3-1b, col_values=(('qos', UUID('c69ad2d1-4f74-4744-acb0-3b6e0ec46547')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:32.669373 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c087db3-1b, col_values=(('external_ids', {'iface-id': '3c087db3-1b24-4587-ae88-e36dceb37f8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:4e:d6', 'vm-uuid': '7aaca677-0143-4ffd-8206-e47614601132'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:32.670295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "cp -r /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_resize/disk.info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.674310 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:32.678890 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:32.680344 np0000001589 nova-compute[98297]: INFO os_vif [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=3c087db3-1b24-4587-ae88-e36dceb37f8f,network=Network(7db0c81f-9026-4a18-9d89-174bcfbaed72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c087db3-1b')
May 28 03:06:32.708545 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.709007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:32.709483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:32.710794 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:32.715328 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:32.715809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.746249 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:32.793546 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004223320001983666 future=<Future at 0x7e4b645ffc80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:32.793546 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] Emitting event <LifecycleEvent: 1779937577.7901318, cfabfa9d-c2fe-41cc-92f4-adca28b33725 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:32.793546 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:32.793546 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] VM Stopped (Lifecycle Event)
May 28 03:06:32.794552 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.523770318000061 future=<Future at 0x7e4b645343b0 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:32.794666 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.5236349850001716 future=<Future at 0x7e4b645343b0 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:32.794952 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:32.795063 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.257221217000279 future=<Future at 0x7e4b6457e660 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:32.795147 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.257137670000247 future=<Future at 0x7e4b6457e660 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:32.810013 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.810473 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.861414 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk 1073741824" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.863007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:32.865751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:32.898254 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:32.901677 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:32.969809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:32.970730 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:06:32.971070 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:33.060138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:33.060799 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Cannot resize image /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:06:33.061258 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:06:33.061459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Ensure instance console log exists: /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:06:33.061761 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:33.061979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:33.062100 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:33.102073 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:33.104436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:33.104981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:33.105152 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:33.105370 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:33.105563 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state rescued and task_state None.
May 28 03:06:33.105729 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:33.105920 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:33.106099 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:33.106612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:33.106775 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:33.106971 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-717401bc-cea7-467f-9eac-94d923fae37d req-40151c94-aa75-440d-8446-d36b71e74b76 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state rescued and task_state None.
May 28 03:06:33.138643 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:33.167062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-63cf8336-b9d2-46f4-931b-c34f3c5ca674 req-1ab48bb6-960c-405e-9392-4ef18318c67e service nova] Releasing lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:33.167951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquired lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:33.168562 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:33.296417 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9fa6efdd-a3c9-4b04-b094-e3b47e25f81d tempest-TaggedBootDevicesTest-864280134 tempest-TaggedBootDevicesTest-864280134-project-member] [instance: cfabfa9d-c2fe-41cc-92f4-adca28b33725] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:33.410767 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937593.4104586, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:33.411169 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Started (Lifecycle Event)
May 28 03:06:33.643734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:33.644584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:33.645325 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:33.647156 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:06:33.734334 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:33.838289 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:33.839144 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:33.914142 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:33.917701 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:33.949007 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:33.979624 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Port 28e0891b-94fd-4c84-afaf-4db9e9df9eb5 binding to destination host np0000001589 is already ACTIVE {{(pid=98297) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 03:06:34.118660 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Updating instance_info_cache with network_info: [{"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:34.206929 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:34.207084 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:34.207218 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No VIF found with MAC fa:16:3e:b4:4e:d6, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:34.207837 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Using config drive
May 28 03:06:34.350295 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Unrescuing
May 28 03:06:34.350526 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:34.350677 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquired lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:34.350839 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:34.421331 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 03:06:34.624824 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Releasing lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:34.625589 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Instance network_info: |[{"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:06:34.627669 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Start _get_guest_xml network_info=[{"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:34.633358 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:34.634475 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603', uuid='7a37d0c2-ade8-45d3-a8a6-54975c7c36ed'), owner=OwnerMeta(userid='48dc5997377e4ca8936b8d440a8fa401', username='tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member', projectid='cd36cb845b9943e18abc432b1d7baf7e', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-176036810'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937594.6340313) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:34.635448 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:34.635799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:34.636550 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:34.636726 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:34.637632 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:34.637936 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:34.638072 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:34.638138 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:34.638283 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:34.638378 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:34.638488 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:34.638677 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:34.638767 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:34.638876 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:34.638982 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:34.639098 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:34.650123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testservervolumeattachscenariooldversion-server-2087692',id=30,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1puY5mfGs3tJbfFRDkcfIc3grVBqYUlScb6A9cdDKPYPwO/MohRAydUKIO6ukPOGKUIUHB53FqcnrPGMUZ/vx8njakNFfxU+U+uCCe848giyoG6+8BqSVGWiaaaPjQ9g==',key_name='tempest-keypair-1114737077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd36cb845b9943e18abc432b1d7baf7e',ramdisk_id='',reservation_id='r-ajdw4aiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-176036810',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48dc5997377e4ca8936b8d440a8fa401',uuid=7a37d0c2-ade8-45d3-a8a6-54975c7c36ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:34.652616 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Converting VIF {"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:34.653280 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:8b,bridge_name='br-int',has_traffic_filtering=True,id=086a2600-25e8-4ce1-8098-cb8646b0c6ad,network=Network(505b7bc8-9fac-4114-9e49-c9a76d1687e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap086a2600-25') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:34.653788 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lazy-loading 'pci_devices' on Instance uuid 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:34.676545 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:34.733494 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:34.758639 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:34.762275 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:34.810758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:34.810758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing instance network info cache due to event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:34.810758 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] Acquiring lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:34.851436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:34.853273 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:06:34.856256 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:34.864279 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:34.946590 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Creating config drive at /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk.config
May 28 03:06:34.953162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpflrou359 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:34.967183 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:34.977310 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.004817 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:06:35.017439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpflrou359" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.022011 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:35.022385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:35.022562 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:35.077530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.083725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.159376 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <uuid>7a37d0c2-ade8-45d3-a8a6-54975c7c36ed</uuid>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <name>instance-0000001e</name>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603</nova:name>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:34</nova:creationTime>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:user uuid="48dc5997377e4ca8936b8d440a8fa401">tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member</nova:user>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:project uuid="cd36cb845b9943e18abc432b1d7baf7e">tempest-TestServerVolumeAttachScenarioOldVersion-176036810</nova:project>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         <nova:port uuid="086a2600-25e8-4ce1-8098-cb8646b0c6ad">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <entry name="serial">7a37d0c2-ade8-45d3-a8a6-54975c7c36ed</entry>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <entry name="uuid">7a37d0c2-ade8-45d3-a8a6-54975c7c36ed</entry>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk.config"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:0a:4b:8b"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <target dev="tap086a2600-25"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/console.log" append="off"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:35.159376 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Preparing to wait for external event network-vif-plugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testservervolumeattachscenariooldversion-server-2087692',id=30,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1puY5mfGs3tJbfFRDkcfIc3grVBqYUlScb6A9cdDKPYPwO/MohRAydUKIO6ukPOGKUIUHB53FqcnrPGMUZ/vx8njakNFfxU+U+uCCe848giyoG6+8BqSVGWiaaaPjQ9g==',key_name='tempest-keypair-1114737077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd36cb845b9943e18abc432b1d7baf7e',ramdisk_id='',reservation_id='r-ajdw4aiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-176036810',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48dc5997377e4ca8936b8d440a8fa401',uuid=7a37d0c2-ade8-45d3-a8a6-54975c7c36ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Converting VIF {"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:8b,bridge_name='br-int',has_traffic_filtering=True,id=086a2600-25e8-4ce1-8098-cb8646b0c6ad,network=Network(505b7bc8-9fac-4114-9e49-c9a76d1687e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap086a2600-25') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:8b,bridge_name='br-int',has_traffic_filtering=True,id=086a2600-25e8-4ce1-8098-cb8646b0c6ad,network=Network(505b7bc8-9fac-4114-9e49-c9a76d1687e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap086a2600-25') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.165182 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:35.167533 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:06:35.168195 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.168932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5133ad92-4db2-5835-b611-21919cc1d696', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:35.171264 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:35.177037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.187404 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.187404 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap086a2600-25, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:35.187404 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap086a2600-25, col_values=(('qos', UUID('97318548-384c-455b-974e-07e6541151c3')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:35.187404 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap086a2600-25, col_values=(('external_ids', {'iface-id': '086a2600-25e8-4ce1-8098-cb8646b0c6ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:4b:8b', 'vm-uuid': '7a37d0c2-ade8-45d3-a8a6-54975c7c36ed'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:35.188037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.190000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:35.191455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.192703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.210436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.217981 np0000001589 nova-compute[98297]: INFO os_vif [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4b:8b,bridge_name='br-int',has_traffic_filtering=True,id=086a2600-25e8-4ce1-8098-cb8646b0c6ad,network=Network(505b7bc8-9fac-4114-9e49-c9a76d1687e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap086a2600-25')
May 28 03:06:35.286806 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.287269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:06:35.287578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.rescue --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.331124 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:35.376603 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.rescue --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.377042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.rescue --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.473259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869/disk.rescue --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.476402 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.479494 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:35.499215 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.540309 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.579138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.580248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.631273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.684594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.687930 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:35.689218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:35.736485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:35.736940 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13455MB free_disk=74.0312728881836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:06:35.737108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:35.737371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:35.876515 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.881590 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.884066 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.909345 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.917024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:35.996249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Releasing lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:35.996249 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'flavor' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:35.996249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] Acquired lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:35.996249 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing network info cache for port 75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:36.039868 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:36.140173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:36.143252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquired lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:36.143252 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:36.270447 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937596.2700317, 7aaca677-0143-4ffd-8206-e47614601132 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:36.270607 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] VM Started (Lifecycle Event)
May 28 03:06:36.501942 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:36.537833 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:36.556816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:36.594682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:36.644791 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:36.752034 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:36.752034 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:36.752034 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] No VIF found with MAC fa:16:3e:0a:4b:8b, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:36.752604 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Using config drive
May 28 03:06:36.762351 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Applying migration context for instance 6894ded6-c069-4e38-b230-5e7435bbee38 as it has an incoming, in-progress migration 0d3a6311-e5fa-450e-96c7-05a090cbb047. Migration status is post-migrating {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 03:06:36.762351 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating resource usage from migration 0d3a6311-e5fa-450e-96c7-05a090cbb047
May 28 03:06:36.769368 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c2fc88a3-1e5a-433f-9aae-0e9cc0e19963 req-21452286-faad-47f2-a20f-11d1a1b3b340 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:36.769565 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c2fc88a3-1e5a-433f-9aae-0e9cc0e19963 req-21452286-faad-47f2-a20f-11d1a1b3b340 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:36.769702 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c2fc88a3-1e5a-433f-9aae-0e9cc0e19963 req-21452286-faad-47f2-a20f-11d1a1b3b340 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:36.769809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c2fc88a3-1e5a-433f-9aae-0e9cc0e19963 req-21452286-faad-47f2-a20f-11d1a1b3b340 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:36.769936 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c2fc88a3-1e5a-433f-9aae-0e9cc0e19963 req-21452286-faad-47f2-a20f-11d1a1b3b340 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:36.770047 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c2fc88a3-1e5a-433f-9aae-0e9cc0e19963 req-21452286-faad-47f2-a20f-11d1a1b3b340 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state rescued and task_state unrescuing.
May 28 03:06:36.776921 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:36.779149 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937596.7788305, 7aaca677-0143-4ffd-8206-e47614601132 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:36.779250 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] VM Paused (Lifecycle Event)
May 28 03:06:36.840769 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ce889453-d238-4bd1-b6b7-88c0ac65a869 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:06:36.840907 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 94a458ec-8795-4832-93b3-cfda54f6444a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:06:36.841041 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Migration 0d3a6311-e5fa-450e-96c7-05a090cbb047 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 03:06:36.841122 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 6894ded6-c069-4e38-b230-5e7435bbee38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:06:36.841218 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7aaca677-0143-4ffd-8206-e47614601132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:06:36.841356 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:06:36.859550 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance destroyed successfully.
May 28 03:06:36.860074 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'numa_topology' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:36.894206 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:36.894206 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing instance network info cache due to event network-changed-75347773-ab8a-4c09-88b9-fed091f53c27. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:36.894807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Acquiring lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:37.035249 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:37.088866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:37.089037 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:37.130447 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:37.186302 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updated VIF entry in instance network info cache for port 75347773-ab8a-4c09-88b9-fed091f53c27. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:06:37.186628 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:37.261126 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:37.283437 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:37.288886 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:37.319557 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:37.344011 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 90a7e1a8-0397-44d0-9e45-7510757fe5af has allocations against this compute host but is not found in the database.
May 28 03:06:37.344238 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:06:37.344414 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1728MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:06:35 up 34 min,  2 users,  load average: 7.24, 6.23, 3.49\n', 'num_instances': '5', 'num_vm_rescued': '1', 'num_task_unrescuing': '1', 'num_os_type_None': '5', 'num_proj_38899ad6345442358b17adfcc1ba57a7': '1', 'io_workload': '2', 'num_vm_active': '2', 'num_task_resize_migrated': '1', 'num_proj_50654591a7494ff3aa75740735c011e0': '1', 'num_task_None': '1', 'num_proj_c470ae60a73f43d183ba78fe4ed0d29b': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_80ff1bde877e4c3d9883c34167e979ce': '1', 'num_proj_cd36cb845b9943e18abc432b1d7baf7e': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:06:37.364100 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Object Instance<ce889453-d238-4bd1-b6b7-88c0ac65a869> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:37.416178 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Creating config drive at /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk.config
May 28 03:06:37.426258 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0eummsnr {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:37.483594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0eummsnr" returned: 0 in 0.057s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:37.591285 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:06:37.689549 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6bd190f8-15fc-48c7-91b4-275360447280 req-5d2f84b9-1dbb-45d1-87ca-3f6565d58745 service nova] Releasing lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:37.690309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Acquired lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:37.690521 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Refreshing network info cache for port 75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:37.742077 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:37.766284 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:37.766485 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:37.791278 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:06:37.791814 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999794405000102 future=<Future at 0x7e4b645b58b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:37.822725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Releasing lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:38.040529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.141900 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:38.193035 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:38.197121 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.231103 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.235352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.271020 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:38.305876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.336051 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:38.343425 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.343425 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.350591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:06:38.375481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:38.409707 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.416949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:06:38.418339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:06:38.427166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:06:38.428315 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feeb:12d7', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1', 'fe80::fc16:3eff:fe0a:4b8b'] 
May 28 03:06:38.428565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:06:38.428642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:06:38.429394 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:38.530310 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.558812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.561684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.563257 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.589284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.590106 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:38.645540 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:38.783000 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:06:38.783219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.046s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:38.783610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.642s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:38.784096 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:06:38.790299 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:06:38.790299 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Claim successful on node np0000001589
May 28 03:06:38.839956 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updated VIF entry in instance network info cache for port 75347773-ab8a-4c09-88b9-fed091f53c27. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:06:38.840358 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [{"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:38.864644 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:38.865731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:38.865949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:38.870309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:38.870889 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:38.871050 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state rescued and task_state unrescuing.
May 28 03:06:38.871152 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:38.871345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:38.874482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:38.874482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:38.874619 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:38.874661 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state rescued and task_state unrescuing.
May 28 03:06:38.874759 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:38.875071 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:38.875144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:38.875518 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:38.875696 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:38.875696 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e89b58e0-03d1-444b-bf2b-520a17f3ddf5 req-644c8fe6-da2b-442b-b4a8-0491b9f148e9 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received unexpected event network-vif-plugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with vm_state rescued and task_state unrescuing.
May 28 03:06:38.976089 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-vif-plugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:38.976089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:38.976194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:38.976301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:38.976427 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Processing event network-vif-plugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:06:38.977183 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-vif-plugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:38.977513 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:38.977768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:38.977955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:38.978126 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] No waiting events found dispatching network-vif-plugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:38.978560 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-4f279ce7-ff7f-4834-9d49-d1c7ac9985ac req-e7860332-e136-4ab3-aad5-62cae3e278d5 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received unexpected event network-vif-plugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad for instance with vm_state building and task_state spawning.
May 28 03:06:39.008649 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:39.011554 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:39.038327 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:39.238661 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for ce889453-d238-4bd1-b6b7-88c0ac65a869 due to new event <LifecycleEvent: 1779937599.2382212, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:06:39.240305 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937599.2382212, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:39.241909 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2a921bf8-9945-4f1b-ae38-329c8a1809f1 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:39.242090 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Resumed (Lifecycle Event)
May 28 03:06:39.277106 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:06:39.279931 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:06:39.282385 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Instance spawned successfully.
May 28 03:06:39.283088 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:06:39.342955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Releasing lock "refresh_cache-ce889453-d238-4bd1-b6b7-88c0ac65a869" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:39.343148 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-vif-plugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:39.343334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:39.343468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:39.343567 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:39.343675 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Processing event network-vif-plugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:06:39.344032 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-vif-plugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:39.344186 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:39.344295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:39.345073 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:06:39.345742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:39.345815 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] No waiting events found dispatching network-vif-plugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:39.345959 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-263d931d-2a1b-4e6b-a97b-6f7269a24b75 req-3d3b3ae7-6a62-4ed1-a18f-984d4aecf98a service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received unexpected event network-vif-plugged-3c087db3-1b24-4587-ae88-e36dceb37f8f for instance with vm_state building and task_state spawning.
May 28 03:06:39.349507 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:06:39.351542 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Instance spawned successfully.
May 28 03:06:39.351878 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:06:39.558668 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Starting finish_migration {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 03:06:39.559886 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:06:39.560095 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Creating image(s)
May 28 03:06:39.560868 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:39.649268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:39.650064 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:06:39.650622 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:39.748078 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:39.756176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:39.757521 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Cannot resize image /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:06:39.758952 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:39.784580 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:39.784799 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:39.785052 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:06:39.785392 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.35 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:06:39.792162 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.792312 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.792600 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.792828 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.793086 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.793462 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.858857 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.859051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.859460 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.859789 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.860178 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:39.860526 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:40.166502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:40.188819 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:40.263781 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937600.263073, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:40.264532 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:06:40.264864 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Started (Lifecycle Event)
May 28 03:06:40.267023 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Ensure instance console log exists: /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:06:40.267186 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:40.267492 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:40.269907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:40.270252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:40.270384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:40.272636 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Start _get_guest_xml network_info=[{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'acf92c02-7290-4b63-ae89-98b788460b07', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '6894ded6-c069-4e38-b230-5e7435bbee38', 'attached_at': '2026-05-28T03:06:39.000000', 'detached_at': '', 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'serial': '90d2e13b-48b8-4a20-9f03-b9845c81d39b'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:40.274307 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:40.275453 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-150448903', uuid='6894ded6-c069-4e38-b230-5e7435bbee38'), owner=OwnerMeta(userid='6db2de4ba77e418598d962bc8fa90cb1', username='tempest-ServerActionsTestOtherB-278131468-project-member', projectid='50654591a7494ff3aa75740735c011e0', projectname='tempest-ServerActionsTestOtherB-278131468'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937600.2751067) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:40.277215 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:40.278023 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:40.279140 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:40.279530 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:40.280470 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:40.280803 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:40.280946 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:40.281049 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:40.281165 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:40.281303 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:40.281438 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:40.281610 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:40.281709 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:40.281830 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:40.281940 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:40.282076 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:40.293041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:40.312174 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Took 7.73 seconds to spawn the instance on the hypervisor.
May 28 03:06:40.313052 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:40.367599 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Took 10.27 seconds to spawn the instance on the hypervisor.
May 28 03:06:40.367795 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:40.381162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:40.381913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:40.382214 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:40.382794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:40.383192 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:06:40.383667 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:40.383828 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:40.384218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:40.384490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:06:40.396402 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:40.397186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:40.398035 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:40.400001 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:40.400001 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:40.400001 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:40.413318 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:40.413318 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:40.422950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:40.422950 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:40.434459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b] added
May 28 03:06:40.434459 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:40.434459 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:40.434459 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:40.434459 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:40.434459 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:40.434459 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:40.434843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:40.434843 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:40.434954 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b] added
May 28 03:06:40.438467 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:40.438467 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0382(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:40.438467 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:40.771459 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:40.774209 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:40.780498 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:40.834118 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Took 13.54 seconds to build instance.
May 28 03:06:40.881712 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Took 16.86 seconds to build instance.
May 28 03:06:41.283454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.500s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:41.283799 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:06:41.286590 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937601.286266, 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:41.286809 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] VM Started (Lifecycle Event)
May 28 03:06:41.338488 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.049s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:41.383753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-27d82937-585f-4bed-9407-5433030fc47a tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.378s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:41.436309 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:41.438609 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:41.451851 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:41.451851 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:41.458340 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:41.458340 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.468621 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.474510 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.481912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.481912 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.481912 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:41.482136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.482136 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.482136 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:41.493252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.493252 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.493252 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:41.493627 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.493627 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.493627 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:41.522007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260]
May 28 03:06:41.522007 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260] successful.
May 28 03:06:41.522007 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.537371 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.538991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260]
May 28 03:06:41.538991 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260] successful.
May 28 03:06:41.538991 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.554590 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:41.554590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:41.554924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:41.555714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] HCTL ('9', '-', '-', 0) found on session 76 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:41.555714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:41.564250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:41.582805 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching for a device in session 76 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:41.582805 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:41.584774 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:41.585063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:41.585133 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:41.586685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] HCTL ('10', '-', '-', 0) found on session 77 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:41.586685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:41.607439 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching for a device in session 77 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:41.608302 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:41.611446 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-changed-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:41.611554 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Refreshing instance network info cache due to event network-changed-3c087db3-1b24-4587-ae88-e36dceb37f8f. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:41.612192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] Acquiring lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:41.612192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] Acquired lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:41.612192 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Refreshing network info cache for port 3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:41.792189 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:06:41.792467 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:06:41.799747 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:41.800034 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:41.800493 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:41.806746 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:41.999749 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82e8bda156aa4270a2d9b5a1cbdd2f54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '077734035a184c9c88ca6c3862eb8409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:06:42.115028 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:42.300497 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:06:42.309650 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937602.3094053, 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:42.309857 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] VM Paused (Lifecycle Event)
May 28 03:06:42.398600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:06:42.451669 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-changed-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:42.452627 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Refreshing instance network info cache due to event network-changed-086a2600-25e8-4ce1-8098-cb8646b0c6ad. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:42.452627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] Acquiring lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:42.452627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] Acquired lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:42.452627 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Refreshing network info cache for port 086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:42.525148 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:42.690292 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updated VIF entry in instance network info cache for port 3c087db3-1b24-4587-ae88-e36dceb37f8f. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:06:42.690618 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating instance_info_cache with network_info: [{"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:42.744042 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:42.749024 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Successfully created port: c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:06:42.806967 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:06:42.812082 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:42.816097 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937602.8143196, 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:42.816097 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] VM Resumed (Lifecycle Event)
May 28 03:06:42.955276 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:43.192920 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dac5837b-fe68-4e9c-b29a-2dd5422f5da9 req-ef3391fe-7f69-4456-ab67-a9064fc8988f service nova] Releasing lock "refresh_cache-7aaca677-0143-4ffd-8206-e47614601132" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:43.323120 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Booting with volume a0454d34-aff7-409c-82db-e662c6751a1b at /dev/vda
May 28 03:06:43.325896 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:43.331367 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:43.376133 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Successfully updated port: c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:06:43.390247 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:43.410623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:06:43.422582 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Found WWN 330000000bbb95063 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:06:43.423921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:43.424091 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '330000000bbb95063', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb95063'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:43.424440 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bbb95063', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb95063'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:06:43.427950 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:43.437134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:43.462818 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-changed-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:43.462818 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Refreshing instance network info cache due to event network-changed-c3d855fe-f1fa-4781-95ff-902eb71ae1fb. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:43.462818 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] Acquiring lock "refresh_cache-90a7e1a8-0397-44d0-9e45-7510757fe5af" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:43.464647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] Acquired lock "refresh_cache-90a7e1a8-0397-44d0-9e45-7510757fe5af" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:43.464647 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Refreshing network info cache for port c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:43.491581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:06:43.491913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:06:43.501833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:06:43.503677 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feeb:12d7', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1', 'fe80::fc16:3eff:fe0a:4b8b', 'fe80::9042:42ff:fe5a:54cc'] 
May 28 03:06:43.503836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:06:43.503954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:06:43.504207 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:43.504720 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Updating existing volume attachment record: f3795dfb-023d-400e-bbbc-a638eb71627b {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:06:43.638526 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Updated VIF entry in instance network info cache for port 086a2600-25e8-4ce1-8098-cb8646b0c6ad. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:06:43.638830 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Updating instance_info_cache with network_info: [{"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:43.833410 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937603.8326368, 7aaca677-0143-4ffd-8206-e47614601132 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:43.833410 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] VM Resumed (Lifecycle Event)
May 28 03:06:43.878698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "refresh_cache-90a7e1a8-0397-44d0-9e45-7510757fe5af" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:43.936095 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:05:28Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:43.936432 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:43.937140 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:43.939792 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <uuid>6894ded6-c069-4e38-b230-5e7435bbee38</uuid>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <name>instance-0000001a</name>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <memory>262144</memory>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsTestOtherB-server-150448903</nova:name>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:40</nova:creationTime>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.micro" id="84">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:memory>256</nova:memory>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:user uuid="6db2de4ba77e418598d962bc8fa90cb1">tempest-ServerActionsTestOtherB-278131468-project-member</nova:user>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:project uuid="50654591a7494ff3aa75740735c011e0">tempest-ServerActionsTestOtherB-278131468</nova:project>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         <nova:port uuid="28e0891b-94fd-4c84-afaf-4db9e9df9eb5">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <entry name="serial">6894ded6-c069-4e38-b230-5e7435bbee38</entry>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <entry name="uuid">6894ded6-c069-4e38-b230-5e7435bbee38</entry>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <alias name="ua-90d2e13b-48b8-4a20-9f03-b9845c81d39b"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-1"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <serial>90d2e13b-48b8-4a20-9f03-b9845c81d39b</serial>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:42:03:f7"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <target dev="tap28e0891b-94"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/console.log" append="off"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:43.939792 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:43.943578 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:05:28Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:06:43.943578 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-457517243-network", "vif_mac": "fa:16:3e:42:03:f7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:43.943578 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:43.943578 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:06:43.945191 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:43.945705 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:43.946141 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:06:43.948305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:43.948305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57ae47fb-140d-5225-b4b6-1dbf86c9cfd3', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:43.949197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:43.951362 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:43.954818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:43.954818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e0891b-94, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:43.954818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e0891b-94, col_values=(('qos', UUID('14a098bc-0f68-4fdf-8961-3b8d571a7b78')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:43.954818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e0891b-94, col_values=(('external_ids', {'iface-id': '28e0891b-94fd-4c84-afaf-4db9e9df9eb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:03:f7', 'vm-uuid': '6894ded6-c069-4e38-b230-5e7435bbee38'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:43.956974 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:43.959385 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:43.963808 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:43.964981 np0000001589 nova-compute[98297]: INFO os_vif [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94')
May 28 03:06:43.971258 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:44.053550 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0011943079998673056 future=<Future at 0x7e4b6457e660 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:44.053719 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:44.053868 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.737714218000292 future=<Future at 0x7e4b645b58b0 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:44.053997 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.737577572000191 future=<Future at 0x7e4b645b58b0 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:44.054080 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:44.055840 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Emitting event <LifecycleEvent: 1779937589.0522094, 6894ded6-c069-4e38-b230-5e7435bbee38 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:44.056008 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Stopped (Lifecycle Event)
May 28 03:06:44.065249 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:44.140727 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6ce3f94a-d9e0-4669-a226-c0cf7a809d49 req-15dd684b-c1ba-431e-a4ac-69cb535dd9cb service nova] Releasing lock "refresh_cache-7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:44.207281 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:44.337215 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:44.340645 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:44.559024 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:44.560762 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:44.710167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6e626487-6ebf-4292-85e2-67064fa06b0c req-78482721-f9df-4f03-9346-489533a6fd24 service nova] Releasing lock "refresh_cache-90a7e1a8-0397-44d0-9e45-7510757fe5af" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:44.710544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquired lock "refresh_cache-90a7e1a8-0397-44d0-9e45-7510757fe5af" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:44.714463 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:45.063374 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 03:06:45.289282 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:45.448246 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:45.481675 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:45.481800 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:45.481873 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:45.481995 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] No VIF found with MAC fa:16:3e:42:03:f7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:45.482470 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Using config drive
May 28 03:06:45.594428 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Updating instance_info_cache with network_info: [{"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:45.625581 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:06:45.626814 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:06:45.627141 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Creating image(s)
May 28 03:06:45.627653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:06:45.628070 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Ensure instance console log exists: /opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:06:45.628571 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:45.628772 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:45.628919 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:45.917347 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:45.953607 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:46.037640 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:46.096876 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Releasing lock "refresh_cache-90a7e1a8-0397-44d0-9e45-7510757fe5af" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:46.097244 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Instance network_info: |[{"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:06:46.099949 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Start _get_guest_xml network_info=[{"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'f3795dfb-023d-400e-bbbc-a638eb71627b', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '90a7e1a8-0397-44d0-9e45-7510757fe5af', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'serial': 'a0454d34-aff7-409c-82db-e662c6751a1b'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:46.109079 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:46.110457 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='90a7e1a8-0397-44d0-9e45-7510757fe5af'), owner=OwnerMeta(userid='82e8bda156aa4270a2d9b5a1cbdd2f54', username='tempest-ImageDependencyTests-1045797042-project-member', projectid='077734035a184c9c88ca6c3862eb8409', projectname='tempest-ImageDependencyTests-1045797042'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937606.1100128) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:46.114852 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:46.116697 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:46.121336 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:46.121336 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:46.122373 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:46.122735 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:46.122913 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:46.123045 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:46.123196 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:46.123329 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:46.123456 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:46.123632 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:46.123770 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:46.123904 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:46.125492 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:46.125765 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:46.144019 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:06:46.144517 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:46.144636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:46.145037 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:46.145327 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:06:46.156636 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eb20acd9-3945-444c-a54e-870d7c8f813e req-57df7213-0d5b-43dd-a66b-049ba1598897 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:46.156911 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eb20acd9-3945-444c-a54e-870d7c8f813e req-57df7213-0d5b-43dd-a66b-049ba1598897 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:46.157090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eb20acd9-3945-444c-a54e-870d7c8f813e req-57df7213-0d5b-43dd-a66b-049ba1598897 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:46.157301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eb20acd9-3945-444c-a54e-870d7c8f813e req-57df7213-0d5b-43dd-a66b-049ba1598897 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:46.157475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eb20acd9-3945-444c-a54e-870d7c8f813e req-57df7213-0d5b-43dd-a66b-049ba1598897 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:46.157655 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-eb20acd9-3945-444c-a54e-870d7c8f813e req-57df7213-0d5b-43dd-a66b-049ba1598897 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state active and task_state resize_finish.
May 28 03:06:46.163722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:46.164802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:46.166577 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:46.166909 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:46.167379 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:46.167614 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:46.179113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:46.179113 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:46.186470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:06:46.186470 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:46.193812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b] added
May 28 03:06:46.193812 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:46.193812 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:46.193812 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:46.193812 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:46.193812 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:46.193812 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:46.194035 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:46.194331 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:46.194547 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b] added
May 28 03:06:46.203011 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:06:46.203011 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:06:46.203011 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:06:46.313688 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:46.314799 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:46.319114 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:46.344256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:46.857042 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937606.8567052, 6894ded6-c069-4e38-b230-5e7435bbee38 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:46.857580 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Resumed (Lifecycle Event)
May 28 03:06:46.858082 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:06:46.860922 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance running successfully.
May 28 03:06:46.861895 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Failed to set time: agent not configured {{(pid=98297) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 03:06:46.862109 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-609fe96b-fbd0-4076-89d1-e3afc49db03d tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] finish_migration finished successfully. {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 03:06:47.143722 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:47.143874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:47.195033 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:06:47.203509 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:47.212579 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:47.212579 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:06:47.217952 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:06:47.217952 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.226674 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.234647 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.241010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.241010 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.241010 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.241010 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.241010 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:47.241308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.241308 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.241308 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.241308 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.241308 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.247914 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:47.274538 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.50.100,3260]
May 28 03:06:47.274538 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.50.100,3260] successful.
May 28 03:06:47.274538 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.286350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.293612 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.40.100,3260]
May 28 03:06:47.293612 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.40.100,3260] successful.
May 28 03:06:47.293612 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.300627 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.300627 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.300627 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.300627 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.300627 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.300627 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.300627 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:47.301034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.301034 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.301034 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.301034 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.301034 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.301034 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.301034 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:47.301034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.135s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:47.301399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:47.301992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] HCTL ('11', '-', '-', 0) found on session 78 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:47.302112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:47.307007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:47.318010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Searching for a device in session 78 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:47.318156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:47.324202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.324202 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.324202 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.324202 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.324202 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.324202 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.324202 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:47.326096 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] HCTL ('12', '-', '-', 0) found on session 79 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:06:47.326096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:06:47.349571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Searching for a device in session 79 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:06:47.349760 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:06:47.362174 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:47.364020 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:47.645709 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:06:47.746017 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:47.868651 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 03:06:47.869059 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937607.8686745, 6894ded6-c069-4e38-b230-5e7435bbee38 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:47.869097 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Started (Lifecycle Event)
May 28 03:06:48.167655 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:06:48.208155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:48.208373 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:48.211550 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:06:48.211921 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Claim successful on node np0000001589
May 28 03:06:48.249103 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ce10bd1-8a0f-43cc-b5b0-814dee9026f8 req-c2b7257c-67a3-455d-85d8-517ecbd31853 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:48.249342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ce10bd1-8a0f-43cc-b5b0-814dee9026f8 req-c2b7257c-67a3-455d-85d8-517ecbd31853 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:48.249551 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ce10bd1-8a0f-43cc-b5b0-814dee9026f8 req-c2b7257c-67a3-455d-85d8-517ecbd31853 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:48.249731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ce10bd1-8a0f-43cc-b5b0-814dee9026f8 req-c2b7257c-67a3-455d-85d8-517ecbd31853 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:48.249897 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ce10bd1-8a0f-43cc-b5b0-814dee9026f8 req-c2b7257c-67a3-455d-85d8-517ecbd31853 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:48.250082 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8ce10bd1-8a0f-43cc-b5b0-814dee9026f8 req-c2b7257c-67a3-455d-85d8-517ecbd31853 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state resized and task_state resize_reverting.
May 28 03:06:48.371741 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:48.375174 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:48.712612 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:48.831757 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:48.832013 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:48.832294 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:48.876532 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 03:06:48.908134 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Port 28e0891b-94fd-4c84-afaf-4db9e9df9eb5 binding to destination host np0000001589 is already ACTIVE {{(pid=98297) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 03:06:48.908298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:48.908389 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquired lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:48.908558 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:48.956886 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:49.181921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Found WWN 330000000c232f398 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:06:49.182100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:49.182259 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000c232f398', 'path': '/dev/dm-2', 'multipath_id': '330000000c232f398'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:49.182425 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c232f398', 'path': '/dev/dm-2', 'multipath_id': '330000000c232f398'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:06:49.410406 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:49.687177 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='instance-depend-image',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077734035a184c9c88ca6c3862eb8409',ramdisk_id='',reservation_id='r-vhr7vhpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1045797042',owner_user_name='tempest-ImageDependencyTests-1045797042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:43Z,user_data=None,user_id='82e8bda156aa4270a2d9b5a1cbdd2f54',uuid=90a7e1a8-0397-44d0-9e45-7510757fe5af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:49.687490 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Converting VIF {"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:49.687947 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:56:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d855fe-f1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:49.688584 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lazy-loading 'pci_devices' on Instance uuid 90a7e1a8-0397-44d0-9e45-7510757fe5af {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:49.692135 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:49.692411 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:49.768247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:49.888457 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:50.195917 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:50.201075 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <uuid>90a7e1a8-0397-44d0-9e45-7510757fe5af</uuid>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <name>instance-0000001f</name>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:name>instance-depend-image</nova:name>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:46</nova:creationTime>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:properties/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:user uuid="82e8bda156aa4270a2d9b5a1cbdd2f54">tempest-ImageDependencyTests-1045797042-project-member</nova:user>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:project uuid="077734035a184c9c88ca6c3862eb8409">tempest-ImageDependencyTests-1045797042</nova:project>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         <nova:port uuid="c3d855fe-f1fa-4781-95ff-902eb71ae1fb">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="192.168.233.127" ipVersion="4"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <entry name="serial">90a7e1a8-0397-44d0-9e45-7510757fe5af</entry>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <entry name="uuid">90a7e1a8-0397-44d0-9e45-7510757fe5af</entry>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af/disk.config"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <alias name="ua-a0454d34-aff7-409c-82db-e662c6751a1b"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-2"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <serial>a0454d34-aff7-409c-82db-e662c6751a1b</serial>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:9f:56:d5"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <target dev="tapc3d855fe-f1"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af/console.log" append="off"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:50.201075 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:50.203293 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Preparing to wait for external event network-vif-plugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:06:50.203293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:50.203293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:50.203293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:50.203293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='instance-depend-image',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='077734035a184c9c88ca6c3862eb8409',ramdisk_id='',reservation_id='r-vhr7vhpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1045797042',owner_user_name='tempest-ImageDependencyTests-1045797042-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:43Z,user_data=None,user_id='82e8bda156aa4270a2d9b5a1cbdd2f54',uuid=90a7e1a8-0397-44d0-9e45-7510757fe5af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:06:50.203293 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Converting VIF {"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:50.203527 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:56:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d855fe-f1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:50.203971 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:56:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d855fe-f1') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:06:50.206412 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:50.206684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:50.206914 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:06:50.207739 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:50.207912 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a4e952a-aa1d-5f6b-a7ce-4f5507fa90f5', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:50.211626 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:50.213572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:50.213793 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3d855fe-f1, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:50.214199 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3d855fe-f1, col_values=(('qos', UUID('4578f794-063a-446c-ab72-474de2117f19')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:50.214444 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3d855fe-f1, col_values=(('external_ids', {'iface-id': 'c3d855fe-f1fa-4781-95ff-902eb71ae1fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:56:d5', 'vm-uuid': '90a7e1a8-0397-44d0-9e45-7510757fe5af'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:50.217761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:50.221728 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:50.222835 np0000001589 nova-compute[98297]: INFO os_vif [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:56:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d855fe-f1')
May 28 03:06:50.391273 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Releasing lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:50.705519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.497s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:50.706241 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:06:50.894882 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Creating tmpfile /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/tmpkquwnlek to verify with other compute node that the instance is on the same shared storage. {{(pid=98297) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 03:06:50.894882 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:06:51.212027 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:06:51.212185 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:06:51.212807 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:51.212807 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:51.369786 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a07e716b60b4c09ba9abd4e284ac10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9800af7fc694415bfdba6885e8399f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:06:51.424170 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:51.427184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:51.452511 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:51.457760 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:51.490301 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:51.490301 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:51.675690 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a81c2960-f418-47ba-9556-23e2d0efd1ef req-694cc1ab-b49d-47d5-8993-7862edfb5b03 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:51.677198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a81c2960-f418-47ba-9556-23e2d0efd1ef req-694cc1ab-b49d-47d5-8993-7862edfb5b03 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:51.677372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a81c2960-f418-47ba-9556-23e2d0efd1ef req-694cc1ab-b49d-47d5-8993-7862edfb5b03 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:51.677488 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a81c2960-f418-47ba-9556-23e2d0efd1ef req-694cc1ab-b49d-47d5-8993-7862edfb5b03 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:51.677639 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a81c2960-f418-47ba-9556-23e2d0efd1ef req-694cc1ab-b49d-47d5-8993-7862edfb5b03 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:51.677820 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a81c2960-f418-47ba-9556-23e2d0efd1ef req-694cc1ab-b49d-47d5-8993-7862edfb5b03 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state resized and task_state resize_reverting.
May 28 03:06:51.715174 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:06:51.737174 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999557334000201 future=<Future at 0x7e4b781aa960 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:51.737506 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999212670999896 future=<Future at 0x7e4b781aa960 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:51.737725 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998961382000289 future=<Future at 0x7e4b781aa960 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:06:51.740284 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:51.741311 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:51.741311 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance destroyed successfully.
May 28 03:06:51.741311 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] No VIF found with MAC fa:16:3e:9f:56:d5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:51.741730 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Using config drive
May 28 03:06:51.744315 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lazy-loading 'resources' on Instance uuid 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:51.818135 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:52.123493 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Successfully created port: 72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:06:52.222650 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:06:52.250009 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:52.253511 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:47Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:06:52.254966 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:52.254966 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:52.254966 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:06:52.261425 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:52.261425 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e0891b-94, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:52.264283 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:52.264283 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:52.269008 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:52.269875 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:52.270036 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=14a098bc-0f68-4fdf-8961-3b8d571a7b78) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:52.271346 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:52.276819 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:52.282643 np0000001589 nova-compute[98297]: INFO os_vif [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94')
May 28 03:06:52.286210 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:06:52.286583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:52.286749 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:06:52.287180 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:06:52.288298 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:06:52.288298 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:06:52.314370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:52.314370 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:52.314370 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:52.314370 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:52.314370 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:52.314370 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:52.314370 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:06:52.315023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:52.315023 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:06:52.315023 np0000001589 nova-compute[98297]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:52.315023 np0000001589 nova-compute[98297]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:06:52.315023 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:52.315023 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:06:52.315023 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:06:52.315326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '79')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:06:52.315326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '77')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:52.320493 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '76')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:06:52.321503 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40579bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'): ({'sdd'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:06:52.321888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:06:52.322264 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flush multipath device 330000000bbb95063 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:06:52.355356 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:52.376561 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Creating config drive at /opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af/disk.config
May 28 03:06:52.380549 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_yscg7s0 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:52.409466 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:06:52.446046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_yscg7s0" returned: 0 in 0.065s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:52.459539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:06:52.459899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:06:52.460978 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:06:52.473352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:06:52.473656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:06:52.488565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:52.516482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260]
May 28 03:06:52.516482 np0000001589 nova-compute[98297]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260] successful.
May 28 03:06:52.516482 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:52.538109 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:52.556976 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:52.590948 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260]
May 28 03:06:52.590948 np0000001589 nova-compute[98297]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260] successful.
May 28 03:06:52.590948 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:52.608715 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:06:52.610460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:06:52.610659 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== disconnect_volume: return (323ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:06:52.610879 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:06:52.741648 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Successfully updated port: 72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:06:52.748376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:52.808680 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-changed-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:52.808824 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Refreshing instance network info cache due to event network-changed-72f8d297-4a12-40ff-a98d-4c17d06274ab. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:06:52.809093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] Acquiring lock "refresh_cache-aa485151-7825-47a6-9d32-f4a8b122f8e0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:52.809219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] Acquired lock "refresh_cache-aa485151-7825-47a6-9d32-f4a8b122f8e0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:52.809424 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Refreshing network info cache for port 72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:06:52.920449 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.007259 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.013470 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.019648 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.035682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.231783 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:06:53.233516 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:06:53.233764 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Creating image(s)
May 28 03:06:53.234334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:53.234508 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "/opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:53.235359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "/opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:53.236289 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:53.240490 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:53.243247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:53.264208 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "refresh_cache-aa485151-7825-47a6-9d32-f4a8b122f8e0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:53.286611 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.292952 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.313612 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:53.323619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:53.336606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:53.336606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:53.336861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:53.337130 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:53.340451 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:06:53.340664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:53.398245 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:53.442310 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:53.442843 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:53.490577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk 1073741824" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:53.491106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.154s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:53.491422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:53.520690 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:53.579498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:53.580098 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:06:53.580554 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:53.686953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:53.687357 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Cannot resize image /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:06:53.687844 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:06:53.688054 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Ensure instance console log exists: /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:06:53.688334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:53.688554 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:53.688703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:53.754119 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:53.756074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:53.756329 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:53.756329 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:53.756488 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:53.756616 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state resized and task_state resize_reverting.
May 28 03:06:53.756723 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-vif-plugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:53.756842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:53.756950 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:53.757459 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:53.757459 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Processing event network-vif-plugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:06:53.757459 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-vif-plugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:53.757459 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:53.757561 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:53.757608 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:53.757700 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] No waiting events found dispatching network-vif-plugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:06:53.757815 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-93246d23-34f5-4572-b5d5-2bfb9eda2942 req-fd044295-6a7e-43dd-83ce-f98d2cdfbd4a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received unexpected event network-vif-plugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb for instance with vm_state building and task_state spawning.
May 28 03:06:53.762310 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937613.7619627, 90a7e1a8-0397-44d0-9e45-7510757fe5af => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:53.763135 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:06:53.763281 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] VM Started (Lifecycle Event)
May 28 03:06:53.765904 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:06:53.767877 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Instance spawned successfully.
May 28 03:06:53.768341 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:06:53.791957 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:53.792239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:54.026622 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9314edfe-76b0-4e80-bf4f-7f836f2271cb req-84ce8ae1-04d7-4dc1-bbdb-98ebd2f5b4c7 service nova] Releasing lock "refresh_cache-aa485151-7825-47a6-9d32-f4a8b122f8e0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:54.027000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquired lock "refresh_cache-aa485151-7825-47a6-9d32-f4a8b122f8e0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:54.027183 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:54.267247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:54.269133 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:54.273882 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:54.274005 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:54.274282 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:54.274459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:54.274715 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:54.274927 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:54.294632 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lazy-loading 'migration_context' on Instance uuid 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:54.595421 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:06:54.740767 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:54.772458 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:06:54.772719 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937614.7725475, 90a7e1a8-0397-44d0-9e45-7510757fe5af => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:54.772839 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] VM Paused (Lifecycle Event)
May 28 03:06:54.778977 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Took 9.15 seconds to spawn the instance on the hypervisor.
May 28 03:06:54.779136 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:54.799740 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Object Instance<6894ded6-c069-4e38-b230-5e7435bbee38> lazy-loaded attributes: resources,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:06:54.883044 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Updating instance_info_cache with network_info: [{"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:55.209903 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:06:55.210094 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:06:55.275115 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:55.277820 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937615.2775342, 90a7e1a8-0397-44d0-9e45-7510757fe5af => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:55.278027 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] VM Resumed (Lifecycle Event)
May 28 03:06:55.289300 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Took 17.19 seconds to build instance.
May 28 03:06:55.384953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Releasing lock "refresh_cache-aa485151-7825-47a6-9d32-f4a8b122f8e0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:55.385267 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Instance network_info: |[{"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:06:55.386829 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Start _get_guest_xml network_info=[{"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:06:55.388970 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:06:55.390026 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-1460556106', uuid='aa485151-7825-47a6-9d32-f4a8b122f8e0'), owner=OwnerMeta(userid='0a07e716b60b4c09ba9abd4e284ac10f', username='tempest-VolumesNegativeTest-1422147233-project-member', projectid='f9800af7fc694415bfdba6885e8399f9', projectname='tempest-VolumesNegativeTest-1422147233'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937615.3897357) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:06:55.390771 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:06:55.391096 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:06:55.391667 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:06:55.391667 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:06:55.391667 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:06:55.393109 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:06:55.393213 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:06:55.393317 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:06:55.393464 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:06:55.393550 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:06:55.393636 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:06:55.393761 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:06:55.393853 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:06:55.393953 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:06:55.394260 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:06:55.394260 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:06:55.404283 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1460556106',display_name='tempest-VolumesNegativeTest-instance-1460556106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesnegativetest-instance-1460556106',id=32,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9800af7fc694415bfdba6885e8399f9',ramdisk_id='',reservation_id='r-l588kk81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1422147233',owner_user_name='tempest-VolumesNegativeTest-1422147233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:52Z,user_data=None,user_id='0a07e716b60b4c09ba9abd4e284ac10f',uuid=aa485151-7825-47a6-9d32-f4a8b122f8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:06:55.404524 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Converting VIF {"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:55.405018 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=72f8d297-4a12-40ff-a98d-4c17d06274ab,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f8d297-4a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:55.405517 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lazy-loading 'pci_devices' on Instance uuid aa485151-7825-47a6-9d32-f4a8b122f8e0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:55.712515 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:06:55.781071 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:55.786140 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:55.790727 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.701s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:55.908607 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] End _get_guest_xml xml=<domain type="qemu">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <uuid>aa485151-7825-47a6-9d32-f4a8b122f8e0</uuid>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <name>instance-00000020</name>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesNegativeTest-instance-1460556106</nova:name>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:06:55</nova:creationTime>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:user uuid="0a07e716b60b4c09ba9abd4e284ac10f">tempest-VolumesNegativeTest-1422147233-project-member</nova:user>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:project uuid="f9800af7fc694415bfdba6885e8399f9">tempest-VolumesNegativeTest-1422147233</nova:project>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         <nova:port uuid="72f8d297-4a12-40ff-a98d-4c17d06274ab">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="192.168.233.208" ipVersion="4"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <system>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <entry name="serial">aa485151-7825-47a6-9d32-f4a8b122f8e0</entry>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <entry name="uuid">aa485151-7825-47a6-9d32-f4a8b122f8e0</entry>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </system>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <os>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   </os>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <features>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   </features>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   <devices>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk.config"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </disk>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d7:4f:6f"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <target dev="tap72f8d297-4a"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </interface>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/console.log" append="off"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </serial>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <video>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </video>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </rng>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:   </devices>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]: </domain>
May 28 03:06:55.908607 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:06:55.912122 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Preparing to wait for external event network-vif-plugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:06:55.912122 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:55.912122 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:55.912122 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:55.912122 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1460556106',display_name='tempest-VolumesNegativeTest-instance-1460556106',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesnegativetest-instance-1460556106',id=32,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9800af7fc694415bfdba6885e8399f9',ramdisk_id='',reservation_id='r-l588kk81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1422147233',owner_user_name='tempest-VolumesNegativeTest-1422147233-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:06:52Z,user_data=None,user_id='0a07e716b60b4c09ba9abd4e284ac10f',uuid=aa485151-7825-47a6-9d32-f4a8b122f8e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:06:55.912122 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Converting VIF {"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:06:55.918911 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=72f8d297-4a12-40ff-a98d-4c17d06274ab,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f8d297-4a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:06:55.919238 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=72f8d297-4a12-40ff-a98d-4c17d06274ab,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f8d297-4a') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:06:55.919669 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:55.919997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:55.920392 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:06:55.921239 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:55.921414 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '220f4890-80de-5592-a367-d4c41092cf73', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:55.922552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:55.923150 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:55.925513 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:55.927520 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:55.927694 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72f8d297-4a, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:55.928119 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72f8d297-4a, col_values=(('qos', UUID('57df2b53-6eca-4a7b-bda4-13bdf3203f67')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:55.928352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72f8d297-4a, col_values=(('external_ids', {'iface-id': '72f8d297-4a12-40ff-a98d-4c17d06274ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:4f:6f', 'vm-uuid': 'aa485151-7825-47a6-9d32-f4a8b122f8e0'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:06:55.929332 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:55.930888 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:06:55.938480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:55.939278 np0000001589 nova-compute[98297]: INFO os_vif [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=72f8d297-4a12-40ff-a98d-4c17d06274ab,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f8d297-4a')
May 28 03:06:56.727315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 2.935s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:56.727790 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:06:57.454293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:57.454438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:06:57.454487 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] No VIF found with MAC fa:16:3e:d7:4f:6f, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:06:57.454944 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Using config drive
May 28 03:06:57.750086 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:57.961884 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:58.067875 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Creating config drive at /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk.config
May 28 03:06:58.070970 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgap127bz {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:06:58.119583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgap127bz" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:06:58.281495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:58.281768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:58.282324 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Shelving
May 28 03:06:58.290396 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Swapping old allocation on dict_keys(['672703c4-2150-4765-9740-44d3bdb44a8c']) held by migration 0d3a6311-e5fa-450e-96c7-05a090cbb047 for instance
May 28 03:06:58.369771 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Overwriting current allocation {'allocations': {'672703c4-2150-4765-9740-44d3bdb44a8c': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 40}}, 'project_id': '50654591a7494ff3aa75740735c011e0', 'user_id': '6db2de4ba77e418598d962bc8fa90cb1', 'consumer_generation': 1} on consumer 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 03:06:58.454276 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:58.516594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:06:58.516826 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquired lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:06:58.517006 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:06:58.538319 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:58.568527 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:58.570269 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:58.646427 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:58.702172 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:58.703364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:58.714246 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6d0e4aca-1154-4747-b661-addbc7eade18 req-4b35a493-b9ea-4b57-be89-ff45b4e49afc service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-vif-plugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:06:58.714914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6d0e4aca-1154-4747-b661-addbc7eade18 req-4b35a493-b9ea-4b57-be89-ff45b4e49afc service nova] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:06:58.715116 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6d0e4aca-1154-4747-b661-addbc7eade18 req-4b35a493-b9ea-4b57-be89-ff45b4e49afc service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:06:58.715335 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6d0e4aca-1154-4747-b661-addbc7eade18 req-4b35a493-b9ea-4b57-be89-ff45b4e49afc service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:06:58.715562 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6d0e4aca-1154-4747-b661-addbc7eade18 req-4b35a493-b9ea-4b57-be89-ff45b4e49afc service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Processing event network-vif-plugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:06:59.019099 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:59.251330 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937619.2508214, aa485151-7825-47a6-9d32-f4a8b122f8e0 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:06:59.251459 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] VM Started (Lifecycle Event)
May 28 03:06:59.252644 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:06:59.255180 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:06:59.258580 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Instance spawned successfully.
May 28 03:06:59.259077 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:06:59.311236 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:06:59.316497 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:59.319294 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:59.337773 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:59.347306 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:59.369506 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:59.375813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:06:59.461617 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:06:59.653061 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance destroyed successfully.
May 28 03:06:59.653484 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'numa_topology' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:06:59.755062 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:06:59.757319 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:06:59.767254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:59.767254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:59.767254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:59.767254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:59.767254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:59.767254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:06:59.964316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Releasing lock "refresh_cache-6894ded6-c069-4e38-b230-5e7435bbee38" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:06:59.965178 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:06:59.976694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:06:59.997725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:00.048326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:07:00.048764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:07:00.057581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:07:00.058770 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe67:17a7', 'fe80::44bb:3aff:fe7c:9be1', 'fe80::fc16:3eff:fe0a:4b8b', 'fe80::9042:42ff:fe5a:54cc', 'fe80::fc16:3eff:fe9f:56d5', 'fe80::20ce:1eff:fe2a:cbc0', 'fe80::fc16:3eff:fed7:4f6f'] 
May 28 03:07:00.058880 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:07:00.059007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:07:00.059215 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== get_connector_properties: return (94ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:00.253249 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Beginning cold snapshot process
May 28 03:07:00.260849 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:07:00.261186 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937620.2609813, aa485151-7825-47a6-9d32-f4a8b122f8e0 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:00.264243 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] VM Paused (Lifecycle Event)
May 28 03:07:00.271731 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Took 7.04 seconds to spawn the instance on the hypervisor.
May 28 03:07:00.271731 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:00.621529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:00.621847 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:00.622250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:00.622335 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:00.622508 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:00.624800 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Terminating instance
May 28 03:07:00.764046 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:00.766274 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937620.7659862, aa485151-7825-47a6-9d32-f4a8b122f8e0 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:00.766652 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] VM Resumed (Lifecycle Event)
May 28 03:07:00.781122 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-vif-plugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:00.781376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:00.781417 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:00.781528 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:00.781682 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] No waiting events found dispatching network-vif-plugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:00.781800 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received unexpected event network-vif-plugged-72f8d297-4a12-40ff-a98d-4c17d06274ab for instance with vm_state active and task_state deleting.
May 28 03:07:00.781909 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:00.782389 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:00.789060 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:00.789291 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:00.789470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] No waiting events found dispatching network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:00.789629 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received unexpected event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 03:07:00.789774 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:00.789945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:00.790119 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:00.790268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:00.790406 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] No waiting events found dispatching network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:00.790547 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a885e187-3031-45b2-84ae-784e7f4eb8b7 req-808caded-5e2b-4f06-b428-452f4457c1c1 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received unexpected event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 for instance with vm_state active and task_state shelving_image_pending_upload.
May 28 03:07:00.791215 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Took 12.64 seconds to build instance.
May 28 03:07:00.931047 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.131411 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:07:01.157967 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Starting finish_revert_migration {{(pid=98297) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 03:07:01.159045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.161676 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.182207 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Start _get_guest_xml network_info=[{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '70450896-0915-438f-a91f-9e4e7ab345f5', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '6894ded6-c069-4e38-b230-5e7435bbee38', 'attached_at': '2026-05-28T03:07:00.000000', 'detached_at': '', 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'serial': '90d2e13b-48b8-4a20-9f03-b9845c81d39b'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:07:01.185004 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:07:01.186347 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-150448903', uuid='6894ded6-c069-4e38-b230-5e7435bbee38'), owner=OwnerMeta(userid='6db2de4ba77e418598d962bc8fa90cb1', username='tempest-ServerActionsTestOtherB-278131468-project-member', projectid='50654591a7494ff3aa75740735c011e0', projectname='tempest-ServerActionsTestOtherB-278131468'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937621.1859388) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:07:01.188823 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:07:01.189073 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.190059 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:07:01.191072 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:07:01.191246 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:07:01.192126 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:07:01.192441 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:07:01.192604 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:07:01.192705 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:07:01.192821 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:07:01.192948 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:07:01.193097 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:07:01.193293 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:07:01.193817 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:01.193959 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:07:01.194087 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:07:01.194192 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:07:01.194344 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:07:01.194509 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:01.269488 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:01.272987 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:01.295424 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff0fd2c5-bfda-4e43-8bee-804b232f7b74 tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.151s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:01.296610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.102s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:01.296853 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:01.297043 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:01.297200 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:01.302582 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Terminating instance
May 28 03:07:01.310650 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-15ab65ed-875d-443a-a9bf-46460b6d905f req-d391a7dc-1a09-4241-8f14-15b2e824fb98 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-vif-unplugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:01.312022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15ab65ed-875d-443a-a9bf-46460b6d905f req-d391a7dc-1a09-4241-8f14-15b2e824fb98 service nova] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:01.312239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15ab65ed-875d-443a-a9bf-46460b6d905f req-d391a7dc-1a09-4241-8f14-15b2e824fb98 service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:01.312373 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15ab65ed-875d-443a-a9bf-46460b6d905f req-d391a7dc-1a09-4241-8f14-15b2e824fb98 service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:01.312493 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-15ab65ed-875d-443a-a9bf-46460b6d905f req-d391a7dc-1a09-4241-8f14-15b2e824fb98 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] No waiting events found dispatching network-vif-unplugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:01.312608 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-15ab65ed-875d-443a-a9bf-46460b6d905f req-d391a7dc-1a09-4241-8f14-15b2e824fb98 service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-vif-unplugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:01.346353 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.357115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.457552 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Instance destroyed successfully.
May 28 03:07:01.458511 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lazy-loading 'resources' on Instance uuid 90a7e1a8-0397-44d0-9e45-7510757fe5af {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:01.706082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:01.772720 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:07:01.773049 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk /opt/stack/data/nova/instances/snapshots/tmprwb70fsi/5afb8dd164bf4039a727cb585793d756 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:01.786613 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] During sync_power_state the instance has a pending task (deleting). Skip.
May 28 03:07:01.787562 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999625300999924 future=<Future at 0x7e4b80101280 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:01.787945 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999825154000064 future=<Future at 0x7e4b645cc500 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:01.800823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:01.801742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:01.802166 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:01.803073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:01.803818 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:07:01.804514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:01.804775 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:01.805490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:01.805808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:07:01.810343 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:07:01.824002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:01.824002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:01.824002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:01.824002 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:01.824002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:01.824002 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:01.834814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:01.834814 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:01.843654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:01.843654 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:01.850349 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b] added
May 28 03:07:01.850349 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:01.850349 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:01.850349 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:01.850349 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:01.850349 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:01.850349 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:01.850349 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:01.850349 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:01.850687 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:01.853295 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.855424 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b] added
May 28 03:07:01.856764 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:01.856764 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:01.856764 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:01.878123 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.885161 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.912469 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.925510 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.961468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='instance-depend-image',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:54Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='077734035a184c9c88ca6c3862eb8409',ramdisk_id='',reservation_id='r-vhr7vhpy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1045797042',owner_user_name='tempest-ImageDependencyTests-1045797042-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:55Z,user_data=None,user_id='82e8bda156aa4270a2d9b5a1cbdd2f54',uuid=90a7e1a8-0397-44d0-9e45-7510757fe5af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:07:01.961759 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Converting VIF {"id": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "address": "fa:16:3e:9f:56:d5", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3d855fe-f1", "ovs_interfaceid": "c3d855fe-f1fa-4781-95ff-902eb71ae1fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:01.962387 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:56:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d855fe-f1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:01.962654 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:56:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d855fe-f1') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:07:01.964193 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.964415 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3d855fe-f1, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:01.965490 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.966350 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:01.984917 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.986018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.986160 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4578f794-063a-446c-ab72-474de2117f19) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:01.986857 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.987572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:01.997282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:01.999785 np0000001589 nova-compute[98297]: INFO os_vif [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:56:d5,bridge_name='br-int',has_traffic_filtering=True,id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3d855fe-f1')
May 28 03:07:02.001550 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:07:02.001937 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:02.002122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:02.084778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk /opt/stack/data/nova/instances/snapshots/tmprwb70fsi/5afb8dd164bf4039a727cb585793d756" returned: 0 in 0.312s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:02.085152 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Snapshot extracted, beginning image upload
May 28 03:07:02.165206 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999623405999955 future=<Future at 0x7e4b406e1040 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:02.165910 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Instance destroyed successfully.
May 28 03:07:02.166615 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lazy-loading 'resources' on Instance uuid aa485151-7825-47a6-9d32-f4a8b122f8e0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:02.670321 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1460556106',display_name='tempest-VolumesNegativeTest-instance-1460556106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesnegativetest-instance-1460556106',id=32,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9800af7fc694415bfdba6885e8399f9',ramdisk_id='',reservation_id='r-l588kk81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1422147233',owner_user_name='tempest-VolumesNegativeTest-1422147233-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:07:00Z,user_data=None,user_id='0a07e716b60b4c09ba9abd4e284ac10f',uuid=aa485151-7825-47a6-9d32-f4a8b122f8e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:07:02.676633 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Converting VIF {"id": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "address": "fa:16:3e:d7:4f:6f", "network": {"id": "32f3f52f-4852-4b06-bcf2-c4d8d26cc456", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "822424ecd9204db1935b0bcd511780ee", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72f8d297-4a", "ovs_interfaceid": "72f8d297-4a12-40ff-a98d-4c17d06274ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:02.677682 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=72f8d297-4a12-40ff-a98d-4c17d06274ab,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f8d297-4a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:02.678016 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=72f8d297-4a12-40ff-a98d-4c17d06274ab,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f8d297-4a') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:07:02.683991 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:02.684248 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72f8d297-4a, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:02.685362 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:02.686322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:02.691553 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:02.693754 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:02.693946 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=57df2b53-6eca-4a7b-bda4-13bdf3203f67) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:02.694473 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:02.695102 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:02.700654 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:02.707769 np0000001589 nova-compute[98297]: INFO os_vif [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4f:6f,bridge_name='br-int',has_traffic_filtering=True,id=72f8d297-4a12-40ff-a98d-4c17d06274ab,network=Network(32f3f52f-4852-4b06-bcf2-c4d8d26cc456),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72f8d297-4a')
May 28 03:07:02.707769 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Deleting instance files /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0_del
May 28 03:07:02.707769 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Deletion of /opt/stack/data/nova/instances/aa485151-7825-47a6-9d32-f4a8b122f8e0_del complete
May 28 03:07:02.760472 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:02.850932 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:02.857648 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:02.867198 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:02.867198 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:02.873258 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:02.873258 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.881096 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-vif-unplugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:02.882825 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.882825 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:02.882984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:02.883142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:02.883363 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] No waiting events found dispatching network-vif-unplugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:02.883541 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-vif-unplugged-72f8d297-4a12-40ff-a98d-4c17d06274ab for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:02.883745 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-vif-unplugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:02.883907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] Acquiring lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:02.884079 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:02.886236 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:02.886236 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] No waiting events found dispatching network-vif-unplugged-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:02.886236 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f383418a-d0ff-4035-ad91-a7780610a5a3 req-01e23ca5-c7e7-4ce6-8819-9dc953d00b3d service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-vif-unplugged-72f8d297-4a12-40ff-a98d-4c17d06274ab for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:02.891627 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.901918 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.901918 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.901918 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.901918 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.901918 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:02.902209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.902209 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.902209 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.902209 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.902209 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:02.908500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.908500 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.908500 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.908500 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.908500 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:02.908736 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.908736 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.908736 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.908736 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.908736 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:02.935821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260]
May 28 03:07:02.935821 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260] successful.
May 28 03:07:02.935821 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.950136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.959776 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260]
May 28 03:07:02.959776 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260] successful.
May 28 03:07:02.959776 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.970190 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.970190 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.970190 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.970190 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.970190 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.970190 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.970190 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:02.970590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.970590 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.970590 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.970590 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.970590 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.970590 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.970590 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:02.970788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:02.970968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:02.973996 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:02.973996 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] HCTL ('9', '-', '-', 0) found on session 80 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:02.974152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:02.990985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.990985 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.990985 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.990985 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.990985 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.990985 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.990985 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:02.991376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.991376 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:02.991376 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.991376 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:02.991376 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.991376 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:02.991376 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:02.991643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.169s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:02.991831 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:02.992892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] HCTL ('10', '-', '-', 0) found on session 81 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:02.993088 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:03.002723 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching for a device in session 80 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:03.002723 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:03.014652 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching for a device in session 81 and hctl ['10', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:03.218744 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 03:07:03.220030 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:07:03.220304 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:07:03.220462 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:07:03.220691 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:03.297998 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:03.399753 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81c588ba-26c9-43c4-97e0-0c99762e8e28 req-21b60ed7-c0a1-43fb-b1cb-dbf3958b962a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-vif-unplugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:03.399753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81c588ba-26c9-43c4-97e0-0c99762e8e28 req-21b60ed7-c0a1-43fb-b1cb-dbf3958b962a service nova] Acquiring lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:03.399753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81c588ba-26c9-43c4-97e0-0c99762e8e28 req-21b60ed7-c0a1-43fb-b1cb-dbf3958b962a service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:03.400506 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81c588ba-26c9-43c4-97e0-0c99762e8e28 req-21b60ed7-c0a1-43fb-b1cb-dbf3958b962a service nova] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:03.400506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81c588ba-26c9-43c4-97e0-0c99762e8e28 req-21b60ed7-c0a1-43fb-b1cb-dbf3958b962a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] No waiting events found dispatching network-vif-unplugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:03.400506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81c588ba-26c9-43c4-97e0-0c99762e8e28 req-21b60ed7-c0a1-43fb-b1cb-dbf3958b962a service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-vif-unplugged-c3d855fe-f1fa-4781-95ff-902eb71ae1fb for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:04.015149 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Searching for a device in session 81 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:04.015387 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:04.059443 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:04.559965 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Took 1.34 seconds to deallocate network for instance.
May 28 03:07:04.758266 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Snapshot image upload complete
May 28 03:07:04.758910 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:04.836865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Found WWN 330000000bbb95063 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:07:04.837206 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:04.837410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000bbb95063', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb95063'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:04.837565 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bbb95063', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb95063'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:07:04.838188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.836s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:04.838691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a0454d34-aff7-409c-82db-e662c6751a1b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:07:04.838923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:07:04.865114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:04.865114 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:04.865114 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:04.865114 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:04.865114 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:04.865114 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:04.865114 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:04.865394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:04.865394 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:04.865394 np0000001589 nova-compute[98297]: tcp: [78] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:04.865394 np0000001589 nova-compute[98297]: tcp: [79] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b (non-flash)
May 28 03:07:04.865394 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:04.865394 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:04.865394 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:04.865394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '70'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '78'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '79'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '81')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:07:04.865610 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '79')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:04.866313 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b', '78')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:04.867912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646b8cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:07:04.868113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Removing multipathed devices sdf, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:07:04.868339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Flush multipath device 330000000c232f398 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:07:04.895530 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:04.939791 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:04.979518 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:07:04.979696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:07:04.980785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:07:04.991009 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:07:04.991282 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:07:05.002063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:05.034503 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.40.100,3260]
May 28 03:07:05.034503 np0000001589 nova-compute[98297]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.40.100,3260] successful.
May 28 03:07:05.034503 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:05.048282 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:05.058592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:05.076978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:05.077179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:05.088802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.50.100,3260]
May 28 03:07:05.088802 np0000001589 nova-compute[98297]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-a0454d34-aff7-409c-82db-e662c6751a1b, portal: 192.168.50.100,3260] successful.
May 28 03:07:05.088802 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:05.107422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:05.107642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:05.107788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] <== disconnect_volume: return (3106ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:05.107934 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:07:05.108209 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Deleting instance files /opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af_del
May 28 03:07:05.109574 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Deletion of /opt/stack/data/nova/instances/90a7e1a8-0397-44d0-9e45-7510757fe5af_del complete
May 28 03:07:05.265309 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Shelve offloading
May 28 03:07:05.345067 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:47Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:07:05.345283 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:05.345981 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] End _get_guest_xml xml=<domain type="qemu">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <uuid>6894ded6-c069-4e38-b230-5e7435bbee38</uuid>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <name>instance-0000001a</name>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsTestOtherB-server-150448903</nova:name>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:07:01</nova:creationTime>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:user uuid="6db2de4ba77e418598d962bc8fa90cb1">tempest-ServerActionsTestOtherB-278131468-project-member</nova:user>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:project uuid="50654591a7494ff3aa75740735c011e0">tempest-ServerActionsTestOtherB-278131468</nova:project>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         <nova:port uuid="28e0891b-94fd-4c84-afaf-4db9e9df9eb5">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <system>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <entry name="serial">6894ded6-c069-4e38-b230-5e7435bbee38</entry>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <entry name="uuid">6894ded6-c069-4e38-b230-5e7435bbee38</entry>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </system>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <os>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   </os>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <features>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   </features>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   <devices>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/disk.config"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <alias name="ua-90d2e13b-48b8-4a20-9f03-b9845c81d39b"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-1"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <serial>90d2e13b-48b8-4a20-9f03-b9845c81d39b</serial>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:42:03:f7"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <target dev="tap28e0891b-94"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </interface>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38/console.log" append="off"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </serial>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <video>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </video>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </rng>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:   </devices>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: </domain>
May 28 03:07:05.348293 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Preparing to wait for external event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:47Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:07:05.348293 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57ae47fb-140d-5225-b4b6-1dbf86c9cfd3', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.356440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:05.359373 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.361536 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.361743 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28e0891b-94, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:05.362036 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28e0891b-94, col_values=(('qos', UUID('eb8d29c7-5c3f-4b7c-8aca-2ab47a854757')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:05.362236 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28e0891b-94, col_values=(('external_ids', {'iface-id': '28e0891b-94fd-4c84-afaf-4db9e9df9eb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:03:f7', 'vm-uuid': '6894ded6-c069-4e38-b230-5e7435bbee38'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:05.364858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.365882 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:05.376709 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.380238 np0000001589 nova-compute[98297]: INFO os_vif [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94')
May 28 03:07:05.474668 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e850ffd9-b12c-4850-889b-c1ef2d492a63 req-3c0456ff-3a97-4236-ac09-ad33c3db7c4e service nova] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Received event network-vif-deleted-72f8d297-4a12-40ff-a98d-4c17d06274ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:05.489626 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:05.489895 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:05.621849 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Took 4.49 seconds to destroy the instance on the hypervisor.
May 28 03:07:05.622555 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:07:05.622860 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:07:05.622953 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:07:05.623176 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:05.694350 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:05.773994 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance destroyed successfully.
May 28 03:07:05.774757 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:05.776015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:05.776240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquired lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:05.776485 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:07:05.852079 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.890154 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:05.995959 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:06.005734 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:06.066315 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eadfa6c-5c7f-4a16-9745-d1eff8422d17 req-5842dc97-b948-49d1-a5ab-c0e83a0349eb service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Received event network-vif-deleted-c3d855fe-f1fa-4781-95ff-902eb71ae1fb {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:06.069493 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-2eadfa6c-5c7f-4a16-9745-d1eff8422d17 req-5842dc97-b948-49d1-a5ab-c0e83a0349eb service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Neutron deleted interface c3d855fe-f1fa-4781-95ff-902eb71ae1fb; detaching it from the instance and deleting it from the info cache
May 28 03:07:06.071469 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2eadfa6c-5c7f-4a16-9745-d1eff8422d17 req-5842dc97-b948-49d1-a5ab-c0e83a0349eb service nova] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Detach interface failed, port_id=c3d855fe-f1fa-4781-95ff-902eb71ae1fb, reason: Instance 90a7e1a8-0397-44d0-9e45-7510757fe5af could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:07:06.242003 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:06.248305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:06.252815 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:06.278603 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:06.279581 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:06.286362 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:06.496683 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:06.504534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.427s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:06.609063 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Deleted allocations for instance aa485151-7825-47a6-9d32-f4a8b122f8e0
May 28 03:07:06.649813 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:06.737830 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0010377779999544146 future=<Future at 0x7e4b781aa960 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:06.738001 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:06.738069 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.04907590599987 future=<Future at 0x7e4b80101280 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:06.738172 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.048949039000036 future=<Future at 0x7e4b80101280 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:06.739807 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Emitting event <LifecycleEvent: 1779937611.7366273, 6894ded6-c069-4e38-b230-5e7435bbee38 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:06.739965 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Stopped (Lifecycle Event)
May 28 03:07:06.789589 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 6894ded6-c069-4e38-b230-5e7435bbee38 due to new event <LifecycleEvent: 1779937626.7892098, 6894ded6-c069-4e38-b230-5e7435bbee38 => Started> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:07:06.790271 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937626.7892098, 6894ded6-c069-4e38-b230-5e7435bbee38 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:06.790271 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Started (Lifecycle Event)
May 28 03:07:06.839540 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:06.998991 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Took 1.38 seconds to deallocate network for instance.
May 28 03:07:07.244584 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:07.293405 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:07.295388 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937627.2950935, 6894ded6-c069-4e38-b230-5e7435bbee38 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:07.295547 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Paused (Lifecycle Event)
May 28 03:07:07.341751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Releasing lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:07.342180 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:07.342548 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:07.573142 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Took 0.57 seconds to detach 1 volumes for instance.
May 28 03:07:07.578156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Deleting volume: a0454d34-aff7-409c-82db-e662c6751a1b {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:07:07.587332 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:07.587594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:07.587805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:07.587972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:07.588156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Processing event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:07:07.588669 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:07.589938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:07.589938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:07.589938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:07.590289 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:07.590289 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-b3636a90-4f06-4a3e-9be9-1fb73cfcd8e8 req-ff31298a-9ad6-4402-afb1-bda417718014 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received unexpected event network-vif-plugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with vm_state resized and task_state resize_reverting.
May 28 03:07:07.594099 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:07:07.598749 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance running successfully.
May 28 03:07:07.599372 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] finish_revert_migration finished successfully. {{(pid=98297) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 03:07:07.619736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71da48b4-3912-4ccb-9e4f-452fe6f7701c tempest-VolumesNegativeTest-1422147233 tempest-VolumesNegativeTest-1422147233-project-member] Lock "aa485151-7825-47a6-9d32-f4a8b122f8e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.324s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:07.763398 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:07.797923 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:07.799733 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937627.7995112, 6894ded6-c069-4e38-b230-5e7435bbee38 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:07.799829 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Resumed (Lifecycle Event)
May 28 03:07:07.909196 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance destroyed successfully.
May 28 03:07:07.909593 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'resources' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:08.137436 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:08.137993 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing instance network info cache due to event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:07:08.141250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] Acquiring lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:08.141250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] Acquired lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:08.141250 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing network info cache for port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:07:08.149514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:08.149682 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:08.302389 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:08.305165 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:08.411305 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<94a458ec-8795-4832-93b3-cfda54f6444a> lazy-loaded attributes: numa_topology,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:07:08.411860 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400263001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1400263001',id=28,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVVpdtpOMxw/GKIxCBvmnegmXanZB2Fx0ZByBEF5idz8qrnymJWQfBuAXPG0Bpxss5nXmXH32bO2I4hzMRCO1JRvOBtV1lIDSVolJiyfWpU902TGoqcIuDGx+v6E6uKQA==',key_name='tempest-keypair-1934369707',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:17Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-fw9ni99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member',shelved_at='2026-05-28T03:07:04.758412',shelved_host='np0000001589',shelved_image_id='d3bd61ae-422a-45dc-932c-343861abf7b9'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:07:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=94a458ec-8795-4832-93b3-cfda54f6444a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:07:08.412046 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:08.412510 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:08.412687 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:07:08.413501 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:08.413694 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb7f8de4-e3, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:08.414690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:08.415610 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:08.415830 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:08.416495 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:08.416626 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ebc27ec-606c-4f9f-ac39-44b0fbb7a1bc) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:08.417536 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:08.420959 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:08.422983 np0000001589 nova-compute[98297]: INFO os_vif [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3')
May 28 03:07:08.423325 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Deleting instance files /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a_del
May 28 03:07:08.430395 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Deletion of /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a_del complete
May 28 03:07:08.527798 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:08.527896 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:08.641247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:08.663645 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6e01e2f3-6463-4780-bf8c-79eca67ded2e tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance to original state: 'active'
May 28 03:07:08.808154 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 03:07:09.004005 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Deleted allocations for instance 94a458ec-8795-4832-93b3-cfda54f6444a
May 28 03:07:09.029620 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:09.031287 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:09.212035 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updated VIF entry in instance network info cache for port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:07:09.213166 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:09.510105 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:09.539149 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.389s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:09.540824 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:09.607925 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Deleted allocations for instance 90a7e1a8-0397-44d0-9e45-7510757fe5af
May 28 03:07:09.716913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-762b701c-7669-4db2-b2a1-5f75641740d8 req-ee527204-b26e-4a3d-a9fe-ae767bbbb73a service nova] Releasing lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:09.843444 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:09.843922 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:10.233709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:10.235765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:10.235765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:10.235765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:10.235765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:10.239695 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Terminating instance
May 28 03:07:10.349115 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:10.622782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-61339cfc-afb0-4722-add6-7f6235eb6336 tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Lock "90a7e1a8-0397-44d0-9e45-7510757fe5af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:10.742938 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:07:10.761184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:10.763636 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:10.780136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:10.788773 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:10.810299 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:10.816435 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:10.854914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.316s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:10.921707 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-889a6854-cb6e-4675-a68d-3fdbb2233419 req-09638615-3c66-4eb0-8ce0-68090cff79d8 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:10.922201 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-889a6854-cb6e-4675-a68d-3fdbb2233419 req-09638615-3c66-4eb0-8ce0-68090cff79d8 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:10.922455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-889a6854-cb6e-4675-a68d-3fdbb2233419 req-09638615-3c66-4eb0-8ce0-68090cff79d8 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:10.922611 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-889a6854-cb6e-4675-a68d-3fdbb2233419 req-09638615-3c66-4eb0-8ce0-68090cff79d8 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:10.922776 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-889a6854-cb6e-4675-a68d-3fdbb2233419 req-09638615-3c66-4eb0-8ce0-68090cff79d8 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:10.922937 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-889a6854-cb6e-4675-a68d-3fdbb2233419 req-09638615-3c66-4eb0-8ce0-68090cff79d8 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:11.077533 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99973913299982 future=<Future at 0x7e4b406cddf0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:11.079567 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Instance destroyed successfully.
May 28 03:07:11.079716 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lazy-loading 'resources' on Instance uuid 6894ded6-c069-4e38-b230-5e7435bbee38 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:11.362109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6bf450a2-bda2-45d8-ba85-24d1b8c386a6 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.080s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:11.521342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:11.521442 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:11.582048 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:05:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-150448903',display_name='tempest-ServerActionsTestOtherB-server-150448903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionstestotherb-server-150448903',id=26,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAwiLp6C7aIwyd82cM+GAYc9IEqzXx2AhqWAVFm39wzCP0IWlLnodbgpagSRYRVXUFqyr+UZ6tuEq2LPw5WmQrSB27/J3q8dLb9F6gx/mUYtVfwP6fpdv+irh5feV6Z+w==',key_name='tempest-keypair-230488919',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:08Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50654591a7494ff3aa75740735c011e0',ramdisk_id='',reservation_id='r-r3e1lr7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-278131468',owner_user_name='tempest-ServerActionsTestOtherB-278131468-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6db2de4ba77e418598d962bc8fa90cb1',uuid=6894ded6-c069-4e38-b230-5e7435bbee38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:07:11.582274 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converting VIF {"id": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "address": "fa:16:3e:42:03:f7", "network": {"id": "86306ba5-60a0-4c54-8494-90c3e9649d95", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-457517243-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "50654591a7494ff3aa75740735c011e0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap28e0891b-94", "ovs_interfaceid": "28e0891b-94fd-4c84-afaf-4db9e9df9eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:11.582982 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:11.583202 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:07:11.584369 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:11.584593 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28e0891b-94, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:11.585551 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:11.586242 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:11.586393 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:11.586924 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:11.587028 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb8d29c7-5c3f-4b7c-8aca-2ab47a854757) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:11.587416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:11.587870 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:11.588157 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:11.589923 np0000001589 nova-compute[98297]: INFO os_vif [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:03:f7,bridge_name='br-int',has_traffic_filtering=True,id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5,network=Network(86306ba5-60a0-4c54-8494-90c3e9649d95),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28e0891b-94')
May 28 03:07:11.591066 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:07:11.591348 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:11.591511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:11.591901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:11.592197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '90d2e13b-48b8-4a20-9f03-b9845c81d39b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:07:11.592414 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:07:11.617553 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:11.617553 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:11.617553 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:11.617553 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:11.617553 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:11.617777 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:11.617777 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:11.617777 np0000001589 nova-compute[98297]: tcp: [80] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:11.617777 np0000001589 nova-compute[98297]: tcp: [81] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b (non-flash)
May 28 03:07:11.617777 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:11.617949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '80'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '81')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:07:11.618119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '80')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:11.618834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b', '81')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:11.619549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64468cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:07:11.619725 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:07:11.619951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Flush multipath device 330000000bbb95063 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:07:11.656282 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:11.699607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:11.749836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:07:11.749966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:07:11.750698 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:07:11.762686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:07:11.762907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:07:11.774875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:11.805814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260]
May 28 03:07:11.805814 np0000001589 nova-compute[98297]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.40.100,3260] successful.
May 28 03:07:11.805814 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:11.819328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:11.832367 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:11.857337 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260]
May 28 03:07:11.857337 np0000001589 nova-compute[98297]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-90d2e13b-48b8-4a20-9f03-b9845c81d39b, portal: 192.168.50.100,3260] successful.
May 28 03:07:11.857337 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:11.868875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:11.869186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:11.869186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] <== disconnect_volume: return (277ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:11.869417 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:07:11.869694 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Deleting instance files /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_del
May 28 03:07:11.876033 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Deletion of /opt/stack/data/nova/instances/6894ded6-c069-4e38-b230-5e7435bbee38_del complete
May 28 03:07:12.024303 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Detaching volume 55c9f28b-10c1-47c2-ae01-040e34795991
May 28 03:07:12.069043 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Attempting to driver detach volume 55c9f28b-10c1-47c2-ae01-040e34795991 from mountpoint /dev/vdb
May 28 03:07:12.074247 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Found disk vdb by alias ua-55c9f28b-10c1-47c2-ae01-040e34795991 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:07:12.075473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Found disk vdb by alias ua-55c9f28b-10c1-47c2-ae01-040e34795991 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:07:12.075473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Attempting to detach device vdb from instance ce889453-d238-4bd1-b6b7-88c0ac65a869 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:07:12.075629 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:07:12.075629 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:12.075629 np0000001589 nova-compute[98297]:   <alias name="ua-55c9f28b-10c1-47c2-ae01-040e34795991"/>
May 28 03:07:12.075629 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:07:12.075629 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:12.075629 np0000001589 nova-compute[98297]:   <serial>55c9f28b-10c1-47c2-ae01-040e34795991</serial>
May 28 03:07:12.075629 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:07:12.075629 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:12.075629 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:07:12.084149 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Successfully detached device vdb from instance ce889453-d238-4bd1-b6b7-88c0ac65a869 from the persistent domain config.
May 28 03:07:12.084515 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] (1/8): Attempting to detach device vdb with device alias ua-55c9f28b-10c1-47c2-ae01-040e34795991 from instance ce889453-d238-4bd1-b6b7-88c0ac65a869 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:07:12.084797 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:07:12.084797 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:12.084797 np0000001589 nova-compute[98297]:   <alias name="ua-55c9f28b-10c1-47c2-ae01-040e34795991"/>
May 28 03:07:12.084797 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:07:12.084797 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:12.084797 np0000001589 nova-compute[98297]:   <serial>55c9f28b-10c1-47c2-ae01-040e34795991</serial>
May 28 03:07:12.084797 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:07:12.084797 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:12.084797 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:07:12.384146 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Took 1.64 seconds to destroy the instance on the hypervisor.
May 28 03:07:12.384617 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:07:12.384779 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:07:12.384868 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:07:12.385087 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:12.498894 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:12.665105 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937632.664808, ce889453-d238-4bd1-b6b7-88c0ac65a869 => ua-55c9f28b-10c1-47c2-ae01-040e34795991> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:07:12.665737 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-55c9f28b-10c1-47c2-ae01-040e34795991 for instance ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:07:12.667919 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Successfully detached device vdb from instance ce889453-d238-4bd1-b6b7-88c0ac65a869 from the live domain config.
May 28 03:07:12.668949 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:07:12.669191 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:12.669362 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:12.669578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:12.669861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '55c9f28b-10c1-47c2-ae01-040e34795991', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:07:12.670008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:07:12.691406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:12.691406 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:12.691406 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:12.691513 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:12.691513 np0000001589 nova-compute[98297]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991 (non-flash)
May 28 03:07:12.691513 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:12.691620 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '70')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:07:12.691712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '69')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:12.692527 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991', '70')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:12.693256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40546ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:07:12.693644 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:07:12.693932 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Flush multipath device 330000000e37b5d04 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:07:12.723934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:12.764359 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:12.775222 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:12.830034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:07:12.830253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:07:12.830809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:07:12.849452 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:07:12.849664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:07:12.851614 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:12.851787 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:12.851907 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Unshelving
May 28 03:07:12.862931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:12.895273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.40.100,3260]
May 28 03:07:12.895273 np0000001589 nova-compute[98297]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.40.100,3260] successful.
May 28 03:07:12.895273 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:12.907150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:12.919970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:12.951275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.50.100,3260]
May 28 03:07:12.951275 np0000001589 nova-compute[98297]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-55c9f28b-10c1-47c2-ae01-040e34795991, portal: 192.168.50.100,3260] successful.
May 28 03:07:12.951275 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:12.962356 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:12.962629 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:12.962798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] <== disconnect_volume: return (293ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:12.962969 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:07:12.973638 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-080f0f09-1ccb-4523-a2af-ceddbb871178 req-b5df9464-90f2-4815-8ff5-ea0d0225430d service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-deleted-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:12.974448 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-080f0f09-1ccb-4523-a2af-ceddbb871178 req-b5df9464-90f2-4815-8ff5-ea0d0225430d service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Neutron deleted interface 28e0891b-94fd-4c84-afaf-4db9e9df9eb5; detaching it from the instance and deleting it from the info cache
May 28 03:07:12.975583 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-080f0f09-1ccb-4523-a2af-ceddbb871178 req-b5df9464-90f2-4815-8ff5-ea0d0225430d service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Detach interface failed, port_id=28e0891b-94fd-4c84-afaf-4db9e9df9eb5, reason: Instance 6894ded6-c069-4e38-b230-5e7435bbee38 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:07:12.980557 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-79204bc1-b569-4932-a284-9e8fd7eed994 req-2c17a9ee-7a14-418b-954b-ca2af2e41ff4 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:12.980811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-79204bc1-b569-4932-a284-9e8fd7eed994 req-2c17a9ee-7a14-418b-954b-ca2af2e41ff4 service nova] Acquiring lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:12.981021 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-79204bc1-b569-4932-a284-9e8fd7eed994 req-2c17a9ee-7a14-418b-954b-ca2af2e41ff4 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:12.981186 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-79204bc1-b569-4932-a284-9e8fd7eed994 req-2c17a9ee-7a14-418b-954b-ca2af2e41ff4 service nova] Lock "6894ded6-c069-4e38-b230-5e7435bbee38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:12.981366 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-79204bc1-b569-4932-a284-9e8fd7eed994 req-2c17a9ee-7a14-418b-954b-ca2af2e41ff4 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] No waiting events found dispatching network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:12.981544 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-79204bc1-b569-4932-a284-9e8fd7eed994 req-2c17a9ee-7a14-418b-954b-ca2af2e41ff4 service nova] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Received event network-vif-unplugged-28e0891b-94fd-4c84-afaf-4db9e9df9eb5 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:13.427557 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:13.506171 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'flavor' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:13.918558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:13.918935 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:13.920070 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'pci_requests' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:13.930121 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Took 1.55 seconds to deallocate network for instance.
May 28 03:07:14.423097 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'numa_topology' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:14.481048 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Took 0.55 seconds to detach 1 volumes for instance.
May 28 03:07:14.511592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-45c7ec2d-a4db-46b0-a5c3-fa65bf4c3078 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.990s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:14.925745 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:07:14.926150 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Claim successful on node np0000001589
May 28 03:07:14.985609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:15.192627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:15.192808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:15.193047 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:15.193292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:15.193477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:15.198142 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Terminating instance
May 28 03:07:15.701407 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:07:15.724409 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:15.730494 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:15.754945 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:15.758781 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:15.782542 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:15.788658 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:15.929495 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9203853e-4352-49d1-a5b0-225966bd008c req-1fbc26db-e66f-447d-bba7-84f9e9b359d4 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:15.930495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9203853e-4352-49d1-a5b0-225966bd008c req-1fbc26db-e66f-447d-bba7-84f9e9b359d4 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:15.930495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9203853e-4352-49d1-a5b0-225966bd008c req-1fbc26db-e66f-447d-bba7-84f9e9b359d4 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:15.930577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9203853e-4352-49d1-a5b0-225966bd008c req-1fbc26db-e66f-447d-bba7-84f9e9b359d4 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:15.931031 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9203853e-4352-49d1-a5b0-225966bd008c req-1fbc26db-e66f-447d-bba7-84f9e9b359d4 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:15.931325 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9203853e-4352-49d1-a5b0-225966bd008c req-1fbc26db-e66f-447d-bba7-84f9e9b359d4 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:16.034247 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999735806999979 future=<Future at 0x7e4b406a85c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.034247 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Instance destroyed successfully.
May 28 03:07:16.034247 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lazy-loading 'resources' on Instance uuid ce889453-d238-4bd1-b6b7-88c0ac65a869 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:16.236138 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:16.236422 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:16.535972 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-197666698',display_name='tempest-ServerStableDeviceRescueTest-server-197666698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverstabledevicerescuetest-server-197666698',id=25,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8Rwh/1DBZW4ET9PMngZjI2tFG3gaSx0f2my4NydSbzlpMQD8jwfKjT5W77Qn23eIfcPL8BcQtHkPU9YetpUHDmKNGmcu3YcJx8R7RTB2RK2rvUbbv49yWyj9+1boe1XQ==',key_name='tempest-keypair-1487384353',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:32Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38899ad6345442358b17adfcc1ba57a7',ramdisk_id='',reservation_id='r-kj0o62kr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-846481241',owner_user_name='tempest-ServerStableDeviceRescueTest-846481241-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51c000d2ac2941a8ad517313e98a3c14',uuid=ce889453-d238-4bd1-b6b7-88c0ac65a869,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:07:16.536185 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converting VIF {"id": "75347773-ab8a-4c09-88b9-fed091f53c27", "address": "fa:16:3e:67:17:a7", "network": {"id": "da64248d-7e0e-4084-a157-8b1686f9d95e", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-379666619-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.159", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "38899ad6345442358b17adfcc1ba57a7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75347773-ab", "ovs_interfaceid": "75347773-ab8a-4c09-88b9-fed091f53c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:16.536751 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:16.537003 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:07:16.537945 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:16.538205 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75347773-ab, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:16.539342 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:16.540007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:16.540915 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:16.545109 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:16.545483 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c55699b5-5448-4996-b826-e27d713994d9) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:16.546072 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:16.546718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:16.547269 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:16.549118 np0000001589 nova-compute[98297]: INFO os_vif [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:17:a7,bridge_name='br-int',has_traffic_filtering=True,id=75347773-ab8a-4c09-88b9-fed091f53c27,network=Network(da64248d-7e0e-4084-a157-8b1686f9d95e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75347773-ab')
May 28 03:07:16.549491 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Deleting instance files /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869_del
May 28 03:07:16.550425 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Deletion of /opt/stack/data/nova/instances/ce889453-d238-4bd1-b6b7-88c0ac65a869_del complete
May 28 03:07:16.740122 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:16.787791 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004594580000230053 future=<Future at 0x7e4b80101280 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.787942 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.787979 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00020863899999312707 future=<Future at 0x7e4b645cc500 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.788087 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003156590000799042 future=<Future at 0x7e4b645cc500 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.788157 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.788274 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.3765572020001855 future=<Future at 0x7e4b406e1040 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.788770 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Emitting event <LifecycleEvent: 1779937621.7870178, 94a458ec-8795-4832-93b3-cfda54f6444a => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:16.789001 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] Emitting event <LifecycleEvent: 1779937621.7877183, 90a7e1a8-0397-44d0-9e45-7510757fe5af => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:16.789164 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.375632547999885 future=<Future at 0x7e4b406e1040 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:16.790301 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Stopped (Lifecycle Event)
May 28 03:07:16.791239 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] VM Stopped (Lifecycle Event)
May 28 03:07:17.055734 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:07:17.056390 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:07:17.057156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:07:17.057262 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:07:17.057483 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:17.134948 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:17.165191 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00030070999991949066 future=<Future at 0x7e4b406e1040 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:17.165314 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:17.165314 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.911905098999796 future=<Future at 0x7e4b406cddf0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:17.165482 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.91181874799986 future=<Future at 0x7e4b406cddf0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:17.165654 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Emitting event <LifecycleEvent: 1779937622.1647441, aa485151-7825-47a6-9d32-f4a8b122f8e0 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:17.165837 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] VM Stopped (Lifecycle Event)
May 28 03:07:17.248031 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.329s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:17.249795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.263s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:17.249795 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:17.253491 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.005s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:17.293349 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:17.298201 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3da55d5b-a85c-45b9-a5db-d6f4861ce634 None None] [instance: 90a7e1a8-0397-44d0-9e45-7510757fe5af] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:17.308018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:17.334144 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Deleted allocations for instance 6894ded6-c069-4e38-b230-5e7435bbee38
May 28 03:07:17.513466 np0000001589 nova-compute[98297]: INFO nova.network.neutron [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 with attributes {'binding:host_id': 'np0000001589', 'device_owner': 'compute:nova'}
May 28 03:07:17.668272 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: aa485151-7825-47a6-9d32-f4a8b122f8e0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:17.765695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:18.047753 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c97999ff-36e3-49d1-b2a3-9b6b81eec13a req-0946c22a-787a-4efe-8f6b-285d7d028689 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-deleted-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:18.048482 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-c97999ff-36e3-49d1-b2a3-9b6b81eec13a req-0946c22a-787a-4efe-8f6b-285d7d028689 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Neutron deleted interface 75347773-ab8a-4c09-88b9-fed091f53c27; detaching it from the instance and deleting it from the info cache
May 28 03:07:18.049693 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c97999ff-36e3-49d1-b2a3-9b6b81eec13a req-0946c22a-787a-4efe-8f6b-285d7d028689 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Detach interface failed, port_id=75347773-ab8a-4c09-88b9-fed091f53c27, reason: Instance ce889453-d238-4bd1-b6b7-88c0ac65a869 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:07:18.065554 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e9ae7d54-8b3d-4bc2-bbdb-35d3dbb6c7af req-ee7243da-3328-41b7-b626-dd185e2e7ab3 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:18.065554 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ae7d54-8b3d-4bc2-bbdb-35d3dbb6c7af req-ee7243da-3328-41b7-b626-dd185e2e7ab3 service nova] Acquiring lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:18.066242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ae7d54-8b3d-4bc2-bbdb-35d3dbb6c7af req-ee7243da-3328-41b7-b626-dd185e2e7ab3 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:18.066242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ae7d54-8b3d-4bc2-bbdb-35d3dbb6c7af req-ee7243da-3328-41b7-b626-dd185e2e7ab3 service nova] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:18.066502 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e9ae7d54-8b3d-4bc2-bbdb-35d3dbb6c7af req-ee7243da-3328-41b7-b626-dd185e2e7ab3 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] No waiting events found dispatching network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:18.066679 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e9ae7d54-8b3d-4bc2-bbdb-35d3dbb6c7af req-ee7243da-3328-41b7-b626-dd185e2e7ab3 service nova] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Received event network-vif-unplugged-75347773-ab8a-4c09-88b9-fed091f53c27 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:18.232576 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:18.232713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquired lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:18.232830 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:07:18.297247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:18.297412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing instance network info cache due to event network-changed-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:07:18.298294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] Acquiring lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:18.348058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-03893371-3fd6-4808-8cca-aa8dcd7ffe6f tempest-ServerActionsTestOtherB-278131468 tempest-ServerActionsTestOtherB-278131468-project-member] Lock "6894ded6-c069-4e38-b230-5e7435bbee38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.114s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:18.442560 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:18.735189 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:18.945078 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Took 1.89 seconds to deallocate network for instance.
May 28 03:07:19.070781 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:19.283143 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:19.294649 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:19.450677 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:19.450866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:19.708460 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:19.708733 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:19.796634 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Releasing lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:19.797542 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:07:19.798278 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] Acquired lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:19.799644 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Creating image(s)
May 28 03:07:19.800319 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Refreshing network info cache for port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:07:19.801575 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:19.801730 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:19.802265 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:19.802561 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:20.211609 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:20.293847 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:20.294037 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:20.305667 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:20.308497 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<94a458ec-8795-4832-93b3-cfda54f6444a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:07:20.309292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "f6e5076f6075680f429f6eb6f1fa4f47d6511bd2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:20.309979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "f6e5076f6075680f429f6eb6f1fa4f47d6511bd2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:20.453874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:20.454189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:20.693392 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:20.722176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.270s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:20.799345 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lazy-loading 'flavor' on Instance uuid 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:20.804316 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Deleted allocations for instance ce889453-d238-4bd1-b6b7-88c0ac65a869
May 28 03:07:20.926195 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updated VIF entry in instance network info cache for port bb7f8de4-e376-4c53-ac5b-b210ba6a74e2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:07:20.926924 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:20.959695 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:21.341288 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:21.343816 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:21.344163 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:21.430028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5e09b513-42b5-4997-9fe8-220f910ee712 req-77597ef9-7cc4-43da-939a-7f2464bb8e90 service nova] Releasing lock "refresh_cache-94a458ec-8795-4832-93b3-cfda54f6444a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:21.434476 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.part --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:21.435056 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] d3bd61ae-422a-45dc-932c-343861abf7b9 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:07:21.435951 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:07:21.436247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.part /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:21.547503 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:21.577321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.part /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.converted" returned: 0 in 0.141s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:21.588149 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:21.674403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2.converted --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:21.677178 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "f6e5076f6075680f429f6eb6f1fa4f47d6511bd2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.366s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:21.677178 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:21.681527 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:21.683536 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:21.781253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2 --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:21.781920 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "f6e5076f6075680f429f6eb6f1fa4f47d6511bd2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:21.782583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "f6e5076f6075680f429f6eb6f1fa4f47d6511bd2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:21.783247 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:21.787804 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:21.788283 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:21.807862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:21.822466 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5fe7c29-1a3d-4fae-b608-3f694b651242 tempest-ServerStableDeviceRescueTest-846481241 tempest-ServerStableDeviceRescueTest-846481241-project-member] Lock "ce889453-d238-4bd1-b6b7-88c0ac65a869" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.629s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:21.879211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2 --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:21.879773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2,backing_fmt=raw /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:21.941070 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2,backing_fmt=raw /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk 1073741824" returned: 0 in 0.061s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:21.944083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "f6e5076f6075680f429f6eb6f1fa4f47d6511bd2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:21.944083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:21.971326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:22.063559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6e5076f6075680f429f6eb6f1fa4f47d6511bd2 --force-share --output=json" returned: 0 in 0.119s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:22.063559 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'migration_context' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:22.567144 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<94a458ec-8795-4832-93b3-cfda54f6444a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:07:22.567614 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Rebasing disk image.
May 28 03:07:22.567877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:22.667024 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:22.671602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a -F raw /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:22.740275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:22.769137 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:22.883738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:22.883977 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:22.884264 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Attaching volume 18d0ac58-77ba-4399-9f70-294d05e637f4 to /dev/vdb
May 28 03:07:22.932733 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:22.948840 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:07:22.972820 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:22.988197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:23.018492 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:07:23.018802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:07:23.027602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:07:23.028823 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe0a:4b8b', 'fe80::9042:42ff:fe5a:54cc'] 
May 28 03:07:23.028973 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:07:23.029077 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:07:23.029819 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:23.029819 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Updating existing volume attachment record: d7fa1291-171d-4203-bcf9-6eadae378131 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:07:23.107003 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:23.107131 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:23.107349 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attaching volume 49a91a27-953f-4eb7-a8e9-89f58c0012c8 to /dev/vdb
May 28 03:07:23.164501 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:23.175816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:07:23.197726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:23.255085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:07:23.255085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:07:23.264266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:07:23.264570 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe0a:4b8b', 'fe80::9042:42ff:fe5a:54cc'] 
May 28 03:07:23.264689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:07:23.264820 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:07:23.265051 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:23.265331 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating existing volume attachment record: 61f198ba-88ec-4b51-98cf-995f451dadd9 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:07:23.598779 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:07:23.599262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18d0ac58-77ba-4399-9f70-294d05e637f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:23.599375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:23.599866 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:23.600015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18d0ac58-77ba-4399-9f70-294d05e637f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:07:23.613217 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:23.613835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:23.615531 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:23.615779 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:23.616249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:23.616455 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:23.627425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:23.627425 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:23.632662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:23.632662 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:23.641845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4] added
May 28 03:07:23.641845 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:23.641845 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:23.641845 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:23.641845 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:23.641845 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:23.641845 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:23.642064 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:23.642293 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:23.642463 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:23.645554 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4] added
May 28 03:07:23.645554 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:23.645554 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:23.645554 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:23.645554 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:23.645554 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:23.645554 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:23.645781 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:23.645907 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:23.645996 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:23.649812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a -F raw /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk" returned: 0 in 0.978s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:23.650178 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:07:23.650374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Ensure instance console log exists: /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:07:23.650605 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:23.650794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:23.650879 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:23.652384 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Start _get_guest_xml network_info=[{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='70fdebc5b71f02dfa5dddded76382f7a',container_format='bare',created_at=2026-05-28T03:06:58Z,direct_url=<?>,disk_format='qcow2',id=d3bd61ae-422a-45dc-932c-343861abf7b9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1400263001-shelved',owner='c470ae60a73f43d183ba78fe4ed0d29b',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-28T03:07:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:07:23.655525 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:07:23.657836 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1400263001', uuid='94a458ec-8795-4832-93b3-cfda54f6444a'), owner=OwnerMeta(userid='84aa869713da4347914ce6054de5ea1e', username='tempest-AttachVolumeShelveTestJSON-653410335-project-member', projectid='c470ae60a73f43d183ba78fe4ed0d29b', projectname='tempest-AttachVolumeShelveTestJSON-653410335'), image=ImageMeta(id='d3bd61ae-422a-45dc-932c-343861abf7b9', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937643.6568534) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:07:23.658380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:07:23.658755 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:07:23.660404 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:07:23.660655 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:07:23.661799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:07:23.662257 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='70fdebc5b71f02dfa5dddded76382f7a',container_format='bare',created_at=2026-05-28T03:06:58Z,direct_url=<?>,disk_format='qcow2',id=d3bd61ae-422a-45dc-932c-343861abf7b9,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1400263001-shelved',owner='c470ae60a73f43d183ba78fe4ed0d29b',properties=ImageMetaProps,protected=<?>,size=53542912,status='active',tags=<?>,updated_at=2026-05-28T03:07:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:07:23.662995 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:07:23.663129 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:07:23.663349 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:07:23.663466 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:07:23.663678 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:07:23.664058 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:07:23.664058 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:07:23.664175 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:07:23.664375 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:07:23.664526 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:07:23.664765 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:23.827733 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:07:23.828049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:23.828203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:24.167088 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<94a458ec-8795-4832-93b3-cfda54f6444a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:07:24.183824 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400263001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1400263001',id=28,image_ref='d3bd61ae-422a-45dc-932c-343861abf7b9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1934369707',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:17Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-fw9ni99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member',shelved_at='2026-05-28T03:07:04.758412',shelved_host='np0000001589',shelved_image_id='d3bd61ae-422a-45dc-932c-343861abf7b9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=94a458ec-8795-4832-93b3-cfda54f6444a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:07:24.183824 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:24.183824 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:24.184400 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<94a458ec-8795-4832-93b3-cfda54f6444a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:25.586741 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] End _get_guest_xml xml=<domain type="qemu">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <uuid>94a458ec-8795-4832-93b3-cfda54f6444a</uuid>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <name>instance-0000001c</name>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1400263001</nova:name>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:07:23</nova:creationTime>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:user uuid="84aa869713da4347914ce6054de5ea1e">tempest-AttachVolumeShelveTestJSON-653410335-project-member</nova:user>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:project uuid="c470ae60a73f43d183ba78fe4ed0d29b">tempest-AttachVolumeShelveTestJSON-653410335</nova:project>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         <nova:port uuid="bb7f8de4-e376-4c53-ac5b-b210ba6a74e2">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <system>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <entry name="serial">94a458ec-8795-4832-93b3-cfda54f6444a</entry>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <entry name="uuid">94a458ec-8795-4832-93b3-cfda54f6444a</entry>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     </system>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <os>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   </os>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <features>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   </features>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:   <devices>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:eb:12:d7"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <target dev="tapbb7f8de4-e3"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     </interface>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/console.log" append="off"/>
May 28 03:07:25.586741 np0000001589 nova-compute[98297]:     </serial>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     <video>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     </video>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     </rng>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:   </devices>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: </domain>
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Preparing to wait for external event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400263001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1400263001',id=28,image_ref='d3bd61ae-422a-45dc-932c-343861abf7b9',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1934369707',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:17Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-fw9ni99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member',shelved_at='2026-05-28T03:07:04.758412',shelved_host='np0000001589',shelved_image_id='d3bd61ae-422a-45dc-932c-343861abf7b9'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=94a458ec-8795-4832-93b3-cfda54f6444a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.595184 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8067dc0a-ee3d-56a3-9208-fd6bde46c34d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb7f8de4-e3, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb7f8de4-e3, col_values=(('qos', UUID('83f72cf7-91f4-4524-ae36-b5dc9d8c2049')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb7f8de4-e3, col_values=(('external_ids', {'iface-id': 'bb7f8de4-e376-4c53-ac5b-b210ba6a74e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:12:d7', 'vm-uuid': '94a458ec-8795-4832-93b3-cfda54f6444a'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:25.595184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.40.100,3260]
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.40.100,3260] successful.
May 28 03:07:25.597131 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: INFO os_vif [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3')
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:25.597131 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:25.597131 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] HCTL ('8', '-', '-', 0) found on session 83 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Searching for a device in session 83 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:25.597131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18d0ac58-77ba-4399-9f70-294d05e637f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:25.745184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.50.100,3260]
May 28 03:07:25.745184 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.50.100,3260] successful.
May 28 03:07:25.745184 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.759256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:25.786008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.786008 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:25.786008 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:25.786008 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:25.786008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:25.786008 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:25.786008 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:25.786008 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:25.786008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.170s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:25.786331 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:25.788266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] HCTL ('9', '-', '-', 0) found on session 84 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:25.788266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:25.793084 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:25.808427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Searching for a device in session 84 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:25.808470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '18d0ac58-77ba-4399-9f70-294d05e637f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:25.843845 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:26.077687 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00041472900011285674 future=<Future at 0x7e4b406cddf0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:26.078326 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:26.078438 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.951264712000011 future=<Future at 0x7e4b406a85c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:26.078519 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.951177058999747 future=<Future at 0x7e4b406a85c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:26.079965 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] Emitting event <LifecycleEvent: 1779937631.077184, 6894ded6-c069-4e38-b230-5e7435bbee38 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:26.080220 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] VM Stopped (Lifecycle Event)
May 28 03:07:26.257622 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:26.257812 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:26.257926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] No VIF found with MAC fa:16:3e:eb:12:d7, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:07:26.258500 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Using config drive
May 28 03:07:26.584419 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7e31936b-66bc-495f-8a8f-ed929696a08e tempest-ServerBootFromVolumeStableRescueTest-1646172629 tempest-ServerBootFromVolumeStableRescueTest-1646172629-project-member] [instance: 6894ded6-c069-4e38-b230-5e7435bbee38] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:26.641142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:07:26.761815 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'ec2_ids' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:27.137980 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:27.138104 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 03:07:27.266913 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<94a458ec-8795-4832-93b3-cfda54f6444a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:07:27.267064 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'keypairs' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:27.479322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:27.640529 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] There are 0 instances to clean {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 03:07:27.641437 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:27.657450 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445799042 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:07:27.657825 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.058s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:27.657998 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] <== connect_volume: return (4058ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799042', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799042'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:27.658094 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445799042', 'path': '/dev/dm-0', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445799042'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:07:27.659296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.830s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:27.659480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:07:27.662001 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lazy-loading 'flavor' on Instance uuid 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:27.670769 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:27.671371 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:27.671816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:27.671990 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:27.672360 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:27.673024 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:27.682326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:27.682326 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:27.687319 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:27.687319 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8] added
May 28 03:07:27.694903 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:27.694903 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:27.694903 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:27.702008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8] added
May 28 03:07:27.702008 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:27.702008 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:27.702008 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:27.702008 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:27.702008 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:27.702008 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:27.702286 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:27.702549 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:27.702771 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:27.771007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:27.774504 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Object Instance<94a458ec-8795-4832-93b3-cfda54f6444a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:07:27.777841 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:27.917620 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Creating config drive at /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config
May 28 03:07:27.923248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_pdc176w {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:27.968752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_pdc176w" returned: 0 in 0.046s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:28.144200 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:07:28.167329 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Attempting to attach volume 18d0ac58-77ba-4399-9f70-294d05e637f4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:07:28.171570 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:07:28.171570 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:28.171570 np0000001589 nova-compute[98297]:   <alias name="ua-18d0ac58-77ba-4399-9f70-294d05e637f4"/>
May 28 03:07:28.171570 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:07:28.171570 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:28.171570 np0000001589 nova-compute[98297]:   <serial>18d0ac58-77ba-4399-9f70-294d05e637f4</serial>
May 28 03:07:28.171570 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:28.171570 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:07:28.598277 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:28.632393 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:28.696650 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:28.703676 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:28.713403 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:28.713403 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:28.720313 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:28.720313 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.732416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.740711 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:28.740711 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.751032 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.751032 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.751032 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.751032 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:28.751239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.751239 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.751239 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.751239 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:28.762005 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.762005 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.762005 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.762005 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:28.762167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.762167 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.762167 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.762167 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:28.784708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.40.100,3260]
May 28 03:07:28.784708 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.40.100,3260] successful.
May 28 03:07:28.784708 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.799403 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.816843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.50.100,3260]
May 28 03:07:28.816843 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.50.100,3260] successful.
May 28 03:07:28.816843 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.819255 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:28.819255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:28.820126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('10', '-', '-', 0) found on session 85 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:28.820371 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:28.833703 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:28.841541 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 85 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:28.841771 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:28.849453 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.849453 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.849453 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.849453 np0000001589 nova-compute[98297]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.849453 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.849453 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:28.849713 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:28.849713 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.849713 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:28.849713 np0000001589 nova-compute[98297]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.849713 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:28.849713 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:28.849923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:28.850087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:28.850883 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('11', '-', '-', 0) found on session 86 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:28.850987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:28.868603 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 86 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:28.868603 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:29.027529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:29.030727 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:29.037631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:29.040466 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:29.075433 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:29.171942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:29.172442 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:29.339749 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:29.605888 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937649.6055183, 94a458ec-8795-4832-93b3-cfda54f6444a => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:29.606389 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Started (Lifecycle Event)
May 28 03:07:29.672709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:07:29.676048 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:07:29.721358 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:29.998111 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:29.998293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:29.998344 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:29.998506 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] No VIF found with MAC fa:16:3e:0a:4b:8b, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:07:30.109241 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:30.110929 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937650.1106756, 94a458ec-8795-4832-93b3-cfda54f6444a => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:30.111093 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Paused (Lifecycle Event)
May 28 03:07:30.235018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:30.235355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:30.238817 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:07:30.238817 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Claim successful on node np0000001589
May 28 03:07:30.616138 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:30.617866 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:30.688966 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2663738-67e7-4cb2-8620-ecbecbc161d0 req-75795553-b33c-429a-87f6-c9250db42bef service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:30.690441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2663738-67e7-4cb2-8620-ecbecbc161d0 req-75795553-b33c-429a-87f6-c9250db42bef service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:30.690594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2663738-67e7-4cb2-8620-ecbecbc161d0 req-75795553-b33c-429a-87f6-c9250db42bef service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:30.690923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2663738-67e7-4cb2-8620-ecbecbc161d0 req-75795553-b33c-429a-87f6-c9250db42bef service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:30.691029 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2663738-67e7-4cb2-8620-ecbecbc161d0 req-75795553-b33c-429a-87f6-c9250db42bef service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Processing event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:07:30.692152 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:07:30.694090 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found WWN 330000000e59bc412 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:07:30.694614 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:30.694837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== connect_volume: return (6866ms) {'type': 'block', 'scsi_wwn': '330000000e59bc412', 'path': '/dev/dm-1', 'multipath_id': '330000000e59bc412'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:30.694973 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e59bc412', 'path': '/dev/dm-1', 'multipath_id': '330000000e59bc412'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:07:30.695947 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:07:30.697952 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:30.708191 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance spawned successfully.
May 28 03:07:31.030198 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003810719999819412 future=<Future at 0x7e4b406a85c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:31.030602 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:31.032048 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Emitting event <LifecycleEvent: 1779937636.02965, ce889453-d238-4bd1-b6b7-88c0ac65a869 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:31.032264 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] VM Stopped (Lifecycle Event)
May 28 03:07:31.077807 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:31.124879 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:07:31.124879 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937651.1238616, 94a458ec-8795-4832-93b3-cfda54f6444a => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:31.124879 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Resumed (Lifecycle Event)
May 28 03:07:31.202245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to attach volume 49a91a27-953f-4eb7-a8e9-89f58c0012c8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:07:31.204261 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:07:31.204261 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:31.204261 np0000001589 nova-compute[98297]:   <alias name="ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8"/>
May 28 03:07:31.204261 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:07:31.204261 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:31.204261 np0000001589 nova-compute[98297]:   <serial>49a91a27-953f-4eb7-a8e9-89f58c0012c8</serial>
May 28 03:07:31.204261 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:31.204261 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:07:31.372947 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:31.544272 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: ce889453-d238-4bd1-b6b7-88c0ac65a869] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:31.586947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-adc00f86-ea02-425c-91ba-cd99ee6d6c9b tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.703s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:31.600114 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:31.600425 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:31.627270 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:31.633668 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:31.896622 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c014d165-cfdc-401f-ac22-8e62a8f622ac tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.045s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:32.103362 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:32.144687 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:32.144932 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:32.145111 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:07:32.145782 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:07:32.611998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.377s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:32.612506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:07:32.769056 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bfced296-d658-41ea-bbf5-7b330e6f9f95 req-4a1cb2c5-4de7-480e-a0a6-ea6dae0ed23c service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:32.769317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bfced296-d658-41ea-bbf5-7b330e6f9f95 req-4a1cb2c5-4de7-480e-a0a6-ea6dae0ed23c service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:32.770401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bfced296-d658-41ea-bbf5-7b330e6f9f95 req-4a1cb2c5-4de7-480e-a0a6-ea6dae0ed23c service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:32.771818 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bfced296-d658-41ea-bbf5-7b330e6f9f95 req-4a1cb2c5-4de7-480e-a0a6-ea6dae0ed23c service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:32.772386 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bfced296-d658-41ea-bbf5-7b330e6f9f95 req-4a1cb2c5-4de7-480e-a0a6-ea6dae0ed23c service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] No waiting events found dispatching network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:32.772632 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-bfced296-d658-41ea-bbf5-7b330e6f9f95 req-4a1cb2c5-4de7-480e-a0a6-ea6dae0ed23c service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received unexpected event network-vif-plugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 for instance with vm_state active and task_state None.
May 28 03:07:32.773482 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:32.914007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:32.914179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:32.923800 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:32.923975 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:32.924104 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:32.924250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No VIF found with MAC fa:16:3e:b4:4e:d6, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:07:33.122322 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:07:33.122701 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:07:33.122905 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:33.123823 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:33.134966 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:33.135182 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:07:33.137464 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:33.137680 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:33.137946 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:07:33.212577 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d927d6b89cf4f0c96580968ea9c3791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee8d500ee84b5f86e297c2660e183b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:07:33.416301 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Detaching volume 18d0ac58-77ba-4399-9f70-294d05e637f4
May 28 03:07:33.480360 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Attempting to driver detach volume 18d0ac58-77ba-4399-9f70-294d05e637f4 from mountpoint /dev/vdb
May 28 03:07:33.490442 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Found disk vdb by alias ua-18d0ac58-77ba-4399-9f70-294d05e637f4 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:07:33.494402 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Found disk vdb by alias ua-18d0ac58-77ba-4399-9f70-294d05e637f4 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:07:33.494402 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Attempting to detach device vdb from instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:07:33.494402 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:07:33.494402 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:33.494402 np0000001589 nova-compute[98297]:   <alias name="ua-18d0ac58-77ba-4399-9f70-294d05e637f4"/>
May 28 03:07:33.494402 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:07:33.494402 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:33.494402 np0000001589 nova-compute[98297]:   <serial>18d0ac58-77ba-4399-9f70-294d05e637f4</serial>
May 28 03:07:33.494402 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:07:33.494402 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:33.494402 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:07:33.501988 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Successfully detached device vdb from instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed from the persistent domain config.
May 28 03:07:33.502144 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] (1/8): Attempting to detach device vdb with device alias ua-18d0ac58-77ba-4399-9f70-294d05e637f4 from instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:07:33.502487 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:07:33.502487 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:33.502487 np0000001589 nova-compute[98297]:   <alias name="ua-18d0ac58-77ba-4399-9f70-294d05e637f4"/>
May 28 03:07:33.502487 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:07:33.502487 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:33.502487 np0000001589 nova-compute[98297]:   <serial>18d0ac58-77ba-4399-9f70-294d05e637f4</serial>
May 28 03:07:33.502487 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:07:33.502487 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:33.502487 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:07:33.626040 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:07:33.658618 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Successfully created port: 9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:07:33.900632 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:34.027655 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937654.0273142, 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed => ua-18d0ac58-77ba-4399-9f70-294d05e637f4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:07:34.031340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-18d0ac58-77ba-4399-9f70-294d05e637f4 for instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:07:34.036917 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Successfully detached device vdb from instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed from the live domain config.
May 28 03:07:34.038711 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:07:34.038984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18d0ac58-77ba-4399-9f70-294d05e637f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:34.039169 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:34.039795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:34.040210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '18d0ac58-77ba-4399-9f70-294d05e637f4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:07:34.040466 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:07:34.072058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:34.072058 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:34.072058 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:34.072058 np0000001589 nova-compute[98297]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:34.072058 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:34.072058 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:34.072323 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsi session list stdout=tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7 (non-flash)
May 28 03:07:34.072323 np0000001589 nova-compute[98297]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:34.072323 np0000001589 nova-compute[98297]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4 (non-flash)
May 28 03:07:34.072323 np0000001589 nova-compute[98297]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:34.072323 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:34.072323 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:34.072323 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3d008ba0-d8d3-4190-a798-07dc4732e4b7', '82'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', '86')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:07:34.072597 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', '83')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:34.073491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4', '84')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:34.074122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4051c2c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4'): ({'sdd'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:07:34.074310 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Removing multipathed devices sdd, sdc {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:07:34.074521 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Flush multipath device 3300000006d2f0114 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:07:34.107704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:34.128765 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:07:34.145974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:34.191949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:07:34.192331 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:07:34.193527 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:07:34.207594 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:07:34.207856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:07:34.221196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:34.256804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.40.100,3260]
May 28 03:07:34.256804 np0000001589 nova-compute[98297]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.40.100,3260] successful.
May 28 03:07:34.256804 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:34.277115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:34.281178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:34.281493 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:34.296456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:34.329851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.50.100,3260]
May 28 03:07:34.329851 np0000001589 nova-compute[98297]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-18d0ac58-77ba-4399-9f70-294d05e637f4, portal: 192.168.50.100,3260] successful.
May 28 03:07:34.329851 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:34.352416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:34.352675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:34.352774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] <== disconnect_volume: return (314ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:34.352884 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:07:34.420311 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Successfully updated port: 9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:07:34.482685 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-changed-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:34.482685 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Refreshing instance network info cache due to event network-changed-9a2a0acb-2785-4a56-9f6d-67de0a4c8277. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:07:34.482685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] Acquiring lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:34.482685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] Acquired lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:34.482685 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Refreshing network info cache for port 9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:07:34.577773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0bd3cb1f-d5b2-47c1-9ce5-6dcde5455bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.471s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:34.722600 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:34.785356 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:07:34.923796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:34.932206 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lazy-loading 'flavor' on Instance uuid 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:34.988101 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:35.051034 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:07:35.140107 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:07:35.141306 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:35.142538 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:07:35.142801 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Creating image(s)
May 28 03:07:35.144889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:35.145055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:35.145603 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:35.146387 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:35.149106 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:35.152940 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:35.244355 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:35.270660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.118s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:35.272315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:35.273031 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:35.273710 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:35.276374 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:07:35.280242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:35.346345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:35.346780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:35.351491 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:07:35.351634 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Claim successful on node np0000001589
May 28 03:07:35.367135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:35.367805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:35.431300 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk 1073741824" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:35.431819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:35.432236 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:35.523625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:35.524436 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:07:35.524743 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:35.626039 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:35.626517 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Cannot resize image /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:07:35.626997 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:07:35.627222 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Ensure instance console log exists: /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:07:35.627584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:35.627854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:35.628034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:35.650173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:35.748959 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-99ac0bbd-a8ce-4752-b145-280f61629f5e req-6f229e5e-8a73-40f8-a64a-f3fae825bcd1 service nova] Releasing lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:35.749672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:35.749925 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:07:35.954953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b206c30-d7e7-4567-94d2-44cf2767e420 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.041s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:36.323942 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:07:36.515487 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:36.708248 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Updating instance_info_cache with network_info: [{"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:36.743121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:36.743478 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:37.210023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:37.210023 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Instance network_info: |[{"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:07:37.211626 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Start _get_guest_xml network_info=[{"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:07:37.213854 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:07:37.215319 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1750601929', uuid='e8ff2f55-78d4-4022-8d61-8b5aab3f0576'), owner=OwnerMeta(userid='2d927d6b89cf4f0c96580968ea9c3791', username='tempest-TestEncryptedCinderVolumes-781621704-project-member', projectid='0eee8d500ee84b5f86e297c2660e183b', projectname='tempest-TestEncryptedCinderVolumes-781621704'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937657.2148924) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:07:37.216343 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:07:37.216721 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:07:37.217656 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:07:37.217843 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:07:37.218865 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:07:37.219272 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:07:37.219438 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:07:37.219557 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:07:37.219709 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:07:37.219822 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:07:37.219945 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:07:37.220126 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:07:37.220275 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:07:37.220414 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:07:37.220544 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:07:37.220692 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:07:37.238937 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:07:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1750601929',display_name='tempest-TestEncryptedCinderVolumes-server-1750601929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-1750601929',id=33,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5896FP+qqzKMggZJaoG06XI74uHegNzk0oSHBO4xNiEp0f1MYLtpJpprZfaE17PzqwQUZVCXnMRMwKpSMGcpMzm5P5Ko2Ln1ImsLhaDLtsrieC232V0dnWYZH+Xg2pMQ==',key_name='tempest-keypair-2091372292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-mzov90e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=e8ff2f55-78d4-4022-8d61-8b5aab3f0576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:07:37.239156 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:37.239755 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:22,bridge_name='br-int',has_traffic_filtering=True,id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2a0acb-27') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:37.240275 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'pci_devices' on Instance uuid e8ff2f55-78d4-4022-8d61-8b5aab3f0576 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:37.246810 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:37.355619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:37.356212 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:37.408540 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:37.408831 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:37.409070 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:37.409243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:37.409372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:37.411830 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Terminating instance
May 28 03:07:37.742914 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] End _get_guest_xml xml=<domain type="qemu">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <uuid>e8ff2f55-78d4-4022-8d61-8b5aab3f0576</uuid>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <name>instance-00000021</name>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1750601929</nova:name>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:07:37</nova:creationTime>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:user uuid="2d927d6b89cf4f0c96580968ea9c3791">tempest-TestEncryptedCinderVolumes-781621704-project-member</nova:user>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:project uuid="0eee8d500ee84b5f86e297c2660e183b">tempest-TestEncryptedCinderVolumes-781621704</nova:project>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         <nova:port uuid="9a2a0acb-2785-4a56-9f6d-67de0a4c8277">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <system>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <entry name="serial">e8ff2f55-78d4-4022-8d61-8b5aab3f0576</entry>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <entry name="uuid">e8ff2f55-78d4-4022-8d61-8b5aab3f0576</entry>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </system>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <os>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   </os>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <features>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   </features>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   <devices>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk.config"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:0c:c1:22"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <target dev="tap9a2a0acb-27"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </interface>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/console.log" append="off"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </serial>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <video>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </video>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </rng>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:   </devices>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]: </domain>
May 28 03:07:37.742914 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:07:37.745949 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Preparing to wait for external event network-vif-plugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:07:37.745949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:37.745949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:37.745949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:37.745949 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:07:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1750601929',display_name='tempest-TestEncryptedCinderVolumes-server-1750601929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-1750601929',id=33,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5896FP+qqzKMggZJaoG06XI74uHegNzk0oSHBO4xNiEp0f1MYLtpJpprZfaE17PzqwQUZVCXnMRMwKpSMGcpMzm5P5Ko2Ln1ImsLhaDLtsrieC232V0dnWYZH+Xg2pMQ==',key_name='tempest-keypair-2091372292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-mzov90e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=e8ff2f55-78d4-4022-8d61-8b5aab3f0576,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:07:37.745949 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:37.745949 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:22,bridge_name='br-int',has_traffic_filtering=True,id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2a0acb-27') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:37.750316 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:22,bridge_name='br-int',has_traffic_filtering=True,id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2a0acb-27') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:07:37.753192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.406s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:37.753450 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:07:37.755746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.106s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:37.756882 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.756882 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:37.756882 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:37.757286 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:07:37.757603 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:07:37.758433 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.758653 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa72fadd-e19e-5f9f-add8-5fc3fb4be7c4', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:37.767917 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.768771 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:37.772906 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.776679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.776679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a2a0acb-27, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:37.776679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a2a0acb-27, col_values=(('qos', UUID('d0014b77-2019-4925-a086-3fe2f2a9a84d')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:37.776679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a2a0acb-27, col_values=(('external_ids', {'iface-id': '9a2a0acb-2785-4a56-9f6d-67de0a4c8277', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:c1:22', 'vm-uuid': 'e8ff2f55-78d4-4022-8d61-8b5aab3f0576'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:37.776679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.778245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:37.785598 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.789729 np0000001589 nova-compute[98297]: INFO os_vif [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:c1:22,bridge_name='br-int',has_traffic_filtering=True,id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2a0acb-27')
May 28 03:07:37.857408 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:07:37.915508 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:07:37.946509 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.949899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.974291 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:37.978721 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.008057 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.008922 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.234773 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.249775 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.259097 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:07:38.263324 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:07:38.263717 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:38.263980 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:38.265699 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99844188399993 future=<Future at 0x7e4b40523050 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:38.266160 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998053169999821 future=<Future at 0x7e4b40523050 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:38.266160 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99794340499966 future=<Future at 0x7e4b40523050 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:38.267343 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Instance destroyed successfully.
May 28 03:07:38.267912 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lazy-loading 'resources' on Instance uuid 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:38.333755 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f776b52236043fb9455d1ec9a21c765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4892c2979f14a6dbc055d3e2d359bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:07:38.428710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:38.429475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:38.434205 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:07:38.434205 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Claim successful on node np0000001589
May 28 03:07:38.693679 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-964fbaeb-66f3-41ed-9ba2-25e9eb89dc0e req-72a831cd-efab-43c7-b11c-20a539ecfa6c service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:38.693921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-964fbaeb-66f3-41ed-9ba2-25e9eb89dc0e req-72a831cd-efab-43c7-b11c-20a539ecfa6c service nova] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:38.694129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-964fbaeb-66f3-41ed-9ba2-25e9eb89dc0e req-72a831cd-efab-43c7-b11c-20a539ecfa6c service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:38.694349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-964fbaeb-66f3-41ed-9ba2-25e9eb89dc0e req-72a831cd-efab-43c7-b11c-20a539ecfa6c service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:38.694527 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-964fbaeb-66f3-41ed-9ba2-25e9eb89dc0e req-72a831cd-efab-43c7-b11c-20a539ecfa6c service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] No event matching network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 in dict_keys([('network-vif-plugged', '9a2a0acb-2785-4a56-9f6d-67de0a4c8277')]) {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 28 03:07:38.694705 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-964fbaeb-66f3-41ed-9ba2-25e9eb89dc0e req-72a831cd-efab-43c7-b11c-20a539ecfa6c service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received unexpected event network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 for instance with vm_state building and task_state spawning.
May 28 03:07:38.764767 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:07:38.770726 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-2087692603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testservervolumeattachscenariooldversion-server-2087692',id=30,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1puY5mfGs3tJbfFRDkcfIc3grVBqYUlScb6A9cdDKPYPwO/MohRAydUKIO6ukPOGKUIUHB53FqcnrPGMUZ/vx8njakNFfxU+U+uCCe848giyoG6+8BqSVGWiaaaPjQ9g==',key_name='tempest-keypair-1114737077',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:40Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd36cb845b9943e18abc432b1d7baf7e',ramdisk_id='',reservation_id='r-ajdw4aiw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-176036810',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48dc5997377e4ca8936b8d440a8fa401',uuid=7a37d0c2-ade8-45d3-a8a6-54975c7c36ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:07:38.771812 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Converting VIF {"id": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "address": "fa:16:3e:0a:4b:8b", "network": {"id": "505b7bc8-9fac-4114-9e49-c9a76d1687e9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-485115206-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "cd36cb845b9943e18abc432b1d7baf7e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap086a2600-25", "ovs_interfaceid": "086a2600-25e8-4ce1-8098-cb8646b0c6ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:38.772625 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:4b:8b,bridge_name='br-int',has_traffic_filtering=True,id=086a2600-25e8-4ce1-8098-cb8646b0c6ad,network=Network(505b7bc8-9fac-4114-9e49-c9a76d1687e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap086a2600-25') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:38.772946 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:4b:8b,bridge_name='br-int',has_traffic_filtering=True,id=086a2600-25e8-4ce1-8098-cb8646b0c6ad,network=Network(505b7bc8-9fac-4114-9e49-c9a76d1687e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap086a2600-25') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:07:38.775457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.775733 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap086a2600-25, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:38.778065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:38.783675 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.785380 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.785603 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97318548-384c-455b-974e-07e6541151c3) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:38.786878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:38.792487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:38.811321 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:38.821886 np0000001589 nova-compute[98297]: INFO os_vif [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:4b:8b,bridge_name='br-int',has_traffic_filtering=True,id=086a2600-25e8-4ce1-8098-cb8646b0c6ad,network=Network(505b7bc8-9fac-4114-9e49-c9a76d1687e9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap086a2600-25')
May 28 03:07:38.822734 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Deleting instance files /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed_del
May 28 03:07:38.823535 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Deletion of /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed_del complete
May 28 03:07:38.904958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk --force-share --output=json" returned: 1 in 0.112s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:38.905163 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk --force-share --output=json' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:07:38.906200 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001e, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/7a37d0c2-ade8-45d3-a8a6-54975c7c36ed/disk
May 28 03:07:38.909217 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:38.926280 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Successfully created port: b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:07:39.007206 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:39.007206 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:39.100332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:39.100332 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:07:39.103980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:39.213087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:39.216261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:39.272463 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:07:39.316319 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:39.321418 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:07:39.323923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:39.357339 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:39.357535 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:39.357711 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:0c:c1:22, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:07:39.358705 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Using config drive
May 28 03:07:39.359276 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Took 1.44 seconds to destroy the instance on the hypervisor.
May 28 03:07:39.364552 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:07:39.365027 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:07:39.365326 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:07:39.366601 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:39.379500 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:39.379500 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=12865MB free_disk=73.95325088500977GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:07:39.379500 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:39.507721 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:39.552890 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Successfully updated port: b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:07:39.615514 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-changed-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:39.616795 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Refreshing instance network info cache due to event network-changed-b1b2aac4-edce-455a-a545-2340a71b9bfa. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:07:39.616795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] Acquiring lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:39.616795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] Acquired lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:39.616953 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Refreshing network info cache for port b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:07:39.778603 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Booting with volume 567fb5dd-f8c4-4085-80cd-a3709b2f4c65 at /dev/vda
May 28 03:07:39.823696 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:39.839320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:07:39.863034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:39.885119 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:39.908572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:07:39.908774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:07:39.917315 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:39.917528 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:39.920102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:07:39.920943 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:feeb:12d7', 'fe80::605f:95ff:fe0c:986d'] 
May 28 03:07:39.921079 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:07:39.921196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:07:39.921469 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:39.921660 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Updating existing volume attachment record: 2406beb2-6946-4eff-ad7b-7b83bdf7ace6 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:07:40.057407 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:40.061051 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Creating config drive at /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk.config
May 28 03:07:40.065481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxp39lyb3 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:40.121036 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:40.124457 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxp39lyb3" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:40.197991 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:07:40.360580 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:40.421134 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:40.469441 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:40.579761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:40.611807 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:40.613101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:40.724847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:40.775474 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-vif-unplugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:40.776056 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:40.776056 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:40.776282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:40.781382 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] No waiting events found dispatching network-vif-unplugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:40.781677 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-vif-unplugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:40.781765 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-vif-unplugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:40.781933 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] Acquiring lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:40.782114 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:40.782313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:40.782786 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] No waiting events found dispatching network-vif-unplugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:40.782985 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-vif-unplugged-086a2600-25e8-4ce1-8098-cb8646b0c6ad for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:07:40.783096 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-64e74df6-98b2-4dfd-90c1-2335e6a91641 req-f65a6396-2490-4689-ac8f-0f74c66c71d7 service nova] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Received event network-vif-deleted-086a2600-25e8-4ce1-8098-cb8646b0c6ad {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:40.862856 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7c0d5213-5470-4937-93d6-5eef1f1b33d7 req-918dec49-f755-4a99-982e-9b9782702c1d service nova] Releasing lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:40.863212 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquired lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:40.863385 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:07:40.934316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.503s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:40.934316 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:07:40.935291 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.556s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:40.952623 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:40.971486 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Took 1.61 seconds to deallocate network for instance.
May 28 03:07:40.985818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:41.412634 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937661.4122705, e8ff2f55-78d4-4022-8d61-8b5aab3f0576 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:41.412962 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] VM Started (Lifecycle Event)
May 28 03:07:41.435572 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:07:41.439375 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:07:41.440365 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:07:41.440528 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:41.440898 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:41.477437 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:41.531670 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada2cf15d86b4419ab73c67773ff8785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac8d769a2d4b49807632858d7e6423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:07:41.622339 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:41.764280 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Updating instance_info_cache with network_info: [{"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:41.915630 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:41.919507 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937661.9191575, e8ff2f55-78d4-4022-8d61-8b5aab3f0576 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:41.923247 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] VM Paused (Lifecycle Event)
May 28 03:07:41.943489 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:07:42.027387 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Successfully created port: 2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:07:42.032166 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7aaca677-0143-4ffd-8206-e47614601132 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:07:42.032437 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:07:42.032807 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 94a458ec-8795-4832-93b3-cfda54f6444a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:07:42.032807 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:07:42.032876 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance bbe1fdbc-f534-444c-8ad2-982bf5108932 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:07:42.033003 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:07:42.033136 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:07:42.033364 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:07:39 up 35 min,  2 users,  load average: 6.88, 6.33, 3.71\n', 'num_instances': '6', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '6', 'num_proj_80ff1bde877e4c3d9883c34167e979ce': '1', 'io_workload': '3', 'num_vm_building': '3', 'num_task_spawning': '1', 'num_proj_0eee8d500ee84b5f86e297c2660e183b': '1', 'num_task_block_device_mapping': '1', 'num_proj_f4892c2979f14a6dbc055d3e2d359bfa': '1', 'num_proj_52ac8d769a2d4b49807632858d7e6423': '1', 'num_proj_c470ae60a73f43d183ba78fe4ed0d29b': '1', 'num_task_deleting': '1', 'num_proj_cd36cb845b9943e18abc432b1d7baf7e': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:07:42.066262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:07:42.067042 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:07:42.067270 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Creating image(s)
May 28 03:07:42.068854 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:07:42.068854 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Ensure instance console log exists: /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:07:42.068854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:42.068854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:42.068854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:42.266392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Releasing lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:42.266758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance network_info: |[{"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:07:42.267485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Start _get_guest_xml network_info=[{"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '2406beb2-6946-4eff-ad7b-7b83bdf7ace6', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'bbe1fdbc-f534-444c-8ad2-982bf5108932', 'attached_at': '', 'detached_at': '', 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'serial': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:07:42.269154 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:07:42.270072 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1321674240', uuid='bbe1fdbc-f534-444c-8ad2-982bf5108932'), owner=OwnerMeta(userid='1f776b52236043fb9455d1ec9a21c765', username='tempest-ServerActionsV293TestJSON-1182810107-project-member', projectid='f4892c2979f14a6dbc055d3e2d359bfa', projectname='tempest-ServerActionsV293TestJSON-1182810107'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937662.2698069) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:07:42.270980 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:07:42.271301 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:07:42.271971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:07:42.272107 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:07:42.272903 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:07:42.273142 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:07:42.273299 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:07:42.273383 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:07:42.273492 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:07:42.273566 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:07:42.273646 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:07:42.273775 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:07:42.273859 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:07:42.273950 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:07:42.274039 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:07:42.274144 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:07:42.285404 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:07:42.285667 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:42.285847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:42.367977 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:42.368076 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:42.423044 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:42.424650 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:42.446843 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:07:42.500022 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Successfully updated port: 2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:07:42.775121 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:42.835407 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-plugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:42.835950 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:42.836802 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:42.837000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:42.837064 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Processing event network-vif-plugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:07:42.837322 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-plugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:42.837372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:42.837530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:42.837592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:42.837669 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] No waiting events found dispatching network-vif-plugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:42.838322 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:07:42.838498 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received unexpected event network-vif-plugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 for instance with vm_state building and task_state spawning.
May 28 03:07:42.838618 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-changed-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:42.838862 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Refreshing instance network info cache due to event network-changed-2eeba967-caa5-4c62-b27b-9bc2637e1ef9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:07:42.838862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Acquiring lock "refresh_cache-138a2f6c-4e95-4349-b9f6-e4557fe7f546" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:42.838962 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Acquired lock "refresh_cache-138a2f6c-4e95-4349-b9f6-e4557fe7f546" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:42.839014 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Refreshing network info cache for port 2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:07:42.844256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:07:42.846365 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Instance spawned successfully.
May 28 03:07:42.846681 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:07:42.870575 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:42.927448 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:07:42.927620 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937662.9273612, e8ff2f55-78d4-4022-8d61-8b5aab3f0576 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:42.927726 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] VM Resumed (Lifecycle Event)
May 28 03:07:42.954256 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Booting with volume 30e0fbdc-ff94-459f-8225-6376530e147f at /dev/vda
May 28 03:07:42.997372 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:43.003830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-138a2f6c-4e95-4349-b9f6-e4557fe7f546" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:43.015770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:07:43.039322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:43.082637 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:07:43.082929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:07:43.091152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:07:43.092360 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:feeb:12d7', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe0c:c122', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:07:43.092895 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:07:43.093002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:07:43.093293 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:43.093510 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Updating existing volume attachment record: 648c2319-69fc-4f46-94b4-fc164bea458a {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:07:43.343360 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:43.356734 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:43.356869 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:43.357265 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:43.357537 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:43.357808 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:43.358051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:43.379627 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:07:43.379627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.444s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:43.380067 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.903s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:43.380580 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:43.380769 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98297) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 03:07:43.424783 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:07:43.431434 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:43.434089 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:43.575163 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:43.760607 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:07:43.760789 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:07:43.787026 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:43.863303 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Took 8.72 seconds to spawn the instance on the hypervisor.
May 28 03:07:43.863538 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:43.887769 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:07:43.937297 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:07:44.077772 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e443cc9-ed0e-4f62-be89-564caffa2c77 req-f6f6edc0-f41c-4bae-ae02-6dc3e7ddf61b service nova] Releasing lock "refresh_cache-138a2f6c-4e95-4349-b9f6-e4557fe7f546" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:44.078271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-138a2f6c-4e95-4349-b9f6-e4557fe7f546" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:44.078455 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:07:44.260316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.974s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:44.261164 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:07:44.262980 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:07:44.275385 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:44.276004 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:44.276687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:44.276961 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:44.280294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:44.280294 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:44.288730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:44.288730 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:44.293720 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:44.293720 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65] added
May 28 03:07:44.305595 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:44.305595 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:44.305595 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:44.308194 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65] added
May 28 03:07:44.308194 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:44.308194 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:44.308194 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:44.308194 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:44.308194 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:44.308194 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:44.308410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:44.308518 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:44.308649 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:44.371112 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Took 14.19 seconds to build instance.
May 28 03:07:44.655317 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:07:44.772472 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.392s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:44.851425 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Deleted allocations for instance 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed
May 28 03:07:44.872500 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3aaae8b4-b964-4bc0-953c-f796e84aa7f4 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.700s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:44.876579 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:44.882512 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:44.885947 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:44.885947 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:07:44.885947 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.36 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:07:44.980938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:44.981214 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:45.046935 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Updating instance_info_cache with network_info: [{"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:45.214766 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:07:45.215721 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:07:45.216242 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Creating image(s)
May 28 03:07:45.216242 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:07:45.216339 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Ensure instance console log exists: /opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:07:45.216524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:45.216669 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:45.216814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:45.305279 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:45.309068 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:45.317803 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:45.317803 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:45.324323 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:45.324323 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.335166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.335624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.348569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.348569 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.348569 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.348569 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:45.348830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.348830 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.348830 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.348830 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:45.349120 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.349120 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.349120 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.349120 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:45.349288 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.349288 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.349288 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.349288 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:45.378847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260]
May 28 03:07:45.378847 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260] successful.
May 28 03:07:45.378847 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.383035 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260]
May 28 03:07:45.383035 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260] successful.
May 28 03:07:45.383035 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.390183 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.398535 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.407276 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:45.407766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:45.407766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:45.410285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] HCTL ('8', '-', '-', 0) found on session 88 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:45.410285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:45.416436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.416436 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.416436 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.416436 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.416436 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.416436 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:45.416678 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.416678 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:45.416678 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:45.416678 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.416678 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:45.416678 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:45.417125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:45.417125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:45.417835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] HCTL ('9', '-', '-', 0) found on session 89 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:45.417952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:45.425413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching for a device in session 88 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:45.425413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:45.435798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching for a device in session 89 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:45.435949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:45.483895 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Detaching volume 49a91a27-953f-4eb7-a8e9-89f58c0012c8
May 28 03:07:45.548986 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-138a2f6c-4e95-4349-b9f6-e4557fe7f546" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:45.549389 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Instance network_info: |[{"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:07:45.551533 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Start _get_guest_xml network_info=[{"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '648c2319-69fc-4f46-94b4-fc164bea458a', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '138a2f6c-4e95-4349-b9f6-e4557fe7f546', 'attached_at': '', 'detached_at': '', 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'serial': '30e0fbdc-ff94-459f-8225-6376530e147f', 'multiattach': True}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:07:45.561860 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:07:45.561860 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-223705336', uuid='138a2f6c-4e95-4349-b9f6-e4557fe7f546'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937665.5610392) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:07:45.563870 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:07:45.565493 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:07:45.565493 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to driver detach volume 49a91a27-953f-4eb7-a8e9-89f58c0012c8 from mountpoint /dev/vdb
May 28 03:07:45.568085 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:07:45.568414 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:07:45.569747 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:07:45.570144 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:07:45.570381 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:07:45.570719 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:07:45.570862 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:07:45.571090 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:07:45.571283 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:07:45.571570 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:07:45.571726 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:07:45.571854 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:07:45.571959 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:07:45.572343 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:07:45.582953 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:07:45.586178 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:07:45.586178 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Attempting to detach device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:07:45.586178 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:07:45.586178 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:45.586178 np0000001589 nova-compute[98297]:   <alias name="ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8"/>
May 28 03:07:45.586178 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:07:45.586178 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:45.586178 np0000001589 nova-compute[98297]:   <serial>49a91a27-953f-4eb7-a8e9-89f58c0012c8</serial>
May 28 03:07:45.586178 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:07:45.586178 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:45.586178 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:07:45.591261 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:07:45.593911 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:45.593911 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:45.597135 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config.
May 28 03:07:45.597135 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] (1/8): Attempting to detach device vdb with device alias ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8 from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:07:45.597572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:07:45.597572 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:45.597572 np0000001589 nova-compute[98297]:   <alias name="ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8"/>
May 28 03:07:45.597572 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:07:45.597572 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:07:45.597572 np0000001589 nova-compute[98297]:   <serial>49a91a27-953f-4eb7-a8e9-89f58c0012c8</serial>
May 28 03:07:45.597572 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:07:45.597572 np0000001589 nova-compute[98297]: </disk>
May 28 03:07:45.597572 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:07:45.623526 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-changed-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:45.623526 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Refreshing instance network info cache due to event network-changed-9a2a0acb-2785-4a56-9f6d-67de0a4c8277. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:07:45.623758 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] Acquiring lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:45.627048 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] Acquired lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:45.627048 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Refreshing network info cache for port 9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:07:45.869432 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c4bb3f8-1cbb-41c2-b976-27c2b273d88e tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Lock "7a37d0c2-ade8-45d3-a8a6-54975c7c36ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.460s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:46.132375 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:46.205029 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937666.204355, 7aaca677-0143-4ffd-8206-e47614601132 => ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:07:46.205912 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-49a91a27-953f-4eb7-a8e9-89f58c0012c8 for instance 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:07:46.209525 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config.
May 28 03:07:46.210982 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:07:46.211241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:46.211366 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:46.277412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:07:46.517388 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:46.692323 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Updated VIF entry in instance network info cache for port 9a2a0acb-2785-4a56-9f6d-67de0a4c8277. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:07:46.692584 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Updating instance_info_cache with network_info: [{"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:47.195872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4664e5cb-1d7b-4041-8329-1e8352178299 req-30a3633b-f902-462e-9515-479d9c266b13 service nova] Releasing lock "refresh_cache-e8ff2f55-78d4-4022-8d61-8b5aab3f0576" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:47.299939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Found WWN 3300000007c93f769 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:07:47.300074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:47.300413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] <== connect_volume: return (5014ms) {'type': 'block', 'scsi_wwn': '3300000007c93f769', 'path': '/dev/dm-0', 'multipath_id': '3300000007c93f769'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:47.300723 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007c93f769', 'path': '/dev/dm-0', 'multipath_id': '3300000007c93f769'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:07:47.301271 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.709s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:47.301823 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:07:47.317254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:47.318356 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:47.318472 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:47.318979 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:47.319237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:47.319878 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:47.332325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:47.332325 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:47.341417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:47.341417 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:47.348322 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f] added
May 28 03:07:47.348322 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:47.348322 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:47.348322 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:47.348322 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:47.348322 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:47.348322 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:47.348566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:47.348626 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:47.348764 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:47.355901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f] added
May 28 03:07:47.355901 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:47.355901 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:47.355901 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:47.355901 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:47.355901 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:47.355901 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:47.356290 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:47.356550 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.037(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:47.356749 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:47.777588 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:47.808644 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1321674240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionsv293testjson-server-1321674240',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3hDIHKDwZCYjvIQ/AFuVBITm39hgX9ZkqgE1WS7Mwn+hc7CvfM7//lGgtkulsIwGUuyXwpO03DqyaRO+qN8oMsRIB8U2wC7XDILYN6XI/HRQ8z1XvjJ7U34UhbCRY/5Q==',key_name='tempest-keypair-64605543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4892c2979f14a6dbc055d3e2d359bfa',ramdisk_id='',reservation_id='r-vj2w8kuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1182810107',owner_user_name='tempest-ServerActionsV293TestJSON-1182810107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f776b52236043fb9455d1ec9a21c765',uuid=bbe1fdbc-f534-444c-8ad2-982bf5108932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:07:47.809415 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converting VIF {"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:47.809415 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:47.810266 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lazy-loading 'pci_devices' on Instance uuid bbe1fdbc-f534-444c-8ad2-982bf5108932 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:48.315783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] End _get_guest_xml xml=<domain type="qemu">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <uuid>bbe1fdbc-f534-444c-8ad2-982bf5108932</uuid>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <name>instance-00000022</name>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1321674240</nova:name>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:07:42</nova:creationTime>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:user uuid="1f776b52236043fb9455d1ec9a21c765">tempest-ServerActionsV293TestJSON-1182810107-project-member</nova:user>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:project uuid="f4892c2979f14a6dbc055d3e2d359bfa">tempest-ServerActionsV293TestJSON-1182810107</nova:project>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         <nova:port uuid="b1b2aac4-edce-455a-a545-2340a71b9bfa">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <system>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <entry name="serial">bbe1fdbc-f534-444c-8ad2-982bf5108932</entry>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <entry name="uuid">bbe1fdbc-f534-444c-8ad2-982bf5108932</entry>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </system>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <os>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   </os>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <features>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   </features>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   <devices>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <alias name="ua-567fb5dd-f8c4-4085-80cd-a3709b2f4c65"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <serial>567fb5dd-f8c4-4085-80cd-a3709b2f4c65</serial>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:94:9f:33"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <target dev="tapb1b2aac4-ed"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </interface>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/console.log" append="off"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </serial>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <video>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </video>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </rng>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:   </devices>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]: </domain>
May 28 03:07:48.315783 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:07:48.318157 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Preparing to wait for external event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:07:48.318157 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:48.318157 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:48.318157 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:48.324717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1321674240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionsv293testjson-server-1321674240',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3hDIHKDwZCYjvIQ/AFuVBITm39hgX9ZkqgE1WS7Mwn+hc7CvfM7//lGgtkulsIwGUuyXwpO03DqyaRO+qN8oMsRIB8U2wC7XDILYN6XI/HRQ8z1XvjJ7U34UhbCRY/5Q==',key_name='tempest-keypair-64605543',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4892c2979f14a6dbc055d3e2d359bfa',ramdisk_id='',reservation_id='r-vj2w8kuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1182810107',owner_user_name='tempest-ServerActionsV293TestJSON-1182810107-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f776b52236043fb9455d1ec9a21c765',uuid=bbe1fdbc-f534-444c-8ad2-982bf5108932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:07:48.325218 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converting VIF {"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:48.326119 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:48.326522 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:07:48.327564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:48.327564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:48.327564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:07:48.329530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:48.329530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbbe6921-a83c-542d-a5c7-86952f2cf9f3', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:48.330430 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:48.349569 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:48.356993 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:48.358649 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:48.360257 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:48.361189 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:48.362689 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1b2aac4-ed, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:48.362689 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1b2aac4-ed, col_values=(('qos', UUID('22ddc32f-eab9-4ea0-bb94-7563a441dcb6')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:48.362689 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1b2aac4-ed, col_values=(('external_ids', {'iface-id': 'b1b2aac4-edce-455a-a545-2340a71b9bfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:9f:33', 'vm-uuid': 'bbe1fdbc-f534-444c-8ad2-982bf5108932'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:48.366004 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.366004 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:48.369394 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:48.369683 np0000001589 nova-compute[98297]: INFO os_vif [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed')
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:48.374080 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:48.374080 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.381093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.388890 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.400926 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:48.405924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.405924 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.405924 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.405924 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.405924 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.405924 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:48.406089 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.406089 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.406089 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.406089 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.406089 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.406089 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:48.442089 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.40.100,3260]
May 28 03:07:48.442089 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.40.100,3260] successful.
May 28 03:07:48.442089 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.455479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.458433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.50.100,3260]
May 28 03:07:48.458433 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.50.100,3260] successful.
May 28 03:07:48.458433 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.474639 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:48.474639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:48.475619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:48.476444 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('12', '-', '-', 0) found on session 90 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:48.476642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:48.494292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.494292 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.494292 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.494292 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.494292 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.494292 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.494292 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.494292 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:48.494570 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.494570 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:48.494570 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:48.494570 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.494570 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:48.494570 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.494570 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:48.494570 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:48.494923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:48.494923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:48.495743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('13', '-', '-', 0) found on session 91 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:48.495856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:48.514670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 90 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:48.514670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:48.518244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 91 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:48.518500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:49.325834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:07:49.889163 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:49.889296 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:49.889399 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No VIF found with MAC fa:16:3e:94:9f:33, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:07:49.889710 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Using config drive
May 28 03:07:50.341499 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 33000000030783bfd for multipath device dm-4 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:07:50.341999 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:50.341999 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (4750ms) {'type': 'block', 'scsi_wwn': '33000000030783bfd', 'path': '/dev/dm-4', 'multipath_id': '33000000030783bfd'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:50.342150 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000030783bfd', 'path': '/dev/dm-4', 'multipath_id': '33000000030783bfd'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:07:50.344105 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 4.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:50.346004 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '49a91a27-953f-4eb7-a8e9-89f58c0012c8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:07:50.346214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:07:50.371500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:50.371500 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:50.371500 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:50.371500 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:50.371500 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:50.371500 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:50.371500 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:50.371500 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: tcp: [86] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8 (non-flash)
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:50.371802 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:50.371802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', '85'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', '86'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732', '87'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:07:50.372154 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', '85')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:50.372792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8', '86')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:07:50.373736 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64443ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:07:50.374041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Removing multipathed devices sde, sdf {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:07:50.374189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Flush multipath device 330000000e59bc412 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:07:50.398446 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:50.415426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:50.425401 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:50.453927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:07:50.504798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:07:50.505157 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:07:50.506604 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:07:50.520007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:07:50.520542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:07:50.533426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:50.573425 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Creating config drive at /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config
May 28 03:07:50.574188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 85, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.40.100,3260]
May 28 03:07:50.574188 np0000001589 nova-compute[98297]: Logout of [sid: 85, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.40.100,3260] successful.
May 28 03:07:50.574188 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:50.579030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprnuk8rxy {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:50.594922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:50.609287 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:50.638686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 86, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.50.100,3260]
May 28 03:07:50.638686 np0000001589 nova-compute[98297]: Logout of [sid: 86, target: iqn.2023-03.storpool.com:os--volume-49a91a27-953f-4eb7-a8e9-89f58c0012c8, portal: 192.168.50.100,3260] successful.
May 28 03:07:50.638686 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:50.648984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprnuk8rxy" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:50.665911 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:50.666352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:50.666511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== disconnect_volume: return (4454ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:50.666668 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:07:50.848264 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-223705336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumemultiattachtest-server-223705336',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-gmg7v0o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:42Z,user_data=None,user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=138a2f6c-4e95-4349-b9f6-e4557fe7f546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:07:50.848417 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:50.849095 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeba967-ca') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:50.849901 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'pci_devices' on Instance uuid 138a2f6c-4e95-4349-b9f6-e4557fe7f546 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:51.149321 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.178630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.188525 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.251738 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:51.288421 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.354321 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] End _get_guest_xml xml=<domain type="qemu">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <uuid>138a2f6c-4e95-4349-b9f6-e4557fe7f546</uuid>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <name>instance-00000023</name>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-223705336</nova:name>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:07:45</nova:creationTime>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         <nova:port uuid="2eeba967-caa5-4c62-b27b-9bc2637e1ef9">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <system>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <entry name="serial">138a2f6c-4e95-4349-b9f6-e4557fe7f546</entry>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <entry name="uuid">138a2f6c-4e95-4349-b9f6-e4557fe7f546</entry>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </system>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <os>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   </os>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <features>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   </features>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   <devices>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546/disk.config"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <alias name="ua-30e0fbdc-ff94-459f-8225-6376530e147f"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-4"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <serial>30e0fbdc-ff94-459f-8225-6376530e147f</serial>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <shareable/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </disk>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:f8:75:b3"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <target dev="tap2eeba967-ca"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </interface>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546/console.log" append="off"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </serial>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <video>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </video>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </rng>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:   </devices>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]: </domain>
May 28 03:07:51.354321 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:07:51.360561 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Preparing to wait for external event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:07:51.360561 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:51.360561 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:51.360561 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:51.360561 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-223705336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumemultiattachtest-server-223705336',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-gmg7v0o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:07:42Z,user_data=None,user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=138a2f6c-4e95-4349-b9f6-e4557fe7f546,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:07:51.363390 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:07:51.363390 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeba967-ca') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:07:51.363390 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeba967-ca') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:07:51.363390 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.363390 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:51.363749 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:07:51.364948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.365695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db9d8b02-f772-5b28-a412-6de0d85676a2', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:51.368619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.373441 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:51.375834 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.376024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eeba967-ca, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:51.376392 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2eeba967-ca, col_values=(('qos', UUID('bee93b76-47e5-49e2-be75-15ffaf60af87')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:51.376549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2eeba967-ca, col_values=(('external_ids', {'iface-id': '2eeba967-caa5-4c62-b27b-9bc2637e1ef9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:75:b3', 'vm-uuid': '138a2f6c-4e95-4349-b9f6-e4557fe7f546'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:07:51.380690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.382404 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:07:51.389958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.390443 np0000001589 nova-compute[98297]: INFO os_vif [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeba967-ca')
May 28 03:07:51.562789 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eea037a1-0188-490b-a4c4-b8399c79c0e7 req-b80f8a45-25e6-4cc4-bd3e-5939aefea084 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:51.563022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eea037a1-0188-490b-a4c4-b8399c79c0e7 req-b80f8a45-25e6-4cc4-bd3e-5939aefea084 service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:51.563268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eea037a1-0188-490b-a4c4-b8399c79c0e7 req-b80f8a45-25e6-4cc4-bd3e-5939aefea084 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:51.563455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eea037a1-0188-490b-a4c4-b8399c79c0e7 req-b80f8a45-25e6-4cc4-bd3e-5939aefea084 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:51.563601 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eea037a1-0188-490b-a4c4-b8399c79c0e7 req-b80f8a45-25e6-4cc4-bd3e-5939aefea084 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Processing event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:07:51.614045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.623245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.626246 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.661954 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:51.760821 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:07:52.259918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ded7707c-d1dc-46ba-9464-46c647d03bbe tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.279s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:52.280776 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937672.2790399, bbe1fdbc-f534-444c-8ad2-982bf5108932 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:52.280776 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] VM Started (Lifecycle Event)
May 28 03:07:52.283041 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:07:52.287644 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:07:52.292884 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance spawned successfully.
May 28 03:07:52.293593 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:07:52.786386 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:52.790780 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:52.804813 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:52.805460 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:52.807524 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:52.808362 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:52.808598 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:52.809464 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:52.852412 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:52.914388 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:52.914529 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:07:52.914628 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:f8:75:b3, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:07:52.915102 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Using config drive
May 28 03:07:53.265163 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0010114950000570389 future=<Future at 0x7e4b40523050 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:53.265609 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:07:53.265867 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Emitting event <LifecycleEvent: 1779937658.264012, 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:53.266132 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] VM Stopped (Lifecycle Event)
May 28 03:07:53.296008 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:07:53.296595 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937673.2960505, bbe1fdbc-f534-444c-8ad2-982bf5108932 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:53.296700 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] VM Paused (Lifecycle Event)
May 28 03:07:53.322016 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Took 11.26 seconds to spawn the instance on the hypervisor.
May 28 03:07:53.322192 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:53.425072 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:53.611245 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Creating config drive at /opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546/disk.config
May 28 03:07:53.620682 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpds1tqwrj {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:53.687862 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-77cff8b7-a1cd-4ece-a1a5-dfb47f700212 req-5ba5c493-9079-4102-8748-282a92ab3438 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:53.688410 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-77cff8b7-a1cd-4ece-a1a5-dfb47f700212 req-5ba5c493-9079-4102-8748-282a92ab3438 service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:53.690516 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpds1tqwrj" returned: 0 in 0.067s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:07:53.691645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-77cff8b7-a1cd-4ece-a1a5-dfb47f700212 req-5ba5c493-9079-4102-8748-282a92ab3438 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:53.691645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-77cff8b7-a1cd-4ece-a1a5-dfb47f700212 req-5ba5c493-9079-4102-8748-282a92ab3438 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:53.691645 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-77cff8b7-a1cd-4ece-a1a5-dfb47f700212 req-5ba5c493-9079-4102-8748-282a92ab3438 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] No waiting events found dispatching network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:53.691645 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-77cff8b7-a1cd-4ece-a1a5-dfb47f700212 req-5ba5c493-9079-4102-8748-282a92ab3438 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received unexpected event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa for instance with vm_state active and task_state None.
May 28 03:07:53.769991 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: 7a37d0c2-ade8-45d3-a8a6-54975c7c36ed] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:53.802007 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:53.809170 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937673.807042, bbe1fdbc-f534-444c-8ad2-982bf5108932 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:53.809170 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] VM Resumed (Lifecycle Event)
May 28 03:07:53.839433 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Took 18.55 seconds to build instance.
May 28 03:07:54.111408 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:54.113530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:54.248829 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:54.278977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:54.282903 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:54.310845 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:54.316900 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:54.341898 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.061s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:54.392141 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:54.619392 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:07:54.683054 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:54.686290 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:54.688960 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:54.720306 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:55.187744 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937675.1874259, 138a2f6c-4e95-4349-b9f6-e4557fe7f546 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:55.188112 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] VM Started (Lifecycle Event)
May 28 03:07:55.589830 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:55.628378 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:55.690055 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:55.693756 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937675.693513, 138a2f6c-4e95-4349-b9f6-e4557fe7f546 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:55.693922 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] VM Paused (Lifecycle Event)
May 28 03:07:55.777259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-changed-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:55.777463 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Refreshing instance network info cache due to event network-changed-b1b2aac4-edce-455a-a545-2340a71b9bfa. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:07:55.777684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] Acquiring lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:07:55.777818 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] Acquired lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:07:55.777985 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Refreshing network info cache for port b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:07:56.053122 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-33ea8798-98d9-4dab-b196-f3c1edce57e5 req-9798ab95-41b8-414f-b4db-8db0993cfbb1 service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:56.053929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-33ea8798-98d9-4dab-b196-f3c1edce57e5 req-9798ab95-41b8-414f-b4db-8db0993cfbb1 service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:56.053929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-33ea8798-98d9-4dab-b196-f3c1edce57e5 req-9798ab95-41b8-414f-b4db-8db0993cfbb1 service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:56.054033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-33ea8798-98d9-4dab-b196-f3c1edce57e5 req-9798ab95-41b8-414f-b4db-8db0993cfbb1 service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:56.054499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-33ea8798-98d9-4dab-b196-f3c1edce57e5 req-9798ab95-41b8-414f-b4db-8db0993cfbb1 service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Processing event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:07:56.057249 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:07:56.063600 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:07:56.075086 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Instance spawned successfully.
May 28 03:07:56.076120 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:07:56.197992 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:56.201920 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937676.2016582, 138a2f6c-4e95-4349-b9f6-e4557fe7f546 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:07:56.202048 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] VM Resumed (Lifecycle Event)
May 28 03:07:56.283851 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:56.380864 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:56.585649 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:56.585850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:56.588064 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:56.588064 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:56.588064 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:56.588064 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:07:56.704060 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:07:56.707564 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:56.713077 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:07:56.744555 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:56.744851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:56.745177 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attaching volume 967ca43b-5191-465c-bbae-fee774a97938 to /dev/vdb
May 28 03:07:56.805025 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:56.823092 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:07:56.854752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:07:56.928423 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:07:56.928768 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:07:56.939255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:07:56.939838 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:feeb:12d7', 'fe80::605f:95ff:fe0c:986d', 'fe80::fc16:3eff:fe0c:c122', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fe94:9f33', 'fe80::c062:69ff:feb9:518c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608'] 
May 28 03:07:56.939908 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:07:56.940003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:07:56.940298 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:07:56.940754 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating existing volume attachment record: 31c670f3-874c-4c66-94b4-05e40b20bfa9 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:07:57.075158 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:57.098917 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Took 11.88 seconds to spawn the instance on the hypervisor.
May 28 03:07:57.099164 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:07:57.102513 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Updated VIF entry in instance network info cache for port b1b2aac4-edce-455a-a545-2340a71b9bfa. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:07:57.102949 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Updating instance_info_cache with network_info: [{"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:07:57.217148 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:07:57.521991 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:07:57.522468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967ca43b-5191-465c-bbae-fee774a97938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:07:57.522666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:57.523171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:57.523489 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967ca43b-5191-465c-bbae-fee774a97938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:07:57.537540 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:57.538145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:07:57.538919 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:57.538919 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:57.540281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:07:57.540476 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:57.550465 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:57.550465 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:57.558246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:07:57.558246 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:57.566688 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938] added
May 28 03:07:57.566688 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:57.566688 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:57.566688 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:57.566688 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:57.566688 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:57.566688 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:57.567412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:57.567412 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:57.567681 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:57.570763 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938] added
May 28 03:07:57.570763 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:07:57.570763 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:57.570763 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:57.570763 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:07:57.570763 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:07:57.570763 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:57.570969 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:07:57.571143 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:07:57.571189 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:07:57.610499 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-12a006e7-c383-495d-9329-c2e015fa367b req-38b1be2d-2a7a-4854-a776-c1a6ef3aa5fe service nova] Releasing lock "refresh_cache-bbe1fdbc-f534-444c-8ad2-982bf5108932" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:07:57.622699 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Took 19.26 seconds to build instance.
May 28 03:07:57.719496 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:57.853131 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:07:58.127685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.771s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:58.160749 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2aec3a6-8a79-4988-a8ad-d662e6464ff7 req-0b984e91-a139-4a99-9024-2de19e9c6e29 service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:07:58.160894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2aec3a6-8a79-4988-a8ad-d662e6464ff7 req-0b984e91-a139-4a99-9024-2de19e9c6e29 service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:07:58.160982 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2aec3a6-8a79-4988-a8ad-d662e6464ff7 req-0b984e91-a139-4a99-9024-2de19e9c6e29 service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:07:58.161073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2aec3a6-8a79-4988-a8ad-d662e6464ff7 req-0b984e91-a139-4a99-9024-2de19e9c6e29 service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:07:58.161247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2aec3a6-8a79-4988-a8ad-d662e6464ff7 req-0b984e91-a139-4a99-9024-2de19e9c6e29 service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] No waiting events found dispatching network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:07:58.161410 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f2aec3a6-8a79-4988-a8ad-d662e6464ff7 req-0b984e91-a139-4a99-9024-2de19e9c6e29 service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received unexpected event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 for instance with vm_state active and task_state None.
May 28 03:07:58.568093 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:07:58.572608 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:58.583781 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:58.583781 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:07:58.588932 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:07:58.588932 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.601796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.607488 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.617154 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.617154 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.617154 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.617154 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.617154 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.617154 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:58.617506 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.617506 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.617506 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.617506 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.617506 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.617506 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:58.627763 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.627763 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.627763 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.627763 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.627763 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.627763 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:58.628044 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.628044 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.628044 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.628044 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.628044 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.628044 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:58.652536 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.40.100,3260]
May 28 03:07:58.652536 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.40.100,3260] successful.
May 28 03:07:58.652536 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.665713 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.678937 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.50.100,3260]
May 28 03:07:58.678937 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.50.100,3260] successful.
May 28 03:07:58.678937 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.684636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.684636 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.684636 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.684636 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.684636 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.684636 np0000001589 nova-compute[98297]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.684636 np0000001589 nova-compute[98297]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.684636 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:58.684875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.684875 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.684875 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.684875 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.684875 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.684875 np0000001589 nova-compute[98297]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.684875 np0000001589 nova-compute[98297]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.684875 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:58.685120 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:58.685374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:58.686273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('10', '-', '-', 0) found on session 92 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:58.686397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:58.694292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:07:58.704254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:58.704254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967ca43b-5191-465c-bbae-fee774a97938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:07:58.716551 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.716551 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.716551 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.716551 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.716551 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.716551 np0000001589 nova-compute[98297]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.716551 np0000001589 nova-compute[98297]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.716551 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:07:58.716877 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [87] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-59bf3bab-5dd5-4426-aadb-94cfb16ec732 (non-flash)
May 28 03:07:58.716877 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.716877 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:07:58.716877 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.716877 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:07:58.716877 np0000001589 nova-compute[98297]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.716877 np0000001589 nova-compute[98297]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:07:58.716877 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:07:58.717104 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.178s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:07:58.717181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:07:58.718175 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('11', '-', '-', 0) found on session 93 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:07:58.718284 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:07:58.737331 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 93 and hctl ['11', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:59.736615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 93 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:07:59.737269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '967ca43b-5191-465c-bbae-fee774a97938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:00.408851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:00.557750 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found WWN 3300000006422be74 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:08:00.558014 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:00.558162 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000006422be74', 'path': '/dev/dm-1', 'multipath_id': '3300000006422be74'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:00.558513 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006422be74', 'path': '/dev/dm-1', 'multipath_id': '3300000006422be74'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:08:00.561488 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:00.847346 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:01.061253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:01.061253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:01.067979 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to attach volume 967ca43b-5191-465c-bbae-fee774a97938 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:08:01.070783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:08:01.070783 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:01.070783 np0000001589 nova-compute[98297]:   <alias name="ua-967ca43b-5191-465c-bbae-fee774a97938"/>
May 28 03:08:01.070783 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:08:01.070783 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:01.070783 np0000001589 nova-compute[98297]:   <serial>967ca43b-5191-465c-bbae-fee774a97938</serial>
May 28 03:08:01.070783 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:01.070783 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:08:01.383299 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:01.563540 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:08:02.363352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:02.372067 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:02.372387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:02.376157 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:08:02.376354 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Claim successful on node np0000001589
May 28 03:08:02.749923 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:02.750143 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:02.750338 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:02.750505 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No VIF found with MAC fa:16:3e:b4:4e:d6, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:02.854677 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:03.461729 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Refreshing inventories for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 03:08:03.528567 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Updating ProviderTree inventory for provider 672703c4-2150-4765-9740-44d3bdb44a8c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 03:08:03.528767 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 03:08:03.590900 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Refreshing aggregate associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, aggregates: None {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 03:08:03.634422 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:03.653216 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Refreshing trait associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, traits: COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 03:08:04.022011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:04.022130 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:04.313625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aedcbca3-cdf6-4a20-a211-b5d070ccbd6c tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.569s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:04.526703 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:05.044282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.672s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:05.044661 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:08:05.551892 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:08:05.552466 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:08:05.552748 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:05.553009 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:05.633869 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada2cf15d86b4419ab73c67773ff8785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac8d769a2d4b49807632858d7e6423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:08:06.056674 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:08:06.210306 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Successfully created port: 38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:08:06.385775 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:06.559720 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:08:06.716638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:06.716991 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:06.848515 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Successfully updated port: 38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:08:06.894693 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-changed-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:06.897782 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Refreshing instance network info cache due to event network-changed-38a13c7d-8add-4161-b90c-90fa6721ff37. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:06.898158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] Acquiring lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:06.898288 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] Acquired lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:06.898432 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Refreshing network info cache for port 38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:07.218864 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:08:07.351664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:07.400304 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:07.491109 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:07.571475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:08:07.573453 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:08:07.573664 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Creating image(s)
May 28 03:08:07.574092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:07.574265 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:07.574761 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:07.575261 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:07.583535 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:07.584802 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:07.688460 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:07.690846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.106s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:07.691823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:07.692000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:07.692415 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:07.695067 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:07.695396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:07.806355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.109s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:07.806355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:07.828610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:07.830983 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:07.838982 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:08:07.839289 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Claim successful on node np0000001589
May 28 03:08:07.865645 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:07.881308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk 1073741824" returned: 0 in 0.075s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:07.881559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:07.881959 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:08.000013 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.118s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:08.000449 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:08:08.000700 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:08.100175 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:08.100653 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Cannot resize image /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:08:08.101197 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:08:08.101418 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Ensure instance console log exists: /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:08:08.101681 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:08.102011 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:08.102142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:08.191781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8f66aeb5-11df-4507-a223-953ae65c2e8e req-17f00858-8851-4c27-9af6-6a69d69ef5ee service nova] Releasing lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:08.192262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:08.193252 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:08:08.676387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:08.676771 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:08.678708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9483d797-c519-40ad-9933-da73aad786dd req-65fc4cea-d29a-4e25-8802-e9237cdfefc0 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:08.679151 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9483d797-c519-40ad-9933-da73aad786dd req-65fc4cea-d29a-4e25-8802-e9237cdfefc0 service nova] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:08.679414 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9483d797-c519-40ad-9933-da73aad786dd req-65fc4cea-d29a-4e25-8802-e9237cdfefc0 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:08.679844 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9483d797-c519-40ad-9933-da73aad786dd req-65fc4cea-d29a-4e25-8802-e9237cdfefc0 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:08.681259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9483d797-c519-40ad-9933-da73aad786dd req-65fc4cea-d29a-4e25-8802-e9237cdfefc0 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] No waiting events found dispatching network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:08.681259 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-9483d797-c519-40ad-9933-da73aad786dd req-65fc4cea-d29a-4e25-8802-e9237cdfefc0 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received unexpected event network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 for instance with vm_state building and task_state spawning.
May 28 03:08:08.751402 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:08.912956 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:08.913174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:08.948895 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:09.121466 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updating instance_info_cache with network_info: [{"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:09.180662 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Detaching volume 967ca43b-5191-465c-bbae-fee774a97938
May 28 03:08:09.222297 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to driver detach volume 967ca43b-5191-465c-bbae-fee774a97938 from mountpoint /dev/vdb
May 28 03:08:09.228525 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-967ca43b-5191-465c-bbae-fee774a97938 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:08:09.229766 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-967ca43b-5191-465c-bbae-fee774a97938 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:08:09.229902 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Attempting to detach device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:08:09.230189 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:08:09.230189 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:09.230189 np0000001589 nova-compute[98297]:   <alias name="ua-967ca43b-5191-465c-bbae-fee774a97938"/>
May 28 03:08:09.230189 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:08:09.230189 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:09.230189 np0000001589 nova-compute[98297]:   <serial>967ca43b-5191-465c-bbae-fee774a97938</serial>
May 28 03:08:09.230189 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:08:09.230189 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:09.230189 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:08:09.238101 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config.
May 28 03:08:09.238216 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] (1/8): Attempting to detach device vdb with device alias ua-967ca43b-5191-465c-bbae-fee774a97938 from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:08:09.238501 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:08:09.238501 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:09.238501 np0000001589 nova-compute[98297]:   <alias name="ua-967ca43b-5191-465c-bbae-fee774a97938"/>
May 28 03:08:09.238501 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:08:09.238501 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:09.238501 np0000001589 nova-compute[98297]:   <serial>967ca43b-5191-465c-bbae-fee774a97938</serial>
May 28 03:08:09.238501 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:08:09.238501 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:09.238501 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:08:09.389851 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:09.390159 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:09.418377 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:08:09.536640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:09.536807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:09.537009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:09.537136 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:09.537211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:09.540777 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Terminating instance
May 28 03:08:09.624575 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:09.624866 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Instance network_info: |[{"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:08:09.626866 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Start _get_guest_xml network_info=[{"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:08:09.629388 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:08:09.630719 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b3c95ae0-6741-420b-baa9-d96e1a8ac6d6'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937689.6303675) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:08:09.632124 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:08:09.632536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:08:09.633717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:08:09.633898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:08:09.634880 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:08:09.635262 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:08:09.635444 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:08:09.635562 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:08:09.635715 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:08:09.635829 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:08:09.635942 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:08:09.636119 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:08:09.636276 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:08:09.636409 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:08:09.636542 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:08:09.636691 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:08:09.651263 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=36,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-hvoopm8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3c95ae0-6741-420b-baa9-d96e1a8ac6d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:08:09.651496 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:09.652078 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:33,bridge_name='br-int',has_traffic_filtering=True,id=38a13c7d-8add-4161-b90c-90fa6721ff37,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a13c7d-8a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:09.652711 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'pci_devices' on Instance uuid b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:09.800148 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937689.7996535, 7aaca677-0143-4ffd-8206-e47614601132 => ua-967ca43b-5191-465c-bbae-fee774a97938> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:08:09.803052 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-967ca43b-5191-465c-bbae-fee774a97938 for instance 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:08:09.805749 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config.
May 28 03:08:09.806849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:08:09.808502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967ca43b-5191-465c-bbae-fee774a97938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:09.808502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:09.808502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:09.808502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967ca43b-5191-465c-bbae-fee774a97938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:08:09.808502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938 (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:09.846309 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '94')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', '92')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938', '93')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b405304a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Removing multipathed devices sde, sdf {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:08:09.846309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Flush multipath device 3300000006422be74 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:08:09.882218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:09.894022 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:09.932873 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:09.978395 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:09.987592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:08:09.987592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:08:09.987592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:08:10.001010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:08:10.001010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:08:10.014201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:10.047595 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:08:10.048373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.40.100,3260]
May 28 03:08:10.048373 np0000001589 nova-compute[98297]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.40.100,3260] successful.
May 28 03:08:10.048373 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:10.073418 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:10.080136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.097471 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:10.106200 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.107984 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.131433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.50.100,3260]
May 28 03:08:10.131433 np0000001589 nova-compute[98297]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-967ca43b-5191-465c-bbae-fee774a97938, portal: 192.168.50.100,3260] successful.
May 28 03:08:10.131433 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:10.143306 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.143995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.149595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:10.149901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:10.150076 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== disconnect_volume: return (342ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:10.150259 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:08:10.158208 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] End _get_guest_xml xml=<domain type="qemu">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <uuid>b3c95ae0-6741-420b-baa9-d96e1a8ac6d6</uuid>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <name>instance-00000024</name>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:name>multiattach-server-0</nova:name>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:08:09</nova:creationTime>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         <nova:port uuid="38a13c7d-8add-4161-b90c-90fa6721ff37">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <system>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <entry name="serial">b3c95ae0-6741-420b-baa9-d96e1a8ac6d6</entry>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <entry name="uuid">b3c95ae0-6741-420b-baa9-d96e1a8ac6d6</entry>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </system>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <os>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   </os>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <features>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   </features>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   <devices>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk.config"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:39:93:33"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <target dev="tap38a13c7d-8a"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </interface>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/console.log" append="off"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </serial>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <video>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </video>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </rng>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:   </devices>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]: </domain>
May 28 03:08:10.158208 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:08:10.161216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Preparing to wait for external event network-vif-plugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:08:10.161216 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:10.161216 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:10.161918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:10.162944 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=36,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-hvoopm8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3c95ae0-6741-420b-baa9-d96e1a8ac6d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:08:10.162944 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:10.163557 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:33,bridge_name='br-int',has_traffic_filtering=True,id=38a13c7d-8add-4161-b90c-90fa6721ff37,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a13c7d-8a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:10.164113 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:33,bridge_name='br-int',has_traffic_filtering=True,id=38a13c7d-8add-4161-b90c-90fa6721ff37,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a13c7d-8a') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:08:10.164252 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.164521 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:10.164761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:08:10.166295 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.167687 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b823025-df24-5c62-8711-49e613e9bba5', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:10.167687 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.168444 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:10.173184 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.175610 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.175757 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38a13c7d-8a, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:10.176186 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38a13c7d-8a, col_values=(('qos', UUID('ed6cbfac-78fa-42a9-beb4-a15ae6e6012c')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:10.176440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38a13c7d-8a, col_values=(('external_ids', {'iface-id': '38a13c7d-8add-4161-b90c-90fa6721ff37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:93:33', 'vm-uuid': 'b3c95ae0-6741-420b-baa9-d96e1a8ac6d6'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:10.177477 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.179809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:10.193584 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.194584 np0000001589 nova-compute[98297]: INFO os_vif [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:93:33,bridge_name='br-int',has_traffic_filtering=True,id=38a13c7d-8add-4161-b90c-90fa6721ff37,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a13c7d-8a')
May 28 03:08:10.384355 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999667279999812 future=<Future at 0x7e4b404d3080 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:10.384605 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999332675999995 future=<Future at 0x7e4b404d3080 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:10.384755 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99920737299999 future=<Future at 0x7e4b404d3080 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:10.385891 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Instance destroyed successfully.
May 28 03:08:10.386685 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lazy-loading 'resources' on Instance uuid 94a458ec-8795-4832-93b3-cfda54f6444a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:10.400756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.572s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:10.401164 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:08:10.403619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.426s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:10.406653 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:08:10.406809 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Claim successful on node np0000001589
May 28 03:08:10.712211 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:10.729869 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:10.730104 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:10.730342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:10.730547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:10.730751 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] No waiting events found dispatching network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:10.730871 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:08:10.731378 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:10.732023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] Acquiring lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:10.732285 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:10.732409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] Lock "94a458ec-8795-4832-93b3-cfda54f6444a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:10.732537 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] No waiting events found dispatching network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:10.732645 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a170f415-aa97-4c6c-92a0-c059e1745c02 req-fc66515d-cfc3-4546-ba8d-1a37ceda46f6 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-unplugged-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:08:10.893082 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1400263001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumeshelvetestjson-server-1400263001',id=28,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVVpdtpOMxw/GKIxCBvmnegmXanZB2Fx0ZByBEF5idz8qrnymJWQfBuAXPG0Bpxss5nXmXH32bO2I4hzMRCO1JRvOBtV1lIDSVolJiyfWpU902TGoqcIuDGx+v6E6uKQA==',key_name='tempest-keypair-1934369707',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:31Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c470ae60a73f43d183ba78fe4ed0d29b',ramdisk_id='',reservation_id='r-fw9ni99w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-653410335',owner_user_name='tempest-AttachVolumeShelveTestJSON-653410335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:07:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84aa869713da4347914ce6054de5ea1e',uuid=94a458ec-8795-4832-93b3-cfda54f6444a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:08:10.893709 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converting VIF {"id": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "address": "fa:16:3e:eb:12:d7", "network": {"id": "064c61b2-9164-4f25-a32f-4ef22602ae3e", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-112595514-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c470ae60a73f43d183ba78fe4ed0d29b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb7f8de4-e3", "ovs_interfaceid": "bb7f8de4-e376-4c53-ac5b-b210ba6a74e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:10.894120 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:10.895608 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:08:10.897147 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.897417 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb7f8de4-e3, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:10.898844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.899608 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:10.906770 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.907761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.907961 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83f72cf7-91f4-4524-ae36-b5dc9d8c2049) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:10.909094 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:10.917863 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:08:10.918486 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:08:10.919336 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:10.920204 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:10.922618 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:10.925334 np0000001589 nova-compute[98297]: INFO os_vif [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:12:d7,bridge_name='br-int',has_traffic_filtering=True,id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2,network=Network(064c61b2-9164-4f25-a32f-4ef22602ae3e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb7f8de4-e3')
May 28 03:08:10.928021 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Deleting instance files /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a_del
May 28 03:08:10.940456 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Deletion of /opt/stack/data/nova/instances/94a458ec-8795-4832-93b3-cfda54f6444a_del complete
May 28 03:08:11.064872 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c0271f7e2e254067b3e5cadb9d232f04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '528e86ab455d438bbf2f6d21a401e580', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:08:11.418077 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:08:11.446100 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 03:08:11.446683 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:08:11.447378 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:08:11.447378 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:08:11.447378 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:11.724809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-81ec5fae-2d50-4aa1-9016-7632728cc694 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.048s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:11.731111 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:11.731303 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:11.731536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:39:93:33, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:11.731859 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Using config drive
May 28 03:08:11.771274 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:11.815589 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Successfully created port: 32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:08:11.924955 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:08:12.048500 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:12.048736 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:12.242428 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:12.418555 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Creating config drive at /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk.config
May 28 03:08:12.424382 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl110er85 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:12.491596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl110er85" returned: 0 in 0.067s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:12.544191 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Successfully updated port: 32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:08:12.552351 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:12.614054 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-changed-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:12.615115 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Refreshing instance network info cache due to event network-changed-32fc28df-a6de-4eb8-8b65-2705be0d9eb3. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:12.615371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] Acquiring lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:12.615469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] Acquired lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:12.615589 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Refreshing network info cache for port 32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:12.809365 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4a38a2e1-d684-432e-af01-f28b7dd9e4db req-c763fda3-4a61-43d5-b402-87b617e07751 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Received event network-vif-deleted-bb7f8de4-e376-4c53-ac5b-b210ba6a74e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:12.809897 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-4a38a2e1-d684-432e-af01-f28b7dd9e4db req-c763fda3-4a61-43d5-b402-87b617e07751 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Neutron deleted interface bb7f8de4-e376-4c53-ac5b-b210ba6a74e2; detaching it from the instance and deleting it from the info cache
May 28 03:08:12.816057 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4a38a2e1-d684-432e-af01-f28b7dd9e4db req-c763fda3-4a61-43d5-b402-87b617e07751 service nova] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Detach interface failed, port_id=bb7f8de4-e376-4c53-ac5b-b210ba6a74e2, reason: Instance 94a458ec-8795-4832-93b3-cfda54f6444a could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:08:12.828301 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:12.866635 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:12.951984 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:08:12.953435 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:08:12.953817 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Creating image(s)
May 28 03:08:12.954318 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "/opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:12.954550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "/opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:12.954972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "/opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:12.955569 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:12.958618 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:12.960323 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:13.034772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:13.048275 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:13.062991 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.659s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:13.063473 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:08:13.068549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:13.076367 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.115s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:13.076542 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:13.076904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:13.077647 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:13.081349 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:13.081678 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:13.118996 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:13.151515 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:13.198067 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.116s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:13.200108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:13.258321 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:13.262907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:13.264805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk 1073741824" returned: 0 in 0.065s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:13.265327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:13.266667 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:13.332823 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Took 1.89 seconds to deallocate network for instance.
May 28 03:08:13.374092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:13.374092 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Checking if we can resize image /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:08:13.374355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:13.418980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:13.419401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:13.517524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:13.518050 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Cannot resize image /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:08:13.518477 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:08:13.518727 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Ensure instance console log exists: /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:08:13.518994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:13.519305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:13.519383 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:13.550583 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:13.579681 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:08:13.580187 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:08:13.580628 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:13.583329 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:13.688380 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1be2b4e542c34494a4052b18a1cea270', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b61f52dbd3ed46f4814f2c0b132c713d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:08:13.843404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:13.843677 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:13.932314 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:14.047978 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937694.0475512, b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:14.048544 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] VM Started (Lifecycle Event)
May 28 03:08:14.053723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-17c8a5cc-56f2-489d-8009-01b38c9d86ee req-5a53c5d7-2110-4294-aa61-0a1c772e36b0 service nova] Releasing lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:14.054471 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquired lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:14.054676 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:08:14.085394 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:08:14.250180 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Successfully created port: dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:08:14.335169 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:14.335516 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:14.551730 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:14.554392 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937694.5540862, b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:14.554532 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] VM Paused (Lifecycle Event)
May 28 03:08:14.592767 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:08:14.641995 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:14.839097 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:14.858481 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:14.864592 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Successfully updated port: dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:08:14.896012 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-plugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:14.897306 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:14.897306 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:14.897479 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:14.897600 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Processing event network-vif-plugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:08:14.897734 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-plugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:14.901602 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:08:14.902536 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:14.902781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:14.902901 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:14.903034 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] No waiting events found dispatching network-vif-plugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:14.903142 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-edb311be-836a-4328-b680-c2e6b6782f06 req-5bde07aa-8837-49d8-a758-4033e754ca34 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received unexpected event network-vif-plugged-38a13c7d-8add-4161-b90c-90fa6721ff37 for instance with vm_state building and task_state spawning.
May 28 03:08:14.905304 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:08:14.907382 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Instance spawned successfully.
May 28 03:08:14.907801 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:08:14.931341 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:14.931486 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing instance network info cache due to event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:14.931633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:14.931722 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:14.931825 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:14.937133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:15.032771 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Updating instance_info_cache with network_info: [{"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:15.059456 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:15.066259 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937695.0616279, b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:15.066259 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] VM Resumed (Lifecycle Event)
May 28 03:08:15.098575 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Booting with volume 95f8b2ce-63a6-4f18-92fd-0866d9c3a24a at /dev/vda
May 28 03:08:15.156090 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:15.170799 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:08:15.196780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:15.254937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:08:15.256081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:08:15.268667 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:08:15.270095 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe0c:c122', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fe94:9f33', 'fe80::c062:69ff:feb9:518c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333'] 
May 28 03:08:15.270095 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:08:15.270350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:08:15.270688 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:15.271303 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating existing volume attachment record: cb51204a-59dc-4b1c-b1b2-365f3e5b8594 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:08:15.349926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.506s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:15.366084 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:15.418630 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:15.418761 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:15.419635 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:15.420095 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:15.420639 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:15.420874 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:15.426096 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Deleted allocations for instance 94a458ec-8795-4832-93b3-cfda54f6444a
May 28 03:08:15.436591 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:15.511501 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:15.535400 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Releasing lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:15.535708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Instance network_info: |[{"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:08:15.537510 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Start _get_guest_xml network_info=[{"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:08:15.541432 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:08:15.542549 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-417171573', uuid='021bf930-a793-4075-893e-af588958bc9b'), owner=OwnerMeta(userid='c0271f7e2e254067b3e5cadb9d232f04', username='tempest-VolumesExtendAttachedTest-470485844-project-member', projectid='528e86ab455d438bbf2f6d21a401e580', projectname='tempest-VolumesExtendAttachedTest-470485844'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937695.5422208) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:08:15.543513 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:08:15.543909 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:08:15.544651 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:08:15.544859 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:08:15.545728 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:08:15.546112 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:08:15.546353 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:08:15.546522 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:08:15.546698 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:08:15.546844 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:08:15.547020 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:08:15.547263 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:08:15.547431 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:08:15.547597 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:08:15.547774 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:08:15.547959 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:08:15.708154 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:15.724638 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:15.728138 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-417171573',display_name='tempest-VolumesExtendAttachedTest-instance-417171573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesextendattachedtest-instance-417171573',id=37,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiJWzRjEfRgVOJ6JCWJrSQtlc6ndL3HHn97FR6UQDSy9SHOHh0q4An2q/1yB5ojOSkk2sFefjv0HrZ9uPHUgID9jdJHfolS0Chfy5kcNrlR44hXgWnYU4Hu5YeMYTy5pA==',key_name='tempest-keypair-46214365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='528e86ab455d438bbf2f6d21a401e580',ramdisk_id='',reservation_id='r-qoy1nzng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-470485844',owner_user_name='tempest-VolumesExtendAttachedTest-470485844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0271f7e2e254067b3e5cadb9d232f04',uuid=021bf930-a793-4075-893e-af588958bc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:08:15.728367 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Converting VIF {"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:15.728757 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:3f,bridge_name='br-int',has_traffic_filtering=True,id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3,network=Network(82136fb9-c9e0-4dcb-80c0-e0a912f926d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32fc28df-a6') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:15.729164 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lazy-loading 'pci_devices' on Instance uuid 021bf930-a793-4075-893e-af588958bc9b {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:15.787438 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:15.915559 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:15.929261 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Took 8.36 seconds to spawn the instance on the hypervisor.
May 28 03:08:15.929261 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:15.978379 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:15.978379 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:15.978379 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attaching volume 06add449-295c-4024-9b03-4f70538663ba to /dev/vdb
May 28 03:08:16.023083 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:16.034624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:08:16.052653 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:16.094518 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:08:16.094934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:08:16.103939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:08:16.105709 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe0c:c122', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fe94:9f33', 'fe80::c062:69ff:feb9:518c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333'] 
May 28 03:08:16.105953 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:08:16.106156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:08:16.106553 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:16.110549 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating existing volume attachment record: f392681c-9e60-4e33-9732-59b50bfc1921 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:08:16.228050 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:16.232859 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] End _get_guest_xml xml=<domain type="qemu">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <uuid>021bf930-a793-4075-893e-af588958bc9b</uuid>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <name>instance-00000025</name>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-417171573</nova:name>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:08:15</nova:creationTime>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:user uuid="c0271f7e2e254067b3e5cadb9d232f04">tempest-VolumesExtendAttachedTest-470485844-project-member</nova:user>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:project uuid="528e86ab455d438bbf2f6d21a401e580">tempest-VolumesExtendAttachedTest-470485844</nova:project>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         <nova:port uuid="32fc28df-a6de-4eb8-8b65-2705be0d9eb3">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <system>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <entry name="serial">021bf930-a793-4075-893e-af588958bc9b</entry>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <entry name="uuid">021bf930-a793-4075-893e-af588958bc9b</entry>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </system>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <os>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   </os>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <features>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   </features>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   <devices>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk.config"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:cc:56:3f"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <target dev="tap32fc28df-a6"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </interface>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/console.log" append="off"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </serial>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <video>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </video>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </rng>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:   </devices>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]: </domain>
May 28 03:08:16.232859 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:08:16.234795 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Preparing to wait for external event network-vif-plugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:08:16.234795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:16.234795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:16.234795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:16.234992 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-417171573',display_name='tempest-VolumesExtendAttachedTest-instance-417171573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesextendattachedtest-instance-417171573',id=37,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiJWzRjEfRgVOJ6JCWJrSQtlc6ndL3HHn97FR6UQDSy9SHOHh0q4An2q/1yB5ojOSkk2sFefjv0HrZ9uPHUgID9jdJHfolS0Chfy5kcNrlR44hXgWnYU4Hu5YeMYTy5pA==',key_name='tempest-keypair-46214365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='528e86ab455d438bbf2f6d21a401e580',ramdisk_id='',reservation_id='r-qoy1nzng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-470485844',owner_user_name='tempest-VolumesExtendAttachedTest-470485844-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0271f7e2e254067b3e5cadb9d232f04',uuid=021bf930-a793-4075-893e-af588958bc9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:08:16.235207 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Converting VIF {"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:16.236069 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:3f,bridge_name='br-int',has_traffic_filtering=True,id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3,network=Network(82136fb9-c9e0-4dcb-80c0-e0a912f926d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32fc28df-a6') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:16.236414 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:3f,bridge_name='br-int',has_traffic_filtering=True,id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3,network=Network(82136fb9-c9e0-4dcb-80c0-e0a912f926d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32fc28df-a6') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:08:16.237011 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:16.237521 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:16.237933 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:08:16.239304 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:16.239537 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59babd48-a521-535c-8b01-bba91fcd652f', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:16.240481 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:16.241390 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:16.241740 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:16.245836 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:16.245977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32fc28df-a6, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:16.246483 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32fc28df-a6, col_values=(('qos', UUID('49312030-5d5b-41bb-bdb0-0e4b08e4cbdc')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:16.246653 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32fc28df-a6, col_values=(('external_ids', {'iface-id': '32fc28df-a6de-4eb8-8b65-2705be0d9eb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:56:3f', 'vm-uuid': '021bf930-a793-4075-893e-af588958bc9b'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:16.247549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:16.249009 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:16.252933 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:16.254136 np0000001589 nova-compute[98297]: INFO os_vif [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:56:3f,bridge_name='br-int',has_traffic_filtering=True,id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3,network=Network(82136fb9-c9e0-4dcb-80c0-e0a912f926d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32fc28df-a6')
May 28 03:08:16.289326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fc7ed58b-c661-49e4-9fec-47f1d7f47eab req-377d3203-13a2-4630-b50d-8d8839174461 service nova] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:16.289842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:16.290101 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:08:16.438081 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Took 14.37 seconds to build instance.
May 28 03:08:16.441814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec35a0b5-f670-43da-84ec-e7a65ab08fd4 tempest-AttachVolumeShelveTestJSON-653410335 tempest-AttachVolumeShelveTestJSON-653410335-project-member] Lock "94a458ec-8795-4832-93b3-cfda54f6444a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.905s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:16.667886 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:08:16.668434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06add449-295c-4024-9b03-4f70538663ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:16.668616 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:16.669133 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:16.669587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06add449-295c-4024-9b03-4f70538663ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:08:16.691622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:16.692090 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:16.692812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:16.693366 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:16.693632 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:16.694006 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:16.718458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:16.718458 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:16.725194 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:16.725194 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba] added
May 28 03:08:16.734369 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:16.734369 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0406(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:16.734369 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:16.737770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba] added
May 28 03:08:16.737770 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:16.737770 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:16.737770 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:16.737770 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:16.737770 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:16.737770 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:16.737948 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:16.738048 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0442(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:16.738149 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:16.876336 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:16.941896 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e7e749f-172d-4a5d-b250-da493a449c3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.881s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:17.094731 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:17.269032 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:17.325997 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-changed-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:17.326144 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Refreshing instance network info cache due to event network-changed-38a13c7d-8add-4161-b90c-90fa6721ff37. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:17.326374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] Acquiring lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:17.326819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] Acquired lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:17.326961 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Refreshing network info cache for port 38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:17.396505 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:08:17.397752 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:08:17.398050 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Creating image(s)
May 28 03:08:17.398535 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:08:17.398842 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Ensure instance console log exists: /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:08:17.399158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:17.399564 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:17.399773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:17.734856 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:17.741556 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:17.751763 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:17.751763 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:17.760620 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:17.760620 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.773546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.778550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.779062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:17.779412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance network_info: |[{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:08:17.783514 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Start _get_guest_xml network_info=[{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'cb51204a-59dc-4b1c-b1b2-365f3e5b8594', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c792127f-b33e-48b3-8da7-ba4bd8ebeac0', 'attached_at': '', 'detached_at': '', 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'serial': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:08:17.785093 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:17.785278 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:17.785469 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No VIF found with MAC fa:16:3e:cc:56:3f, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:17.785976 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Using config drive
May 28 03:08:17.789382 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:08:17.791676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.791676 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.791676 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.791676 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.791676 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.791676 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:17.791949 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1722686750', uuid='c792127f-b33e-48b3-8da7-ba4bd8ebeac0'), owner=OwnerMeta(userid='1be2b4e542c34494a4052b18a1cea270', username='tempest-TestShelveInstance-1399725326-project-member', projectid='b61f52dbd3ed46f4814f2c0b132c713d', projectname='tempest-TestShelveInstance-1399725326'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937697.791353) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:08:17.792236 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.792236 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.792236 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.792236 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.792236 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.792236 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:17.793843 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:08:17.794145 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:08:17.796522 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:08:17.797484 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:08:17.799668 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:08:17.800105 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:08:17.800816 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:08:17.801209 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:08:17.801435 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:08:17.803281 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:08:17.804907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.804907 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.804907 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.804907 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.804907 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.804907 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:17.805441 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:08:17.806814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.806814 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.806814 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.806814 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.806814 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.806814 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:17.807036 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:08:17.807209 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:08:17.807402 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:08:17.807552 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:08:17.807726 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:08:17.823168 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:08:17.823433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:17.823555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:17.828824 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:17.841169 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.40.100,3260]
May 28 03:08:17.841169 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.40.100,3260] successful.
May 28 03:08:17.841169 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.854315 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.860884 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.50.100,3260]
May 28 03:08:17.860884 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.50.100,3260] successful.
May 28 03:08:17.860884 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.869569 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:17.871885 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.871885 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.871885 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.871885 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.871885 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.871885 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.871885 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.871885 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:17.872096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.872096 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.872096 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.872096 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.872096 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.872096 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.872096 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.872096 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:17.872373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:17.872509 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:17.873461 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('10', '-', '-', 0) found on session 95 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:17.873583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:17.874573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:17.897318 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 95 and hctl ['10', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:17.901865 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('11', '-', '-', 0) found on session 96 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:17.901865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:17.915958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 96 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:17.915958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '06add449-295c-4024-9b03-4f70538663ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:18.203679 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:18.296172 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:18.360555 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updated VIF entry in instance network info cache for port 38a13c7d-8add-4161-b90c-90fa6721ff37. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:08:18.360555 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updating instance_info_cache with network_info: [{"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:18.451213 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Creating config drive at /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk.config
May 28 03:08:18.455801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxpoj9cic {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:18.523052 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxpoj9cic" returned: 0 in 0.067s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:18.676737 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:18.677295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:18.862679 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-43b19cff-6e3b-4354-8e01-c959bcdb877d req-5d534996-a869-4ab3-b039-aa4392fa61c9 service nova] Releasing lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:18.897763 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 95 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:18.898074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06add449-295c-4024-9b03-4f70538663ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:18.967240 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.011524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.105310 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.180129 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:08:19.204520 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9bf96ea8-be08-4b98-a16b-2f4dc94df2e3 req-dd3946f6-2fdb-415f-8f77-0a468c89ed93 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-vif-plugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:19.206333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9bf96ea8-be08-4b98-a16b-2f4dc94df2e3 req-dd3946f6-2fdb-415f-8f77-0a468c89ed93 service nova] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:19.206333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9bf96ea8-be08-4b98-a16b-2f4dc94df2e3 req-dd3946f6-2fdb-415f-8f77-0a468c89ed93 service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:19.206333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9bf96ea8-be08-4b98-a16b-2f4dc94df2e3 req-dd3946f6-2fdb-415f-8f77-0a468c89ed93 service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:19.206333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9bf96ea8-be08-4b98-a16b-2f4dc94df2e3 req-dd3946f6-2fdb-415f-8f77-0a468c89ed93 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Processing event network-vif-plugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:08:19.401646 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.403314 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.409183 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.412997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.442876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:19.710690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found WWN 3300000002cd3dace for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:08:19.711442 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:19.711671 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000002cd3dace', 'path': '/dev/dm-1', 'multipath_id': '3300000002cd3dace'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:19.711889 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002cd3dace', 'path': '/dev/dm-1', 'multipath_id': '3300000002cd3dace'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:08:19.712576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.889s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:19.712852 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:08:19.716498 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:19.727060 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:19.727491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:19.728138 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:19.729367 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:19.730786 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:19.730786 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:19.742614 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:19.742614 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:19.751315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:19.751596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:19.753625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:19.753625 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:19.755719 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:08:19.755895 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Claim successful on node np0000001589
May 28 03:08:19.760265 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a] added
May 28 03:08:19.760265 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:19.760265 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:19.760265 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:19.760265 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:19.760265 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:19.760265 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:19.760479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:19.763267 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:19.763267 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:19.767938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a] added
May 28 03:08:19.767938 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:19.767938 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:19.767938 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:19.767938 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:19.767938 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:19.767938 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:19.768332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:19.768332 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:19.768498 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:19.926618 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:08:19.927327 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937699.927024, 021bf930-a793-4075-893e-af588958bc9b => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:19.927507 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] VM Started (Lifecycle Event)
May 28 03:08:19.930134 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:08:19.932773 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 021bf930-a793-4075-893e-af588958bc9b] Instance spawned successfully.
May 28 03:08:19.933075 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:08:20.220045 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to attach volume 06add449-295c-4024-9b03-4f70538663ba with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:08:20.224354 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:08:20.224354 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:20.224354 np0000001589 nova-compute[98297]:   <alias name="ua-06add449-295c-4024-9b03-4f70538663ba"/>
May 28 03:08:20.224354 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:08:20.224354 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:20.224354 np0000001589 nova-compute[98297]:   <serial>06add449-295c-4024-9b03-4f70538663ba</serial>
May 28 03:08:20.224354 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:20.224354 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:08:20.431271 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:20.432569 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:20.440554 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:20.440554 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:20.440554 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:20.440693 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:20.441038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:20.441998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:20.761106 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:20.773263 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:20.776670 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:20.776670 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:20.790494 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:20.790494 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.795847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.806692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.814668 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.814668 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.814668 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.814668 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.814668 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.814668 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.814668 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.814668 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:20.814980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.814980 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.814980 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.814980 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.814980 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.814980 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.814980 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.814980 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:20.826548 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.826548 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.826548 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.826548 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.826548 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.826548 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.826548 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.826548 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:20.826761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.826761 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.826761 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.826761 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.826761 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.826761 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.826761 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.826761 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:20.881767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260]
May 28 03:08:20.881767 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260] successful.
May 28 03:08:20.881767 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.892648 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260]
May 28 03:08:20.892648 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260] successful.
May 28 03:08:20.892648 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.897235 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.908173 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.923616 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.923920 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:20.924156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:20.924156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:20.925072 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] HCTL ('14', '-', '-', 0) found on session 97 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:20.925171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.934962 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:20.935379 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:20.936545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.207s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:20.937116 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:20.937578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:20.937973 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937700.9377444, 021bf930-a793-4075-893e-af588958bc9b => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:20.938149 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] VM Paused (Lifecycle Event)
May 28 03:08:20.946605 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] HCTL ('15', '-', '-', 0) found on session 98 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:20.946605 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:20.951390 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Took 8.00 seconds to spawn the instance on the hypervisor.
May 28 03:08:20.952750 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:20.955158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching for a device in session 97 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:20.955386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:20.970413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching for a device in session 98 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:20.970413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:21.250663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:21.293931 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f5ae597c-2dca-458c-ab12-82c1c9bf3260 req-22dad1e4-3a21-4092-8de5-4cb005f5358d service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-vif-plugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:21.294144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f5ae597c-2dca-458c-ab12-82c1c9bf3260 req-22dad1e4-3a21-4092-8de5-4cb005f5358d service nova] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:21.294410 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f5ae597c-2dca-458c-ab12-82c1c9bf3260 req-22dad1e4-3a21-4092-8de5-4cb005f5358d service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:21.294584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f5ae597c-2dca-458c-ab12-82c1c9bf3260 req-22dad1e4-3a21-4092-8de5-4cb005f5358d service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:21.297312 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f5ae597c-2dca-458c-ab12-82c1c9bf3260 req-22dad1e4-3a21-4092-8de5-4cb005f5358d service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] No waiting events found dispatching network-vif-plugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:21.297312 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f5ae597c-2dca-458c-ab12-82c1c9bf3260 req-22dad1e4-3a21-4092-8de5-4cb005f5358d service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received unexpected event network-vif-plugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 for instance with vm_state active and task_state None.
May 28 03:08:21.325775 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:21.414406 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:21.414617 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:21.440795 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:21.444291 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937701.4429832, 021bf930-a793-4075-893e-af588958bc9b => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:21.444291 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] VM Resumed (Lifecycle Event)
May 28 03:08:21.464306 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Took 13.74 seconds to build instance.
May 28 03:08:21.730769 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:08:21.917705 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:21.942875 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:21.944767 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:21.945148 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:21.945366 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No VIF found with MAC fa:16:3e:b4:4e:d6, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:21.949340 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:21.955210 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 021bf930-a793-4075-893e-af588958bc9b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:21.967412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.250s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:22.007954 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:22.008446 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:22.426535 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.675s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:22.429251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:08:22.511944 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid e8ff2f55-78d4-4022-8d61-8b5aab3f0576 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:22.750073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Found WWN 330000000436e0942 for multipath device dm-7 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:08:22.750446 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:22.750666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] <== connect_volume: return (4926ms) {'type': 'block', 'scsi_wwn': '330000000436e0942', 'path': '/dev/dm-7', 'multipath_id': '330000000436e0942'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:22.750832 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000436e0942', 'path': '/dev/dm-7', 'multipath_id': '330000000436e0942'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:08:22.872457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:22.935414 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:08:22.935604 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:08:22.935892 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:22.936100 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:23.049294 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada2cf15d86b4419ab73c67773ff8785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac8d769a2d4b49807632858d7e6423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:08:23.257847 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1722686750',display_name='tempest-TestShelveInstance-server-1722686750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testshelveinstance-server-1722686750',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRA+otnkfm7lbFsCKUzuGvqR+nbstrjEvckiUyG3QiLHC4l387rAxGfMMadCii8UDww36pB8lIkDSWkmlCz6/E47NEFRnn5NaQ3xMdlL4vFWn8T/60SSfxtyUXxMofy7A==',key_name='tempest-TestShelveInstance-1678016135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61f52dbd3ed46f4814f2c0b132c713d',ramdisk_id='',reservation_id='r-t5rvslrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1399725326',owner_user_name='tempest-TestShelveInstance-1399725326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:15Z,user_data=None,user_id='1be2b4e542c34494a4052b18a1cea270',uuid=c792127f-b33e-48b3-8da7-ba4bd8ebeac0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:08:23.257847 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converting VIF {"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:23.258578 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:23.259436 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'pci_devices' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:23.380973 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-changed-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:23.381415 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Refreshing instance network info cache due to event network-changed-32fc28df-a6de-4eb8-8b65-2705be0d9eb3. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:23.381601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] Acquiring lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:23.381799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] Acquired lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:23.381891 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Refreshing network info cache for port 32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:23.440312 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:08:23.527638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:23.540014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e234b0e5-c80c-43fd-8f97-f44575dd96be tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.564s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:23.648064 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Successfully created port: 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:08:23.762807 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] End _get_guest_xml xml=<domain type="qemu">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <uuid>c792127f-b33e-48b3-8da7-ba4bd8ebeac0</uuid>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <name>instance-00000026</name>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestShelveInstance-server-1722686750</nova:name>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:08:17</nova:creationTime>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:user uuid="1be2b4e542c34494a4052b18a1cea270">tempest-TestShelveInstance-1399725326-project-member</nova:user>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:project uuid="b61f52dbd3ed46f4814f2c0b132c713d">tempest-TestShelveInstance-1399725326</nova:project>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         <nova:port uuid="dc68665e-2eb3-4e6f-b031-e32d71c7fee2">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <system>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <entry name="serial">c792127f-b33e-48b3-8da7-ba4bd8ebeac0</entry>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <entry name="uuid">c792127f-b33e-48b3-8da7-ba4bd8ebeac0</entry>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </system>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <os>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   </os>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <features>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   </features>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   <devices>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <alias name="ua-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-7"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <serial>95f8b2ce-63a6-4f18-92fd-0866d9c3a24a</serial>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ab:c4:80"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <target dev="tapdc68665e-2e"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </interface>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/console.log" append="off"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </serial>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <video>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </video>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </rng>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:   </devices>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]: </domain>
May 28 03:08:23.762807 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:08:23.766964 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Preparing to wait for external event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:08:23.766964 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:23.766964 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:23.766964 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:23.768350 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1722686750',display_name='tempest-TestShelveInstance-server-1722686750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testshelveinstance-server-1722686750',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRA+otnkfm7lbFsCKUzuGvqR+nbstrjEvckiUyG3QiLHC4l387rAxGfMMadCii8UDww36pB8lIkDSWkmlCz6/E47NEFRnn5NaQ3xMdlL4vFWn8T/60SSfxtyUXxMofy7A==',key_name='tempest-TestShelveInstance-1678016135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b61f52dbd3ed46f4814f2c0b132c713d',ramdisk_id='',reservation_id='r-t5rvslrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1399725326',owner_user_name='tempest-TestShelveInstance-1399725326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:15Z,user_data=None,user_id='1be2b4e542c34494a4052b18a1cea270',uuid=c792127f-b33e-48b3-8da7-ba4bd8ebeac0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:08:23.768730 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converting VIF {"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:23.769872 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:23.770337 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:08:23.770915 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:23.771092 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:23.771537 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:08:23.772154 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:23.772499 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499e147e-b590-5ea5-b055-2cf4f0279b9d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:23.776313 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:23.780073 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:23.780532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc68665e-2e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:23.780785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc68665e-2e, col_values=(('qos', UUID('f6d59533-0fc1-4ee9-aa57-4749a4fc8028')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:23.781003 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc68665e-2e, col_values=(('external_ids', {'iface-id': 'dc68665e-2eb3-4e6f-b031-e32d71c7fee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:c4:80', 'vm-uuid': 'c792127f-b33e-48b3-8da7-ba4bd8ebeac0'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:23.786998 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:23.794071 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:23.794559 np0000001589 nova-compute[98297]: INFO os_vif [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e')
May 28 03:08:23.885514 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:23.944019 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:08:24.267167 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Successfully updated port: 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:08:24.350320 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-changed-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:24.351322 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Refreshing instance network info cache due to event network-changed-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:24.351322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] Acquiring lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:24.351322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] Acquired lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:24.351322 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Refreshing network info cache for port 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:24.377658 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:24.521436 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Updated VIF entry in instance network info cache for port 32fc28df-a6de-4eb8-8b65-2705be0d9eb3. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:08:24.521881 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Updating instance_info_cache with network_info: [{"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:24.636332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:24.636332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:24.636332 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Attaching volume f7a867a4-b686-4e53-8845-7c5dc966abc0 to /dev/vdb
May 28 03:08:24.684096 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:24.695433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:08:24.724922 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:24.765679 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:08:24.767306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:08:24.769443 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:24.777995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:08:24.781267 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe0c:c122', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fe94:9f33', 'fe80::c062:69ff:feb9:518c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fecc:563f', 'fe80::24e9:85ff:fe54:e97b'] 
May 28 03:08:24.781267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:08:24.781267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:08:24.781267 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:24.781267 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Updating existing volume attachment record: d95aac8c-10ba-4148-83c7-068d8f67a516 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:08:24.854439 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:24.958511 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:08:24.960437 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:08:24.960967 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Creating image(s)
May 28 03:08:24.961976 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "/opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:24.962435 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:24.963726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:24.966082 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:24.971357 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:24.977452 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:24.979908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:25.025041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-57c3698b-d712-4e31-98f4-f6ff02cdafd2 req-735338cf-9658-4b9e-a278-7b238b2fce86 service nova] Releasing lock "refresh_cache-021bf930-a793-4075-893e-af588958bc9b" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:25.069842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:25.071377 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:25.071900 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:25.072445 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:25.085575 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:25.086921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:25.195858 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.109s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:25.196962 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:25.221245 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:25.241691 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:25.267006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk 1073741824" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:25.268040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:25.268040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:25.326825 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:25.327009 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:25.327302 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] No VIF found with MAC fa:16:3e:ab:c4:80, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:25.328914 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Using config drive
May 28 03:08:25.368073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:25.368311 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:08:25.368778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:25.386900 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.002839542999936384 future=<Future at 0x7e4b404d3080 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:25.387109 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:25.388247 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Emitting event <LifecycleEvent: 1779937690.383839, 94a458ec-8795-4832-93b3-cfda54f6444a => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:25.388604 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] VM Stopped (Lifecycle Event)
May 28 03:08:25.401460 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e8ff2f55-78d4-4022-8d61-8b5aab3f0576', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'serial': 'f7a867a4-b686-4e53-8845-7c5dc966abc0'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:08:25.407427 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:08:25.410116 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:25.410963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:25.411829 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:25.412100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:08:25.433924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:25.433924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:25.433924 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:25.434931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:25.435332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:25.435652 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:25.448566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:25.448566 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:25.456747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:25.456747 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:25.461788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0] added
May 28 03:08:25.461788 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:25.461788 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:25.461788 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:25.461788 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:25.461788 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:25.461788 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:25.462038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:25.462482 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:25.462531 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:25.469639 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:25.470064 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Cannot resize image /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:08:25.470588 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:08:25.470677 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Ensure instance console log exists: /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:08:25.472497 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0] added
May 28 03:08:25.472497 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:25.472497 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:25.472497 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:25.472497 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:25.472497 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:25.472497 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:25.473153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:25.473461 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:25.473951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:25.473951 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.038(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:25.474099 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:25.474305 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:25.724101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-944b5423-91d9-4d0b-8e3e-a3253b71437e req-349d41fe-0999-44d4-af25-df241593e3df service nova] Releasing lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:25.724504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:25.724757 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:08:25.749855 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] While synchronizing instance power states, found 8 instances in the database and 7 instances on the hypervisor.
May 28 03:08:25.750655 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.751151 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid e8ff2f55-78d4-4022-8d61-8b5aab3f0576 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.751723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:25.751874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:25.752745 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid bbe1fdbc-f534-444c-8ad2-982bf5108932 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.753248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:25.755892 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid 138a2f6c-4e95-4349-b9f6-e4557fe7f546 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.756106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:25.756338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:25.756685 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.762403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:25.762574 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.005s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:25.765683 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid 021bf930-a793-4075-893e-af588958bc9b {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.766601 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.769606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:25.769606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:25.771345 np0000001589 nova-compute[98297]: WARNING nova.utils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7e4b646b9260> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 03:08:25.771345 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:08:25.771345 np0000001589 nova-compute[98297]: WARNING nova.utils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] The unknown pool does not have free threads so the task <function ComputeManager._sync_power_states.<locals>._sync at 0x7e4b646b9260> will be queued. If this happens repeatedly then the size of the pool is too small for the load or there are stuck threads filling the pool.
May 28 03:08:25.771840 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:25.773575 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.90 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:08:25.837247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:25.905243 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 94a458ec-8795-4832-93b3-cfda54f6444a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:25.979023 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Creating config drive at /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config
May 28 03:08:25.983681 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmeo4jmf9 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:26.039107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmeo4jmf9" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:26.267053 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.515s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:26.267469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:26.267668 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "021bf930-a793-4075-893e-af588958bc9b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:26.272004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:26.272004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:26.278361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.516s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:26.278619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:26.279573 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:26.338353 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:26.463777 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:26.474869 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:26.488652 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:26.488652 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:26.498988 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:26.498988 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.512476 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.519836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.541303 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.541633 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:26.548757 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.563049 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:26.590739 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:26.614201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.40.100,3260]
May 28 03:08:26.614201 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.40.100,3260] successful.
May 28 03:08:26.614201 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.633943 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.638889 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.50.100,3260]
May 28 03:08:26.638889 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.50.100,3260] successful.
May 28 03:08:26.638889 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.656290 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.656757 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:26.656757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:26.657147 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:26.660073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('7', '-', '-', 0) found on session 99 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:26.660073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:26.688251 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:26.693757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:26.694907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 99 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:26.695392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:26.724429 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.725646 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:26.726168 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:26.726694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.291s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:26.726694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:26.729048 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('16', '-', '-', 0) found on session 100 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:26.729219 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:26.759773 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 100 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:26.760621 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:26.778704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "021bf930-a793-4075-893e-af588958bc9b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:27.049434 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updating instance_info_cache with network_info: [{"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:27.128405 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:27.138983 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:27.170197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:27.223397 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eae7b0a5-cfd9-4036-835a-c34bcf1a328f req-5ec17998-721c-46c3-a9c5-00dc5b78e4c7 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:27.223397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eae7b0a5-cfd9-4036-835a-c34bcf1a328f req-5ec17998-721c-46c3-a9c5-00dc5b78e4c7 service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:27.223397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eae7b0a5-cfd9-4036-835a-c34bcf1a328f req-5ec17998-721c-46c3-a9c5-00dc5b78e4c7 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:27.223397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eae7b0a5-cfd9-4036-835a-c34bcf1a328f req-5ec17998-721c-46c3-a9c5-00dc5b78e4c7 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:27.223397 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eae7b0a5-cfd9-4036-835a-c34bcf1a328f req-5ec17998-721c-46c3-a9c5-00dc5b78e4c7 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Processing event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:08:27.437350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:08:27.545125 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:08:27.545878 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937707.5455067, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:27.546051 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Started (Lifecycle Event)
May 28 03:08:27.547561 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:08:27.552055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:27.552359 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Instance network_info: |[{"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:08:27.552751 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance spawned successfully.
May 28 03:08:27.555432 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Start _get_guest_xml network_info=[{"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:08:27.557244 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:08:27.559656 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:08:27.561456 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='0eb715c5-e8bf-49d1-8610-d46e7afa4bf4'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937707.560845) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:08:27.562831 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:08:27.563365 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:08:27.564798 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:08:27.565385 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:08:27.566686 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:08:27.567187 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:08:27.567783 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:08:27.567841 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:08:27.568027 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:08:27.568201 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:08:27.568895 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:08:27.570082 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:08:27.570331 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:08:27.570777 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:08:27.570777 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:08:27.570862 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:08:27.594601 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=39,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-2vq8owna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=0eb715c5-e8bf-49d1-8610-d46e7afa4bf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:08:27.595732 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:27.596608 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6b2f0a-a4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:27.598140 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'pci_devices' on Instance uuid 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:27.607179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:27.607813 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:27.876637 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.050333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:28.052395 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:28.066458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:28.066614 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:28.066959 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:28.067206 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:28.067506 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:28.067775 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:28.102207 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] End _get_guest_xml xml=<domain type="qemu">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <uuid>0eb715c5-e8bf-49d1-8610-d46e7afa4bf4</uuid>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <name>instance-00000027</name>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:name>multiattach-server-1</nova:name>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:08:27</nova:creationTime>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         <nova:port uuid="6b6b2f0a-a4ea-4541-8c6e-5bc47a888021">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <system>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <entry name="serial">0eb715c5-e8bf-49d1-8610-d46e7afa4bf4</entry>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <entry name="uuid">0eb715c5-e8bf-49d1-8610-d46e7afa4bf4</entry>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </system>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <os>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   </os>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <features>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   </features>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   <devices>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk.config"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:12:88:e0"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <target dev="tap6b6b2f0a-a4"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </interface>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/console.log" append="off"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </serial>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <video>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </video>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </rng>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:   </devices>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]: </domain>
May 28 03:08:28.102207 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Preparing to wait for external event network-vif-plugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=39,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-2vq8owna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=0eb715c5-e8bf-49d1-8610-d46e7afa4bf4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6b2f0a-a4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6b2f0a-a4') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:28.107996 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:08:28.111697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.111697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ec956c5-dcac-5283-b765-68af2a151784', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:28.112536 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Detaching volume 06add449-295c-4024-9b03-4f70538663ba
May 28 03:08:28.114469 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.115349 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:28.119540 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.124115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.125118 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b6b2f0a-a4, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:28.127027 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6b6b2f0a-a4, col_values=(('qos', UUID('8488c997-11a4-4994-8689-c8a2b3db34e7')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:28.127027 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6b6b2f0a-a4, col_values=(('external_ids', {'iface-id': '6b6b2f0a-a4ea-4541-8c6e-5bc47a888021', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:88:e0', 'vm-uuid': '0eb715c5-e8bf-49d1-8610-d46e7afa4bf4'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:28.130521 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.130521 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:28.146908 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.151009 np0000001589 nova-compute[98297]: INFO os_vif [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6b2f0a-a4')
May 28 03:08:28.191903 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to driver detach volume 06add449-295c-4024-9b03-4f70538663ba from mountpoint /dev/vdb
May 28 03:08:28.196141 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-06add449-295c-4024-9b03-4f70538663ba {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:08:28.197539 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-06add449-295c-4024-9b03-4f70538663ba {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:08:28.197765 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Attempting to detach device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:08:28.198063 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:08:28.198063 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:28.198063 np0000001589 nova-compute[98297]:   <alias name="ua-06add449-295c-4024-9b03-4f70538663ba"/>
May 28 03:08:28.198063 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:08:28.198063 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:28.198063 np0000001589 nova-compute[98297]:   <serial>06add449-295c-4024-9b03-4f70538663ba</serial>
May 28 03:08:28.198063 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:08:28.198063 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:28.198063 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:08:28.203639 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config.
May 28 03:08:28.203774 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] (1/8): Attempting to detach device vdb with device alias ua-06add449-295c-4024-9b03-4f70538663ba from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:08:28.203976 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:08:28.203976 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:28.203976 np0000001589 nova-compute[98297]:   <alias name="ua-06add449-295c-4024-9b03-4f70538663ba"/>
May 28 03:08:28.203976 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:08:28.203976 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:28.203976 np0000001589 nova-compute[98297]:   <serial>06add449-295c-4024-9b03-4f70538663ba</serial>
May 28 03:08:28.203976 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:08:28.203976 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:28.203976 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:08:28.459832 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found WWN 330000000fab6ba67 for multipath device dm-10 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:08:28.460470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:28.461454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '330000000fab6ba67', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000fab6ba67'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:28.461656 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fab6ba67', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '330000000fab6ba67'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:08:28.464447 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:08:28.465311 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:08:28.468556 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:08:28.470893 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7e4b406b90d0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': 'e8ff2f55-78d4-4022-8d61-8b5aab3f0576', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'serial': 'f7a867a4-b686-4e53-8845-7c5dc966abc0'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:08:28.471347 np0000001589 nova-compute[98297]: WARNING os_brick.encryptors.cryptsetup [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 28 03:08:28.472356 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98297) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 03:08:28.472558 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.cryptsetup [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] opening encrypted volume /dev/dm-10 {{(pid=98297) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 28 03:08:28.557802 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:28.557802 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937708.5555606, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:28.557802 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Paused (Lifecycle Event)
May 28 03:08:28.579974 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Took 11.18 seconds to spawn the instance on the hypervisor.
May 28 03:08:28.579974 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:28.625663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:28.636924 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid e8ff2f55-78d4-4022-8d61-8b5aab3f0576 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:28.805358 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-06add449-295c-4024-9b03-4f70538663ba for instance 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:08:29.060048 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:29.062097 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937709.0618465, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:29.062391 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Resumed (Lifecycle Event)
May 28 03:08:29.095160 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Took 19.17 seconds to build instance.
May 28 03:08:29.140494 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Attempting to attach volume f7a867a4-b686-4e53-8845-7c5dc966abc0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:08:29.141822 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:08:29.141822 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:29.141822 np0000001589 nova-compute[98297]:   <alias name="ua-f7a867a4-b686-4e53-8845-7c5dc966abc0"/>
May 28 03:08:29.141822 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 28 03:08:29.141822 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:29.141822 np0000001589 nova-compute[98297]:   <serial>f7a867a4-b686-4e53-8845-7c5dc966abc0</serial>
May 28 03:08:29.141822 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:29.141822 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:08:29.302685 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e9ddfd15-8817-4b56-8abb-7790cc83695e req-b72f0423-e4b4-45e8-bac2-f5a6dc3c1897 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:29.303735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ddfd15-8817-4b56-8abb-7790cc83695e req-b72f0423-e4b4-45e8-bac2-f5a6dc3c1897 service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:29.303735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ddfd15-8817-4b56-8abb-7790cc83695e req-b72f0423-e4b4-45e8-bac2-f5a6dc3c1897 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:29.303735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ddfd15-8817-4b56-8abb-7790cc83695e req-b72f0423-e4b4-45e8-bac2-f5a6dc3c1897 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:29.303735 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e9ddfd15-8817-4b56-8abb-7790cc83695e req-b72f0423-e4b4-45e8-bac2-f5a6dc3c1897 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] No waiting events found dispatching network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:29.303735 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e9ddfd15-8817-4b56-8abb-7790cc83695e req-b72f0423-e4b4-45e8-bac2-f5a6dc3c1897 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received unexpected event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 for instance with vm_state active and task_state None.
May 28 03:08:29.565031 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:29.566499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:29.597107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.683s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:29.597178 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.327s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:29.597391 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:29.597517 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:29.678154 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:29.678340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:29.678475 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:12:88:e0, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:29.678960 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Using config drive
May 28 03:08:30.068944 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937710.068531, 7aaca677-0143-4ffd-8206-e47614601132 => ua-06add449-295c-4024-9b03-4f70538663ba> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:08:30.071509 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config.
May 28 03:08:30.072926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:08:30.073212 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06add449-295c-4024-9b03-4f70538663ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:30.073471 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:30.191394 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:30.338483 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Creating config drive at /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk.config
May 28 03:08:30.343605 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfjj955mn {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:30.397766 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfjj955mn" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:30.815689 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:30.816811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:30.816811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:30.816811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:0c:c1:22, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:30.833415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.758s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:30.833415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06add449-295c-4024-9b03-4f70538663ba', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:08:30.833415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:30.869411 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [95] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [96] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:30.869686 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:30.869686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', '95'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', '99')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:08:30.869928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', '95')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:30.870848 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:30.875732 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba', '96')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:30.877913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646cbb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:08:30.877913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Removing multipathed devices sde, sdf {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:08:30.877913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Flush multipath device 3300000002cd3dace {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:08:30.904582 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:30.909087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:30.917077 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:30.954387 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:31.003271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:31.006307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:08:31.006307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:08:31.007553 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:08:31.028918 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:08:31.029677 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:08:31.043209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:31.079284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:31.079712 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:31.086645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.40.100,3260]
May 28 03:08:31.086645 np0000001589 nova-compute[98297]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.40.100,3260] successful.
May 28 03:08:31.086645 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:31.113894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:31.130281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:31.172580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.50.100,3260]
May 28 03:08:31.172580 np0000001589 nova-compute[98297]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-06add449-295c-4024-9b03-4f70538663ba, portal: 192.168.50.100,3260] successful.
May 28 03:08:31.172580 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:31.193494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:31.193804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:31.193957 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== disconnect_volume: return (1120ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:31.194153 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:08:31.670113 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:31.673379 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.47 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:08:31.775622 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:31.789118 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937711.7876887, 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:31.789118 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] VM Started (Lifecycle Event)
May 28 03:08:31.801875 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:31.802014 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing instance network info cache due to event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:31.802651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:31.802651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:31.802880 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:31.823154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:31.823592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:32.137672 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:32.138109 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:08:32.138441 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:08:32.291779 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:32.296588 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937712.296303, 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:32.298804 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] VM Paused (Lifecycle Event)
May 28 03:08:32.307470 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:32.327833 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:08:32.377913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e462787b-b7f0-4a71-a300-ca55d26d42ab tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.744s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:32.378699 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.625s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:32.632207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:32.692989 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:32.783286 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-688cfb66-1e6d-4ec0-bd98-3f860ab984a1 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.176s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:32.802154 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:32.805337 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:32.878758 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:32.890498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:32.892660 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updated VIF entry in instance network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:08:32.892860 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:32.895924 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.262s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:32.897904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:32.898341 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:32.902677 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:08:32.903044 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Claim successful on node np0000001589
May 28 03:08:33.133552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:33.308122 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:33.396861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e35ed58f-b4c3-487a-83d3-f0d3563d0462 req-a2bb8b49-5414-4eae-9d65-579eccc89e13 service nova] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:33.399805 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Detaching volume f7a867a4-b686-4e53-8845-7c5dc966abc0
May 28 03:08:33.453180 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Attempting to driver detach volume f7a867a4-b686-4e53-8845-7c5dc966abc0 from mountpoint /dev/vdb
May 28 03:08:33.492127 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': 'e8ff2f55-78d4-4022-8d61-8b5aab3f0576', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'serial': 'f7a867a4-b686-4e53-8845-7c5dc966abc0'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:08:33.495583 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-f7a867a4-b686-4e53-8845-7c5dc966abc0 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:08:33.496700 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-f7a867a4-b686-4e53-8845-7c5dc966abc0 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:08:33.496806 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Attempting to detach device vdb from instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:08:33.497067 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:08:33.497067 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:33.497067 np0000001589 nova-compute[98297]:   <alias name="ua-f7a867a4-b686-4e53-8845-7c5dc966abc0"/>
May 28 03:08:33.497067 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 28 03:08:33.497067 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:33.497067 np0000001589 nova-compute[98297]:   <serial>f7a867a4-b686-4e53-8845-7c5dc966abc0</serial>
May 28 03:08:33.497067 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:08:33.497067 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:33.497067 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:08:33.502512 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 from the persistent domain config.
May 28 03:08:33.502675 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] (1/8): Attempting to detach device vdb with device alias ua-f7a867a4-b686-4e53-8845-7c5dc966abc0 from instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:08:33.502936 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:08:33.502936 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:33.502936 np0000001589 nova-compute[98297]:   <alias name="ua-f7a867a4-b686-4e53-8845-7c5dc966abc0"/>
May 28 03:08:33.502936 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 28 03:08:33.502936 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:33.502936 np0000001589 nova-compute[98297]:   <serial>f7a867a4-b686-4e53-8845-7c5dc966abc0</serial>
May 28 03:08:33.502936 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:08:33.502936 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:33.502936 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:08:33.936277 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Rebuilding instance
May 28 03:08:34.076557 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937714.0762737, e8ff2f55-78d4-4022-8d61-8b5aab3f0576 => ua-f7a867a4-b686-4e53-8845-7c5dc966abc0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:08:34.077891 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f7a867a4-b686-4e53-8845-7c5dc966abc0 for instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:08:34.079931 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 from the live domain config.
May 28 03:08:34.081185 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:08:34.081430 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:08:34.081546 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:08:34.082003 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7e4b64588290>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': 'e8ff2f55-78d4-4022-8d61-8b5aab3f0576', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'serial': 'f7a867a4-b686-4e53-8845-7c5dc966abc0'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:08:34.082149 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.cryptsetup [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] closing encrypted volume /dev/dm-11 {{(pid=98297) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 28 03:08:34.106712 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:08:34.106712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:34.106853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:34.107158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:34.108029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f7a867a4-b686-4e53-8845-7c5dc966abc0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:08:34.108029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:08:34.122820 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:34.150110 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [100] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: tcp: [99] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0 (non-flash)
May 28 03:08:34.153330 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', '100'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '98'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', '99')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', '99')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:34.153330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0', '100')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:34.153624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646bb560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'): ({'sdk'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:08:34.153726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Removing multipathed devices sdk, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:08:34.154834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flush multipath device 330000000fab6ba67 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:08:34.191759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:34.236217 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:34.285095 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if SCSI volumes sdk, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:08:34.285324 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] SCSI volumes sdk, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:08:34.286699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if device paths {'sdk', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:08:34.300333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Device paths {'sdk', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:08:34.300431 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:08:34.331101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:34.368510 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.40.100,3260]
May 28 03:08:34.368510 np0000001589 nova-compute[98297]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.40.100,3260] successful.
May 28 03:08:34.368510 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:34.392450 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:34.393255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:34.394808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:34.411447 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:34.454558 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.50.100,3260]
May 28 03:08:34.454558 np0000001589 nova-compute[98297]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-f7a867a4-b686-4e53-8845-7c5dc966abc0, portal: 192.168.50.100,3260] successful.
May 28 03:08:34.454558 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:34.470555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:34.472035 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:34.472196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== disconnect_volume: return (365ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:34.472451 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:08:34.482386 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:34.482599 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:34.695309 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-24a466b8-1acc-4e5a-8bae-9802738ffe00 req-cd2c3215-246e-428f-b6d6-d8e85839c04b service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-vif-plugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:34.695798 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-24a466b8-1acc-4e5a-8bae-9802738ffe00 req-cd2c3215-246e-428f-b6d6-d8e85839c04b service nova] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:34.696014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-24a466b8-1acc-4e5a-8bae-9802738ffe00 req-cd2c3215-246e-428f-b6d6-d8e85839c04b service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:34.696177 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-24a466b8-1acc-4e5a-8bae-9802738ffe00 req-cd2c3215-246e-428f-b6d6-d8e85839c04b service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:34.696539 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-24a466b8-1acc-4e5a-8bae-9802738ffe00 req-cd2c3215-246e-428f-b6d6-d8e85839c04b service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Processing event network-vif-plugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:08:34.696863 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:08:34.699902 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937714.6996024, 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:34.700159 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] VM Resumed (Lifecycle Event)
May 28 03:08:34.701080 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:08:34.706363 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Instance spawned successfully.
May 28 03:08:34.708304 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:08:34.898990 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:34.985522 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:35.020610 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid e8ff2f55-78d4-4022-8d61-8b5aab3f0576 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:35.137638 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:35.137897 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:35.138124 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:35.153367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.153775 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.177087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.201050 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.203062 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:35.204723 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:35.207997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.222988 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:35.223496 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:35.224031 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:35.224373 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:35.224798 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:35.225128 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:35.309621 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-981cf131-db17-403a-af22-281fec007669 req-e5facb66-286d-493f-8872-a8664d9ef87b service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:35.310361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-981cf131-db17-403a-af22-281fec007669 req-e5facb66-286d-493f-8872-a8664d9ef87b service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:35.311250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-981cf131-db17-403a-af22-281fec007669 req-e5facb66-286d-493f-8872-a8664d9ef87b service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:35.311442 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-981cf131-db17-403a-af22-281fec007669 req-e5facb66-286d-493f-8872-a8664d9ef87b service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:35.313667 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-981cf131-db17-403a-af22-281fec007669 req-e5facb66-286d-493f-8872-a8664d9ef87b service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] No waiting events found dispatching network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:35.313811 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-981cf131-db17-403a-af22-281fec007669 req-e5facb66-286d-493f-8872-a8664d9ef87b service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received unexpected event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa for instance with vm_state active and task_state rebuilding.
May 28 03:08:35.494505 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.596s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:35.495949 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:08:35.501183 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance destroyed successfully.
May 28 03:08:35.506661 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance destroyed successfully.
May 28 03:08:35.508076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-684942754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionsv293testjson-server-1321674240',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3hDIHKDwZCYjvIQ/AFuVBITm39hgX9ZkqgE1WS7Mwn+hc7CvfM7//lGgtkulsIwGUuyXwpO03DqyaRO+qN8oMsRIB8U2wC7XDILYN6XI/HRQ8z1XvjJ7U34UhbCRY/5Q==',key_name='tempest-keypair-64605543',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:53Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4892c2979f14a6dbc055d3e2d359bfa',ramdisk_id='',reservation_id='r-vj2w8kuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1182810107',owner_user_name='tempest-ServerActionsV293TestJSON-1182810107-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f776b52236043fb9455d1ec9a21c765',uuid=bbe1fdbc-f534-444c-8ad2-982bf5108932,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:08:35.508536 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converting VIF {"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:35.509402 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:35.509777 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:08:35.512280 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.513241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1b2aac4-ed, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:35.522509 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.530641 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:35.535569 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.536968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22ddc32f-eab9-4ea0-bb94-7563a441dcb6) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:35.537861 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.540278 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:35.540621 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:35.544038 np0000001589 nova-compute[98297]: INFO os_vif [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed')
May 28 03:08:35.546105 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:08:35.546712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:35.546866 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:35.547933 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:35.548477 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:08:35.548660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [88] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [89] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:35.589952 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '101'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '89'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '98')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '89')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:35.589952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '88')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:08:35.590758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b6446ae80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:08:35.590966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Removing multipathed devices sdd, sdc {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:08:35.591195 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Flush multipath device 3300000007c93f769 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:08:35.642247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:35.645239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:35.645239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:35.645239 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:08:35.707005 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:35.707297 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999864658000206 future=<Future at 0x7e4b64548950 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:35.708972 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99814372300034 future=<Future at 0x7e4b64548950 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:35.710235 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998048896 future=<Future at 0x7e4b64548950 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:35.732030 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Took 10.77 seconds to spawn the instance on the hypervisor.
May 28 03:08:35.732442 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:35.904059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:36.004777 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:08:36.004901 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:08:36.005443 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:36.005639 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:36.035441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dec02c1b-e272-4273-af5b-4069b6c1f7b9 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.141s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:36.103836 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba297a0d43248c883c9b6100d92cae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094dc3cb80814083a18dc5026b895ec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:08:36.245299 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Took 16.56 seconds to build instance.
May 28 03:08:36.515819 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:08:36.642141 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Successfully created port: 9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:08:36.682720 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:36.747776 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c44e921e-c738-43db-8e0e-2d347b3ce947 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.070s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:36.748320 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.470s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:36.748785 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:36.748785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:36.793125 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:36.794559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:36.895520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:36.901290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:08:36.903161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:36.938259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-65f1ad63-2630-46ef-abf0-3fdf086c15d8 req-26a050ee-ab19-4e60-9e22-c802f560f475 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-vif-plugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:36.938872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-65f1ad63-2630-46ef-abf0-3fdf086c15d8 req-26a050ee-ab19-4e60-9e22-c802f560f475 service nova] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:36.939748 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-65f1ad63-2630-46ef-abf0-3fdf086c15d8 req-26a050ee-ab19-4e60-9e22-c802f560f475 service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:36.940174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-65f1ad63-2630-46ef-abf0-3fdf086c15d8 req-26a050ee-ab19-4e60-9e22-c802f560f475 service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:36.940508 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-65f1ad63-2630-46ef-abf0-3fdf086c15d8 req-26a050ee-ab19-4e60-9e22-c802f560f475 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] No waiting events found dispatching network-vif-plugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:36.940957 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-65f1ad63-2630-46ef-abf0-3fdf086c15d8 req-26a050ee-ab19-4e60-9e22-c802f560f475 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received unexpected event network-vif-plugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 for instance with vm_state active and task_state None.
May 28 03:08:36.994801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:36.994801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:36.994801 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attaching volume 733b7727-b78c-4351-8ebf-b27cf59b75fe to /dev/vdb
May 28 03:08:36.997696 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:36.998705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.018344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:37.018344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:37.018344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:37.018344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:37.018344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:37.026492 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:08:37.042345 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Terminating instance
May 28 03:08:37.105574 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.109885 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:37.112732 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.136640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:08:37.163307 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.225893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.228716 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.247332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:08:37.247904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:08:37.257944 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Successfully updated port: 9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:08:37.263100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:08:37.264544 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fe0c:c122', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fecc:563f', 'fe80::24e9:85ff:fe54:e97b', 'fe80::fc16:3eff:feab:c480', 'fe80::3073:48ff:fe9d:fe6f', 'fe80::fc16:3eff:fe12:88e0'] 
May 28 03:08:37.264717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:08:37.264810 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:08:37.265066 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:37.265458 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating existing volume attachment record: 6348cb6e-7802-4d36-8982-36b7433936a1 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:08:37.326085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.330435 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:08:37.331826 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.386998 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c98ead17-6436-4c7c-9a03-9e9bbafdff3e req-44837483-c3d6-48c0-ab88-f485d4b7e82f service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:37.387814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c98ead17-6436-4c7c-9a03-9e9bbafdff3e req-44837483-c3d6-48c0-ab88-f485d4b7e82f service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:37.388546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c98ead17-6436-4c7c-9a03-9e9bbafdff3e req-44837483-c3d6-48c0-ab88-f485d4b7e82f service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:37.389153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c98ead17-6436-4c7c-9a03-9e9bbafdff3e req-44837483-c3d6-48c0-ab88-f485d4b7e82f service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:37.389414 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c98ead17-6436-4c7c-9a03-9e9bbafdff3e req-44837483-c3d6-48c0-ab88-f485d4b7e82f service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] No waiting events found dispatching network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:37.389636 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c98ead17-6436-4c7c-9a03-9e9bbafdff3e req-44837483-c3d6-48c0-ab88-f485d4b7e82f service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received unexpected event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa for instance with vm_state active and task_state rebuilding.
May 28 03:08:37.423516 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.426297 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.514131 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.518880 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:08:37.524312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.566018 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:08:37.597495 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:37.609607 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:37.627410 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:37.636442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:37.643176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.645783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.669951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:37.760085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.763593 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:37.763739 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquired lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:37.763967 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:08:37.767030 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:08:37.768581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:37.833482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:37.834117 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=11738MB free_disk=73.87689208984375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:08:37.834370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:37.834638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:37.836632 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:08:37.837057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '733b7727-b78c-4351-8ebf-b27cf59b75fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:37.837261 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:37.880604 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-changed-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:37.880604 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Refreshing instance network info cache due to event network-changed-38a13c7d-8add-4161-b90c-90fa6721ff37. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:37.880604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] Acquiring lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:37.880604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] Acquired lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:37.881908 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Refreshing network info cache for port 38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:37.885751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:37.931498 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999555952999799 future=<Future at 0x7e4b406ca090 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:37.933494 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Instance destroyed successfully.
May 28 03:08:37.934046 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'resources' on Instance uuid e8ff2f55-78d4-4022-8d61-8b5aab3f0576 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:38.068533 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:08:38.069678 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:08:38.069940 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Creating image(s)
May 28 03:08:38.071571 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:38.071760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:38.072314 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:38.072985 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:38.076997 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:38.081005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:38.185577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:38.187142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:38.188036 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:38.190911 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:38.195021 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:38.195511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:38.292432 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:38.292432 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:38.360793 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk 1073741824" returned: 0 in 0.068s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:38.361473 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:38.361891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:38.393339 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:38.406894 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:38.438118 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:07:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1750601929',display_name='tempest-TestEncryptedCinderVolumes-server-1750601929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-1750601929',id=33,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5896FP+qqzKMggZJaoG06XI74uHegNzk0oSHBO4xNiEp0f1MYLtpJpprZfaE17PzqwQUZVCXnMRMwKpSMGcpMzm5P5Ko2Ln1ImsLhaDLtsrieC232V0dnWYZH+Xg2pMQ==',key_name='tempest-keypair-2091372292',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:43Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-mzov90e4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:07:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=e8ff2f55-78d4-4022-8d61-8b5aab3f0576,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:08:38.438427 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "address": "fa:16:3e:0c:c1:22", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a2a0acb-27", "ovs_interfaceid": "9a2a0acb-2785-4a56-9f6d-67de0a4c8277", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:38.438910 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c1:22,bridge_name='br-int',has_traffic_filtering=True,id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2a0acb-27') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:38.439161 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c1:22,bridge_name='br-int',has_traffic_filtering=True,id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2a0acb-27') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:08:38.441501 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:38.441856 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a2a0acb-27, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:38.443236 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:38.444984 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:38.444984 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:38.445478 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:38.445608 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0014b77-2019-4925-a086-3fe2f2a9a84d) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:38.446776 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:38.448629 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:38.449336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:38.451247 np0000001589 nova-compute[98297]: INFO os_vif [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:c1:22,bridge_name='br-int',has_traffic_filtering=True,id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a2a0acb-27')
May 28 03:08:38.451609 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Deleting instance files /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576_del
May 28 03:08:38.452449 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Deletion of /opt/stack/data/nova/instances/e8ff2f55-78d4-4022-8d61-8b5aab3f0576_del complete
May 28 03:08:38.463939 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:38.464746 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:08:38.465134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:38.572397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:38.572949 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Cannot resize image /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:08:38.573691 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:08:38.575377 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Ensure instance console log exists: /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:08:38.575937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:38.576550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:38.576869 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:38.680691 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:38.838469 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:38.842983 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Updating instance_info_cache with network_info: [{"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:38.919309 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7aaca677-0143-4ffd-8206-e47614601132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.919493 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.919635 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance bbe1fdbc-f534-444c-8ad2-982bf5108932 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.919721 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.919845 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.919944 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 021bf930-a793-4075-893e-af588958bc9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.920070 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c792127f-b33e-48b3-8da7-ba4bd8ebeac0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.920188 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.920326 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:08:38.920507 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:08:38.920622 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:08:37 up 36 min,  2 users,  load average: 7.88, 6.67, 3.98\n', 'num_instances': '9', 'num_vm_active': '8', 'num_task_None': '6', 'num_os_type_None': '9', 'num_proj_80ff1bde877e4c3d9883c34167e979ce': '1', 'io_workload': '2', 'num_task_deleting': '1', 'num_proj_0eee8d500ee84b5f86e297c2660e183b': '1', 'num_task_rebuilding': '1', 'num_proj_f4892c2979f14a6dbc055d3e2d359bfa': '1', 'num_proj_52ac8d769a2d4b49807632858d7e6423': '3', 'num_proj_528e86ab455d438bbf2f6d21a401e580': '1', 'num_proj_b61f52dbd3ed46f4814f2c0b132c713d': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_094dc3cb80814083a18dc5026b895ec5': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:08:38.963979 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 03:08:38.966074 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:08:38.966437 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:08:38.966539 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:08:38.966773 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:39.010630 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-changed-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:39.015732 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Refreshing instance network info cache due to event network-changed-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:39.016477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Acquiring lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:39.045795 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updated VIF entry in instance network info cache for port 38a13c7d-8add-4161-b90c-90fa6721ff37. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:08:39.046217 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updating instance_info_cache with network_info: [{"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:39.111658 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:39.346120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Releasing lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:39.346444 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Instance network_info: |[{"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:08:39.348174 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Start _get_guest_xml network_info=[{"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:08:39.348592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Acquired lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:39.348722 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Refreshing network info cache for port 9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:39.352133 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:08:39.353581 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-624632726', uuid='8e34a9f9-f4aa-493a-8ca2-6998667e2580'), owner=OwnerMeta(userid='fba297a0d43248c883c9b6100d92cae8', username='tempest-AttachVolumeNegativeTest-414697469-project-member', projectid='094dc3cb80814083a18dc5026b895ec5', projectname='tempest-AttachVolumeNegativeTest-414697469'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937719.3529832) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:08:39.354708 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:08:39.355108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:08:39.355972 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:08:39.356334 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:08:39.358257 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:08:39.358746 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:08:39.358901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:08:39.359281 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:08:39.359517 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:08:39.359700 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:08:39.360065 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:08:39.360235 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:08:39.360779 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:08:39.360916 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:08:39.361054 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:08:39.361404 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:08:39.377874 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624632726',display_name='tempest-AttachVolumeNegativeTest-server-624632726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-624632726',id=40,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyLk2zmKDleJgS/EZ1kzCy/5ZLm4DKxSzFIyzhdHCKpmMfrXxXWTCOzLHsaMydOZkmRzXtDbS7LzUQKaOYTUaw4rIexGgt70PFvrD24FKqHk9RrcZiu8cLhHZqZ6bu5HA==',key_name='tempest-keypair-11038288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-5rhlh4qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=8e34a9f9-f4aa-493a-8ca2-6998667e2580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:08:39.378192 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:39.382130 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8c2700-ba') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:39.382675 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e34a9f9-f4aa-493a-8ca2-6998667e2580 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:39.422593 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:39.422653 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:39.549541 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82474d2c-4c38-4bf8-b2cb-f9ac26bbb811 req-be63ac5a-5b6e-4dc9-b44f-493abf6470eb service nova] Releasing lock "refresh_cache-b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:39.747441 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-74731859-3c7e-4069-9487-104261ca11cf req-f5493672-98d5-44bc-83b4-17bf1026e8c8 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-deleted-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:39.747775 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-74731859-3c7e-4069-9487-104261ca11cf req-f5493672-98d5-44bc-83b4-17bf1026e8c8 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Neutron deleted interface 9a2a0acb-2785-4a56-9f6d-67de0a4c8277; detaching it from the instance and deleting it from the info cache
May 28 03:08:39.751845 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-74731859-3c7e-4069-9487-104261ca11cf req-f5493672-98d5-44bc-83b4-17bf1026e8c8 service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Detach interface failed, port_id=9a2a0acb-2785-4a56-9f6d-67de0a4c8277, reason: Instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:08:39.802241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:39.803469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:39.852085 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:39.885972 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] End _get_guest_xml xml=<domain type="qemu">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <uuid>8e34a9f9-f4aa-493a-8ca2-6998667e2580</uuid>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <name>instance-00000028</name>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeNegativeTest-server-624632726</nova:name>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:08:39</nova:creationTime>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:user uuid="fba297a0d43248c883c9b6100d92cae8">tempest-AttachVolumeNegativeTest-414697469-project-member</nova:user>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:project uuid="094dc3cb80814083a18dc5026b895ec5">tempest-AttachVolumeNegativeTest-414697469</nova:project>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         <nova:port uuid="9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <system>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <entry name="serial">8e34a9f9-f4aa-493a-8ca2-6998667e2580</entry>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <entry name="uuid">8e34a9f9-f4aa-493a-8ca2-6998667e2580</entry>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </system>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <os>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   </os>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <features>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   </features>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   <devices>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk.config"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:51:1d:91"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <target dev="tap9d8c2700-ba"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </interface>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/console.log" append="off"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </serial>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <video>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </video>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </rng>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:   </devices>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]: </domain>
May 28 03:08:39.885972 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:08:39.887746 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Preparing to wait for external event network-vif-plugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:08:39.887746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:39.887746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:39.887746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:39.887746 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624632726',display_name='tempest-AttachVolumeNegativeTest-server-624632726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-624632726',id=40,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyLk2zmKDleJgS/EZ1kzCy/5ZLm4DKxSzFIyzhdHCKpmMfrXxXWTCOzLHsaMydOZkmRzXtDbS7LzUQKaOYTUaw4rIexGgt70PFvrD24FKqHk9RrcZiu8cLhHZqZ6bu5HA==',key_name='tempest-keypair-11038288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-5rhlh4qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=8e34a9f9-f4aa-493a-8ca2-6998667e2580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:08:39.887746 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:39.887746 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8c2700-ba') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:39.888024 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8c2700-ba') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:08:39.888482 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:39.888889 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:39.889247 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:08:39.890160 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:39.890468 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd28fc2fd-7d6e-5a41-8ef2-7db43cbb282a', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:39.901380 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:39.901380 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:39.902397 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:39.905330 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:39.905518 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d8c2700-ba, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:39.905877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d8c2700-ba, col_values=(('qos', UUID('e95d347e-2193-4f0f-856e-a39a74aecfa7')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:39.906077 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d8c2700-ba, col_values=(('external_ids', {'iface-id': '9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:1d:91', 'vm-uuid': '8e34a9f9-f4aa-493a-8ca2-6998667e2580'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:39.906861 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:39.908070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:39.915476 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:39.916435 np0000001589 nova-compute[98297]: INFO os_vif [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8c2700-ba')
May 28 03:08:39.925135 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:39.951997 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-changed-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:39.953277 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Refreshing instance network info cache due to event network-changed-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:39.953689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] Acquiring lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:39.953810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] Acquired lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:39.953942 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Refreshing network info cache for port 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:40.185993 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:40.199250 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:40.308430 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:40.393572 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Updated VIF entry in instance network info cache for port 9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:08:40.394588 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Updating instance_info_cache with network_info: [{"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:40.434309 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:08:40.434483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.600s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:40.435102 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:08:40.456137 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:40.705424 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Took 1.74 seconds to deallocate network for instance.
May 28 03:08:40.802265 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:40.897471 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Releasing lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:40.897651 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:40.897816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:40.897950 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:40.898049 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:40.898154 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] No waiting events found dispatching network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:40.898294 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:08:40.898415 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:40.898528 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Acquiring lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:40.898640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:40.898732 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:40.898825 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] No waiting events found dispatching network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:40.898921 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72a80de8-363b-41ee-9bea-7dfbf6c7ed38 req-5aa67cbb-e3f9-4e04-902f-fd47c6d3d68a service nova] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Received event network-vif-unplugged-9a2a0acb-2785-4a56-9f6d-67de0a4c8277 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:08:40.953765 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updated VIF entry in instance network info cache for port 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:08:40.955210 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updating instance_info_cache with network_info: [{"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:41.223556 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:41.224122 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:41.314812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:41.443923 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:41.444188 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:41.444307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No VIF found with MAC fa:16:3e:51:1d:91, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:41.444772 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Using config drive
May 28 03:08:41.458000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52761855-c0c3-4bf9-bb68-b6736ce4eaef req-caefc597-697e-4b3d-ab24-19307d436ee0 service nova] Releasing lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:41.693899 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:41.694083 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:41.952623 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:42.128602 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Creating config drive at /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk.config
May 28 03:08:42.133235 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi41ijmu0 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:42.185902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi41ijmu0" returned: 0 in 0.052s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:42.197843 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:42.394839 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:42.395071 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:42.395323 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Attaching volume cffb3082-5b97-416e-a3ae-a7e93385154a to /dev/vdb
May 28 03:08:42.434639 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:42.435040 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:42.435779 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:08:42.436083 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.70 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:08:42.448023 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:42.459180 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:08:42.481338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:42.527635 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:08:42.527944 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:08:42.540025 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:08:42.541334 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fecc:563f', 'fe80::24e9:85ff:fe54:e97b', 'fe80::fc16:3eff:feab:c480', 'fe80::3073:48ff:fe9d:fe6f', 'fe80::fc16:3eff:fe12:88e0'] 
May 28 03:08:42.541547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:08:42.541722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:08:42.542069 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:42.542544 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updating existing volume attachment record: 2b14685b-767f-4e85-8203-7ffd981a5c56 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:08:42.638376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:42.680327 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:42.708028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.484s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:42.764990 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:42.785478 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deleted allocations for instance e8ff2f55-78d4-4022-8d61-8b5aab3f0576
May 28 03:08:42.881932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ef39c254-5078-486c-93a4-f213bcde2cb5 req-d5aaf153-4f36-448b-9a4a-8ce159e89072 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-vif-plugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:42.881932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ef39c254-5078-486c-93a4-f213bcde2cb5 req-d5aaf153-4f36-448b-9a4a-8ce159e89072 service nova] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:42.881932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ef39c254-5078-486c-93a4-f213bcde2cb5 req-d5aaf153-4f36-448b-9a4a-8ce159e89072 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:42.881932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ef39c254-5078-486c-93a4-f213bcde2cb5 req-d5aaf153-4f36-448b-9a4a-8ce159e89072 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:42.882494 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ef39c254-5078-486c-93a4-f213bcde2cb5 req-d5aaf153-4f36-448b-9a4a-8ce159e89072 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Processing event network-vif-plugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:08:42.883021 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:43.021289 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:43.026023 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:43.052410 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:43.052929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:43.105065 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:08:43.105476 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:43.105721 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:43.589895 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937723.589483, 8e34a9f9-f4aa-493a-8ca2-6998667e2580 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:43.590409 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:08:43.590583 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] VM Started (Lifecycle Event)
May 28 03:08:43.594182 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:08:43.596909 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Instance spawned successfully.
May 28 03:08:43.597267 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:08:43.799920 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c5aa423a-4f9b-4d8c-a9cb-4a9e93986c61 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "e8ff2f55-78d4-4022-8d61-8b5aab3f0576" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.784s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:44.094182 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:44.097678 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:44.105110 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:44.105110 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:44.105110 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:44.105336 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:44.105650 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:44.105897 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:08:44.601598 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:08:44.602013 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937724.601753, 8e34a9f9-f4aa-493a-8ca2-6998667e2580 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:44.602187 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] VM Paused (Lifecycle Event)
May 28 03:08:44.612036 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Took 6.54 seconds to spawn the instance on the hypervisor.
May 28 03:08:44.612344 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:44.908650 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:44.969771 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aaf1c6ff-f7cc-4579-bd7c-dbb81aebec7c req-2c23344e-864f-492e-8b7c-9c6926556d93 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-vif-plugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:44.970853 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aaf1c6ff-f7cc-4579-bd7c-dbb81aebec7c req-2c23344e-864f-492e-8b7c-9c6926556d93 service nova] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:44.971255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aaf1c6ff-f7cc-4579-bd7c-dbb81aebec7c req-2c23344e-864f-492e-8b7c-9c6926556d93 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:44.971255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aaf1c6ff-f7cc-4579-bd7c-dbb81aebec7c req-2c23344e-864f-492e-8b7c-9c6926556d93 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:44.971367 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aaf1c6ff-f7cc-4579-bd7c-dbb81aebec7c req-2c23344e-864f-492e-8b7c-9c6926556d93 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] No waiting events found dispatching network-vif-plugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:08:44.971430 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-aaf1c6ff-f7cc-4579-bd7c-dbb81aebec7c req-2c23344e-864f-492e-8b7c-9c6926556d93 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received unexpected event network-vif-plugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c for instance with vm_state active and task_state None.
May 28 03:08:45.104816 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:45.106432 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937725.1061685, 8e34a9f9-f4aa-493a-8ca2-6998667e2580 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:45.106565 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] VM Resumed (Lifecycle Event)
May 28 03:08:45.121744 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Took 12.29 seconds to build instance.
May 28 03:08:45.610717 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:45.614071 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:45.623075 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e50656f2-f536-4895-9d38-cc8db2c7730a tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.799s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:46.690756 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-changed-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:46.691207 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Refreshing instance network info cache due to event network-changed-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:46.691207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] Acquiring lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:46.691331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] Acquired lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:46.691628 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Refreshing network info cache for port 9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:47.193479 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:47.473689 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:47.625575 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Updated VIF entry in instance network info cache for port 9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:08:47.625805 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Updating instance_info_cache with network_info: [{"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:47.885138 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:48.122726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:48.122726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:48.128218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1200f5f2-725f-4394-b855-6a1d1f738d8c req-a2223445-8851-4c4b-ade0-472443a22c8c service nova] Releasing lock "refresh_cache-8e34a9f9-f4aa-493a-8ca2-6998667e2580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:48.623235 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:08:49.167504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:49.167891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:49.170409 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:08:49.170595 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Claim successful on node np0000001589
May 28 03:08:49.910407 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:50.574479 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:08:50.574863 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:08:50.709958 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.002805892999731441 future=<Future at 0x7e4b64548950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:50.710832 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Emitting event <LifecycleEvent: 1779937715.7070577, bbe1fdbc-f534-444c-8ad2-982bf5108932 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:50.710972 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] VM Stopped (Lifecycle Event)
May 28 03:08:50.713812 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:50.714081 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.2169291929999417 future=<Future at 0x7e4b406ca090 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:50.714251 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.216756230000101 future=<Future at 0x7e4b406ca090 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:51.077487 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:08:51.215199 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:51.216809 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: rebuilding, current DB power_state: 1, VM power_state: 4 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:08:51.585734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.418s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:51.586266 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:08:51.718928 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] During sync_power_state the instance has a pending task (rebuilding). Skip.
May 28 03:08:52.091291 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:08:52.091457 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:08:52.091671 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:52.091890 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:52.158991 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d927d6b89cf4f0c96580968ea9c3791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee8d500ee84b5f86e297c2660e183b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:08:52.597046 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:08:52.666694 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Successfully created port: d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:08:52.889764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:52.931369 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003189829999428184 future=<Future at 0x7e4b406ca090 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:52.931793 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] Emitting event <LifecycleEvent: 1779937717.9309237, e8ff2f55-78d4-4022-8d61-8b5aab3f0576 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:52.931941 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:08:52.932084 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] VM Stopped (Lifecycle Event)
May 28 03:08:53.100146 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:08:53.135692 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Successfully updated port: d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:08:53.184265 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-changed-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:53.184428 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Refreshing instance network info cache due to event network-changed-d8858067-1d26-4553-ba2d-4341e6450d66. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:08:53.184568 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] Acquiring lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:53.184658 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] Acquired lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:53.185561 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Refreshing network info cache for port d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:08:53.434684 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-af82cbc2-28fe-4fab-b3bd-872e199a6496 tempest-TestServerVolumeAttachScenarioOldVersion-176036810 tempest-TestServerVolumeAttachScenarioOldVersion-176036810-project-member] [instance: e8ff2f55-78d4-4022-8d61-8b5aab3f0576] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:08:53.637181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:08:53.687248 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:53.748892 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:53.884370 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:54.108814 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:08:54.109748 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:08:54.109984 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Creating image(s)
May 28 03:08:54.110463 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:54.110641 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:54.111368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:54.111835 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:54.114238 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:54.115434 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:54.208254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:54.208254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:54.208254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:54.208254 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:54.209668 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:08:54.210016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:54.305846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:54.306391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:54.354383 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk 1073741824" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:54.354811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:54.355132 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:54.387918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ffb58d1-d695-4b5d-8091-0b1c0f04a2ea req-dfd8ee3f-e6f2-4350-9d2e-f52fd3bd9b78 service nova] Releasing lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:54.388821 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:08:54.389169 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:08:54.439018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:54.439442 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:08:54.439697 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:54.520717 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:54.521114 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Cannot resize image /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:08:54.521512 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:08:54.521674 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Ensure instance console log exists: /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:08:54.521954 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:54.522156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:54.522319 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:54.912004 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:54.950024 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:08:55.081525 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:55.190176 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Updating instance_info_cache with network_info: [{"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:08:55.621564 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:55.670690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:08:55.692292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:08:55.692645 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Instance network_info: |[{"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:08:55.694520 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Start _get_guest_xml network_info=[{"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:08:55.697574 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:08:55.698815 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-628878147', uuid='1d86d49f-8fd0-4682-b508-abb1b434b002'), owner=OwnerMeta(userid='2d927d6b89cf4f0c96580968ea9c3791', username='tempest-TestEncryptedCinderVolumes-781621704-project-member', projectid='0eee8d500ee84b5f86e297c2660e183b', projectname='tempest-TestEncryptedCinderVolumes-781621704'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937735.698438) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:08:55.699719 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:08:55.700073 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:08:55.700793 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:08:55.700956 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:08:55.701841 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:08:55.702133 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:08:55.702316 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:08:55.702416 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:08:55.702559 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:08:55.702640 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:08:55.702731 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:08:55.702875 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:08:55.702971 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:08:55.703071 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:08:55.703179 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:08:55.703332 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:08:55.714659 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-628878147',display_name='tempest-TestEncryptedCinderVolumes-server-628878147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-628878147',id=41,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtSYLL3Q+r016U21YaWd/+UpRWoHfrn68uyMec37BqHrccHPH8qSbXF3vunlrHuOdvUa2EFO8IOk0Cii7ZLIfrv3eLzvj0aoxTL9djtqNALqW7W9k3rIxxq2D8r2fWU8g==',key_name='tempest-keypair-754997858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-xqdtqhhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=1d86d49f-8fd0-4682-b508-abb1b434b002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:08:55.714844 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:55.715419 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8858067-1d26-4553-ba2d-4341e6450d66,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8858067-1d') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:55.715905 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d86d49f-8fd0-4682-b508-abb1b434b002 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:55.722607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:08:55.722822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:08:55.724534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:08:55.737159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:08:55.737454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:08:55.749969 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.780170 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 89, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260]
May 28 03:08:55.780170 np0000001589 nova-compute[98297]: Logout of [sid: 89, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260] successful.
May 28 03:08:55.780170 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.794953 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.806241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.834197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260]
May 28 03:08:55.834197 np0000001589 nova-compute[98297]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260] successful.
May 28 03:08:55.834197 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.854057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.854358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 20.307s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:55.854489 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] <== disconnect_volume: return (20307ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:55.854612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:08:55.854970 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Deleting instance files /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932_del
May 28 03:08:55.855384 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 18.018s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:55.855634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '733b7727-b78c-4351-8ebf-b27cf59b75fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:08:55.856242 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Deletion of /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932_del complete
May 28 03:08:55.869235 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:55.869481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:55.870067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:55.870067 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:55.870448 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:55.870652 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:55.881835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:55.881835 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.887102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:55.887102 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe] added
May 28 03:08:55.892950 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:55.892950 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:55.892950 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:55.898645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe] added
May 28 03:08:55.898645 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:55.898645 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:55.898645 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:55.898645 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:55.898645 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:55.898645 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:55.898834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:55.898880 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0283(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:55.899047 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:56.218636 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] End _get_guest_xml xml=<domain type="qemu">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <uuid>1d86d49f-8fd0-4682-b508-abb1b434b002</uuid>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <name>instance-00000029</name>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-628878147</nova:name>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:08:55</nova:creationTime>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:user uuid="2d927d6b89cf4f0c96580968ea9c3791">tempest-TestEncryptedCinderVolumes-781621704-project-member</nova:user>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:project uuid="0eee8d500ee84b5f86e297c2660e183b">tempest-TestEncryptedCinderVolumes-781621704</nova:project>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         <nova:port uuid="d8858067-1d26-4553-ba2d-4341e6450d66">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <system>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <entry name="serial">1d86d49f-8fd0-4682-b508-abb1b434b002</entry>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <entry name="uuid">1d86d49f-8fd0-4682-b508-abb1b434b002</entry>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </system>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <os>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   </os>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <features>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   </features>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   <devices>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk.config"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </disk>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:1c:b4:b2"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <target dev="tapd8858067-1d"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </interface>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/console.log" append="off"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </serial>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <video>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </video>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </rng>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:   </devices>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]: </domain>
May 28 03:08:56.218636 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:08:56.221045 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Preparing to wait for external event network-vif-plugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:08:56.221045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:56.221045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:56.221045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:56.221045 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-628878147',display_name='tempest-TestEncryptedCinderVolumes-server-628878147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-628878147',id=41,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtSYLL3Q+r016U21YaWd/+UpRWoHfrn68uyMec37BqHrccHPH8qSbXF3vunlrHuOdvUa2EFO8IOk0Cii7ZLIfrv3eLzvj0aoxTL9djtqNALqW7W9k3rIxxq2D8r2fWU8g==',key_name='tempest-keypair-754997858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-xqdtqhhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=1d86d49f-8fd0-4682-b508-abb1b434b002,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:08:56.221045 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:08:56.221358 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8858067-1d26-4553-ba2d-4341e6450d66,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8858067-1d') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:08:56.221756 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8858067-1d26-4553-ba2d-4341e6450d66,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8858067-1d') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:08:56.221884 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:56.222159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:56.222502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:08:56.223475 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:56.223636 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e847e443-91c4-5388-b857-a88fdaaff6e3', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:56.224563 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:56.225403 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:56.226657 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:56.228560 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:56.228733 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8858067-1d, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:56.229080 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8858067-1d, col_values=(('qos', UUID('98b3e849-e52c-41fa-bf3b-25110c76492f')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:56.229236 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8858067-1d, col_values=(('external_ids', {'iface-id': 'd8858067-1d26-4553-ba2d-4341e6450d66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:b4:b2', 'vm-uuid': '1d86d49f-8fd0-4682-b508-abb1b434b002'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:08:56.231557 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:56.235209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:08:56.237956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:56.239394 np0000001589 nova-compute[98297]: INFO os_vif [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:b4:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8858067-1d26-4553-ba2d-4341e6450d66,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8858067-1d')
May 28 03:08:56.424216 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance bbe1fdbc-f534-444c-8ad2-982bf5108932 could not be found.
May 28 03:08:56.425073 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:08:56.425471 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:08:56.425620 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:56.893372 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:56.899515 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:56.907549 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:56.907549 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:56.910611 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:56.910611 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:56.920623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:56.926335 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:56.935935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:56.935935 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.935935 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.935935 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.935935 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.935935 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:56.936128 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:56.936128 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.936128 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.936128 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.936128 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.936128 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:56.941326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:56.941326 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.941326 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.941326 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.941326 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.941326 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:56.941482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:56.941482 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.941482 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:56.941482 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.941482 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:56.941482 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:56.975383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.40.100,3260]
May 28 03:08:56.975383 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.40.100,3260] successful.
May 28 03:08:56.975383 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:56.981713 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.50.100,3260]
May 28 03:08:56.981713 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.50.100,3260] successful.
May 28 03:08:56.981713 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:56.986745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:56.995293 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:57.003537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:57.003537 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.003537 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.003537 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.003537 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.003537 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.003537 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.003537 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.003857 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:57.003857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:57.004124 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:57.007732 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('7', '-', '-', 0) found on session 102 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:57.007835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:57.012337 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:57.012337 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.012337 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.012337 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.012337 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.012337 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.012337 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.012337 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:57.012604 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:57.012604 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.012604 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:57.012604 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.012604 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:57.012604 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.012604 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:57.012604 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:08:57.012753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:57.012834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:08:57.013621 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] HCTL ('8', '-', '-', 0) found on session 103 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:08:57.013739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:08:57.023101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 102 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:57.023101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '733b7727-b78c-4351-8ebf-b27cf59b75fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:57.029352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 103 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:57.756619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:57.756971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:08:57.756971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:1c:b4:b2, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:08:57.757237 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Using config drive
May 28 03:08:57.889412 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:58.029920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Searching for a device in session 103 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:08:58.030040 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '733b7727-b78c-4351-8ebf-b27cf59b75fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:08:58.261867 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:08:58.364002 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Creating config drive at /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk.config
May 28 03:08:58.367498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcdhzc36w {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:08:58.412594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcdhzc36w" returned: 0 in 0.045s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:08:58.843070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:58.886444 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found WWN 33000000072bf737c for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:08:58.890798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:08:58.890798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== connect_volume: return (21050ms) {'type': 'block', 'scsi_wwn': '33000000072bf737c', 'path': '/dev/dm-0', 'multipath_id': '33000000072bf737c'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:08:58.890798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:58.891605 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000072bf737c', 'path': '/dev/dm-0', 'multipath_id': '33000000072bf737c'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:08:58.891923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:58.892751 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 15.787s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:58.893144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:08:58.896056 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:58.912955 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:58.913664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:58.914264 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:58.915735 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:08:58.917122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:08:58.917304 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:58.929694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:58.929694 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:58.934808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:08:58.934808 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:58.950170 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a] added
May 28 03:08:58.950170 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:58.950170 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:58.950170 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:58.950170 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:58.950170 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:58.950170 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:58.950170 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:58.950685 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:58.950952 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:58.952852 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a] added
May 28 03:08:58.952852 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:08:58.952852 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:58.952852 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:58.952852 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:08:58.952852 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:08:58.952852 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:58.953114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:08:58.953165 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0359(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:08:58.955301 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:08:58.962672 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:59.075167 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bdc4ba76-ec3b-453a-b780-fa87d47e7665 req-7e999620-9eb7-41d0-b939-c70462718fda service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-vif-plugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:08:59.075167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bdc4ba76-ec3b-453a-b780-fa87d47e7665 req-7e999620-9eb7-41d0-b939-c70462718fda service nova] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:59.076997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bdc4ba76-ec3b-453a-b780-fa87d47e7665 req-7e999620-9eb7-41d0-b939-c70462718fda service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:59.077759 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bdc4ba76-ec3b-453a-b780-fa87d47e7665 req-7e999620-9eb7-41d0-b939-c70462718fda service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:08:59.077918 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bdc4ba76-ec3b-453a-b780-fa87d47e7665 req-7e999620-9eb7-41d0-b939-c70462718fda service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Processing event network-vif-plugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:08:59.143714 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:59.212261 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:59.217471 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:59.240410 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:08:59.402574 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to attach volume 733b7727-b78c-4351-8ebf-b27cf59b75fe with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:08:59.403350 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:08:59.403350 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:08:59.403350 np0000001589 nova-compute[98297]:   <alias name="ua-733b7727-b78c-4351-8ebf-b27cf59b75fe"/>
May 28 03:08:59.403350 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:08:59.403350 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:08:59.403350 np0000001589 nova-compute[98297]:   <serial>733b7727-b78c-4351-8ebf-b27cf59b75fe</serial>
May 28 03:08:59.403350 np0000001589 nova-compute[98297]: </disk>
May 28 03:08:59.403350 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:08:59.484255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:08:59.484499 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:08:59.653121 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937739.6527517, 1d86d49f-8fd0-4682-b508-abb1b434b002 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:08:59.653528 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:08:59.653708 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] VM Started (Lifecycle Event)
May 28 03:08:59.657459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:08:59.659829 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Instance spawned successfully.
May 28 03:08:59.660185 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:08:59.951393 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:08:59.955865 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:59.964627 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:59.964627 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:08:59.970545 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:08:59.970545 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:59.979181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:59.986193 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:08:59.992089 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lazy-loading 'flavor' on Instance uuid 021bf930-a793-4075-893e-af588958bc9b {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:08:59.999454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:59.999454 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:59.999454 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:59.999454 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:59.999454 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:59.999454 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:59.999454 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:59.999454 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:08:59.999991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:08:59.999991 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:59.999991 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:08:59.999991 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:59.999991 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:08:59.999991 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:59.999991 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:08:59.999991 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:00.001178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:00.001178 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.001178 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.001178 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.001178 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.001178 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.001178 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.001178 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:00.001491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:00.001491 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.001491 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.001491 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.001491 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.001491 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.001491 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.001491 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:00.043627 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.40.100,3260]
May 28 03:09:00.043627 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.40.100,3260] successful.
May 28 03:09:00.043627 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:00.054356 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:00.062051 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.50.100,3260]
May 28 03:09:00.062051 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.50.100,3260] successful.
May 28 03:09:00.062051 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.069096 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.069445 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:00.069708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:00.069708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:00.070609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('9', '-', '-', 0) found on session 104 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:00.070748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:00.074816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:00.087117 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 104 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:00.087908 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.101034 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:00.101352 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:00.101547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:00.101691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:00.103016 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('10', '-', '-', 0) found on session 105 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:00.103016 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:00.117980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 105 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:00.118534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:00.156368 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:00.159584 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:00.167422 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:00.167613 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:00.167963 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:00.168259 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:00.168607 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:00.168837 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:00.494580 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Ignoring supplied device name: /dev/vdb
May 28 03:09:00.666020 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:09:00.666223 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937740.666032, 1d86d49f-8fd0-4682-b508-abb1b434b002 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:00.666335 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] VM Paused (Lifecycle Event)
May 28 03:09:00.673882 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Took 6.56 seconds to spawn the instance on the hypervisor.
May 28 03:09:00.674046 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:00.918144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:09:00.997949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:01.056560 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:01.056678 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:01.056735 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:01.056869 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] No VIF found with MAC fa:16:3e:b4:4e:d6, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:01.128663 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75ff663e-4b77-4bd1-b909-4e9ac5548d82 req-d203a5f1-7dac-4ed4-a9c2-78a9925b9d4c service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-vif-plugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:01.129136 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75ff663e-4b77-4bd1-b909-4e9ac5548d82 req-d203a5f1-7dac-4ed4-a9c2-78a9925b9d4c service nova] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:01.129261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75ff663e-4b77-4bd1-b909-4e9ac5548d82 req-d203a5f1-7dac-4ed4-a9c2-78a9925b9d4c service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:01.129386 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75ff663e-4b77-4bd1-b909-4e9ac5548d82 req-d203a5f1-7dac-4ed4-a9c2-78a9925b9d4c service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:01.129517 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75ff663e-4b77-4bd1-b909-4e9ac5548d82 req-d203a5f1-7dac-4ed4-a9c2-78a9925b9d4c service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] No waiting events found dispatching network-vif-plugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:01.129629 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-75ff663e-4b77-4bd1-b909-4e9ac5548d82 req-d203a5f1-7dac-4ed4-a9c2-78a9925b9d4c service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received unexpected event network-vif-plugged-d8858067-1d26-4553-ba2d-4341e6450d66 for instance with vm_state active and task_state None.
May 28 03:09:01.168373 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:01.169822 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937741.169643, 1d86d49f-8fd0-4682-b508-abb1b434b002 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:01.169914 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] VM Resumed (Lifecycle Event)
May 28 03:09:01.181600 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Took 12.05 seconds to build instance.
May 28 03:09:01.231604 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:01.672427 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:01.674336 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:01.684940 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe81d1ef-de92-4214-a75a-fc31537c32de tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.561s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:01.932615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 33000000011193771 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:09:01.932923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:01.933134 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (18827ms) {'type': 'block', 'scsi_wwn': '33000000011193771', 'path': '/dev/dm-1', 'multipath_id': '33000000011193771'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:01.933337 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000011193771', 'path': '/dev/dm-1', 'multipath_id': '33000000011193771'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:09:01.934347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:01.934347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:09:01.934347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:09:01.935593 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:01.965144 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:01.968263 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '101'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '98')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b405787c0>, {}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Disconnecting from: [] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] <== disconnect_volume: return (5541ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:01.968263 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:09:02.063373 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:02.063741 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:02.063741 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Attaching volume b2dee0d7-c0cf-46d6-ac05-31b414a13f54 to /dev/vdb
May 28 03:09:02.118618 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:02.128926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:09:02.148447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:02.201555 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:09:02.201866 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:09:02.216047 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:09:02.217473 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fecc:563f', 'fe80::24e9:85ff:fe54:e97b', 'fe80::fc16:3eff:feab:c480', 'fe80::3073:48ff:fe9d:fe6f', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe1c:b4b2', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:09:02.217638 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:09:02.217740 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:09:02.217948 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:02.218161 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Updating existing volume attachment record: 29e25ec7-9efd-4f0b-8509-59a7bd38eb34 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:09:02.387012 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-changed-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:02.387514 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Refreshing instance network info cache due to event network-changed-d8858067-1d26-4553-ba2d-4341e6450d66. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:02.387760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] Acquiring lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:02.387854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] Acquired lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:02.388037 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Refreshing network info cache for port d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:02.440584 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Attempting to attach volume cffb3082-5b97-416e-a3ae-a7e93385154a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:09:02.442558 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:09:02.442558 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:02.442558 np0000001589 nova-compute[98297]:   <alias name="ua-cffb3082-5b97-416e-a3ae-a7e93385154a"/>
May 28 03:09:02.442558 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:09:02.442558 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:02.442558 np0000001589 nova-compute[98297]:   <serial>cffb3082-5b97-416e-a3ae-a7e93385154a</serial>
May 28 03:09:02.442558 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:09:02.442558 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:02.442558 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:09:02.614991 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54e8e644-06c8-4275-8d82-5c01cf465098 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.622s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:02.768088 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:09:02.768658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:02.768658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:02.769032 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:02.769195 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:09:02.780158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:02.780765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:02.780990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:02.781185 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:02.781533 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:02.781646 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:02.795342 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:02.795342 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:02.802335 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:02.802335 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:02.810599 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54] added
May 28 03:09:02.810599 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:02.810599 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:02.810599 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:02.810599 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:02.810599 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:02.810599 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:02.810864 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:02.811112 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:02.811112 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:02.814318 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54] added
May 28 03:09:02.814318 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:02.814318 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:02.814318 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:02.814318 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:02.814318 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:02.814318 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:02.814638 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:02.814814 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.033(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:02.814919 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:02.890778 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:02.895734 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:03.154294 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Preparing to wait for external event volume-reimaged-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:09:03.154691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:03.154691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:03.154770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:03.225547 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:03.357743 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Updated VIF entry in instance network info cache for port d8858067-1d26-4553-ba2d-4341e6450d66. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:09:03.357743 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Updating instance_info_cache with network_info: [{"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:03.811530 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:03.815381 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:03.823079 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:03.823079 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:03.829578 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:03.829578 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.836061 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.842249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.851586 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.851858 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:03.860743 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a563738e-95a8-470a-991e-b18dd8875951 req-4c685cc6-66b7-43b4-99cd-06cf4cd84d2d service nova] Releasing lock "refresh_cache-1d86d49f-8fd0-4682-b508-abb1b434b002" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.861292 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.861571 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:03.898248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.40.100,3260]
May 28 03:09:03.898248 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.40.100,3260] successful.
May 28 03:09:03.898248 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.904821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.50.100,3260]
May 28 03:09:03.904821 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.50.100,3260] successful.
May 28 03:09:03.904821 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.911073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.916190 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.930468 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.930764 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:03.930961 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:03.931103 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:03.932276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] HCTL ('11', '-', '-', 0) found on session 106 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:03.932451 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.932987 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:03.933358 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:03.933753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:03.933753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:03.934547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] HCTL ('16', '-', '-', 0) found on session 107 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:03.934659 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:03.944957 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Searching for a device in session 106 and hctl ['11', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:03.961891 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Searching for a device in session 107 and hctl ['16', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:04.099344 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:04.099682 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:04.099918 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:04.100052 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:39:93:33, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:04.945059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Searching for a device in session 106 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:04.945596 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:04.950826 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Searching for a device in session 107 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:04.950986 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:05.310477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:05.310823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:05.643132 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-52a16b92-d5d7-4e0c-9c64-e871fc7e0747 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.248s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:05.781524 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:09:05.814145 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:06.232477 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:06.796501 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Found WWN 330000000a50a3f23 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:09:06.796723 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:06.796860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '330000000a50a3f23', 'path': '/dev/dm-2', 'multipath_id': '330000000a50a3f23'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:06.796962 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a50a3f23', 'path': '/dev/dm-2', 'multipath_id': '330000000a50a3f23'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:09:06.798764 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lazy-loading 'flavor' on Instance uuid 021bf930-a793-4075-893e-af588958bc9b {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:06.821520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:06.854690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:06.854871 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:07.301556 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Attempting to attach volume b2dee0d7-c0cf-46d6-ac05-31b414a13f54 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:09:07.302574 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:09:07.302574 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:07.302574 np0000001589 nova-compute[98297]:   <alias name="ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54"/>
May 28 03:09:07.302574 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:09:07.302574 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:07.302574 np0000001589 nova-compute[98297]:   <serial>b2dee0d7-c0cf-46d6-ac05-31b414a13f54</serial>
May 28 03:09:07.302574 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:07.302574 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:09:07.357448 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Detaching volume 733b7727-b78c-4351-8ebf-b27cf59b75fe
May 28 03:09:07.413824 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Attempting to driver detach volume 733b7727-b78c-4351-8ebf-b27cf59b75fe from mountpoint /dev/vdb
May 28 03:09:07.419129 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-733b7727-b78c-4351-8ebf-b27cf59b75fe {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:07.421185 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Found disk vdb by alias ua-733b7727-b78c-4351-8ebf-b27cf59b75fe {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:07.421185 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Attempting to detach device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:09:07.421499 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:07.421499 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:07.421499 np0000001589 nova-compute[98297]:   <alias name="ua-733b7727-b78c-4351-8ebf-b27cf59b75fe"/>
May 28 03:09:07.421499 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:09:07.421499 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:07.421499 np0000001589 nova-compute[98297]:   <serial>733b7727-b78c-4351-8ebf-b27cf59b75fe</serial>
May 28 03:09:07.421499 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:07.421499 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:07.421499 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:07.428038 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the persistent domain config.
May 28 03:09:07.428569 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] (1/8): Attempting to detach device vdb with device alias ua-733b7727-b78c-4351-8ebf-b27cf59b75fe from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:09:07.428865 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:07.428865 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:07.428865 np0000001589 nova-compute[98297]:   <alias name="ua-733b7727-b78c-4351-8ebf-b27cf59b75fe"/>
May 28 03:09:07.428865 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:09:07.428865 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:07.428865 np0000001589 nova-compute[98297]:   <serial>733b7727-b78c-4351-8ebf-b27cf59b75fe</serial>
May 28 03:09:07.428865 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:07.428865 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:07.428865 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:07.899150 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:07.899284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:07.899539 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:07.899608 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Attaching volume cffb3082-5b97-416e-a3ae-a7e93385154a to /dev/vdb
May 28 03:09:07.947154 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:07.948245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937747.9479287, 7aaca677-0143-4ffd-8206-e47614601132 => ua-733b7727-b78c-4351-8ebf-b27cf59b75fe> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:09:07.950402 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-733b7727-b78c-4351-8ebf-b27cf59b75fe for instance 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:09:07.954961 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully detached device vdb from instance 7aaca677-0143-4ffd-8206-e47614601132 from the live domain config.
May 28 03:09:07.957738 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:09:07.957876 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '733b7727-b78c-4351-8ebf-b27cf59b75fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:07.957963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:07.958450 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:09:07.992086 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:08.048317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:09:08.048586 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:09:08.059296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:09:08.066015 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fecc:563f', 'fe80::24e9:85ff:fe54:e97b', 'fe80::fc16:3eff:feab:c480', 'fe80::3073:48ff:fe9d:fe6f', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe1c:b4b2', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:09:08.066378 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:09:08.066552 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:09:08.067217 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:08.067680 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updating existing volume attachment record: 1e031605-45e8-49f9-925e-6e73653a3543 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:09:08.629454 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:09:08.629858 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:08.629981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:08.973257 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:08.973435 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:08.973499 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:08.973571 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No VIF found with MAC fa:16:3e:cc:56:3f, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:09.018573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.060s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:09.019746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '733b7727-b78c-4351-8ebf-b27cf59b75fe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:09:09.019746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.059949 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsi session list stdout=tcp: [102] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [103] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.060518 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', '102'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '107'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '108'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '98')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:09:09.060518 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', '102')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:09.062256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe', '103')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:09.062256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4069b380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:09:09.062459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:09:09.063059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Flush multipath device 33000000072bf737c {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:09:09.105549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:09.163747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:09.222127 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:09:09.222449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:09:09.224817 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:09:09.236966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:09:09.237325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:09:09.249995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.288130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.40.100,3260]
May 28 03:09:09.288130 np0000001589 nova-compute[98297]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.40.100,3260] successful.
May 28 03:09:09.288130 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.307158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.317812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.347964 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.50.100,3260]
May 28 03:09:09.347964 np0000001589 nova-compute[98297]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-733b7727-b78c-4351-8ebf-b27cf59b75fe, portal: 192.168.50.100,3260] successful.
May 28 03:09:09.347964 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.365958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.366208 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:09.366511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] <== disconnect_volume: return (1408ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:09.366637 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:09:09.369078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.738s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:09.369428 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:09:09.381326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:09.381973 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:09.383119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:09.383119 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:09.383119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:09.383339 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:09.396362 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:09.396362 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.402457 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:09.402678 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:09.403689 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Shelve offloading
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:09.405168 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:09.405168 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.413555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.421616 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.430696 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.430990 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:09.431422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:09.431422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:09.432048 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('9', '0', '0', 0) found on session 104 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:09.432185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.438219 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:09.438539 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:09.438851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:09.438921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:09.439748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('10', '0', '0', 0) found on session 105 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:09.439896 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:09.447857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 104 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:09.448051 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:09.449867 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 105 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:09.450063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:09.946619 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'flavor' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:10.383867 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:09:10.446408 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:10.453611 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:10.475598 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:10.475598 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:10.512807 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:10.537567 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-08bebe68-b789-42b1-82a6-1156de7b9d61 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.474s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:10.622491 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b110630c-434d-42ca-bfce-86cdc67799e2 req-dcbed20b-a7d8-4967-86f7-442f7ebd530f service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:10.623378 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b110630c-434d-42ca-bfce-86cdc67799e2 req-dcbed20b-a7d8-4967-86f7-442f7ebd530f service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:10.623577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b110630c-434d-42ca-bfce-86cdc67799e2 req-dcbed20b-a7d8-4967-86f7-442f7ebd530f service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:10.625046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b110630c-434d-42ca-bfce-86cdc67799e2 req-dcbed20b-a7d8-4967-86f7-442f7ebd530f service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:10.625560 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b110630c-434d-42ca-bfce-86cdc67799e2 req-dcbed20b-a7d8-4967-86f7-442f7ebd530f service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] No waiting events found dispatching network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:10.626478 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-b110630c-434d-42ca-bfce-86cdc67799e2 req-dcbed20b-a7d8-4967-86f7-442f7ebd530f service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received unexpected event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 for instance with vm_state active and task_state shelving.
May 28 03:09:10.761173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:10.776187 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:10.790644 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999414680999962 future=<Future at 0x7e4b40577830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:10.790950 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99660162500004 future=<Future at 0x7e4b40577830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:10.791071 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.996469889999844 future=<Future at 0x7e4b40577830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:10.792105 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance destroyed successfully.
May 28 03:09:10.792639 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'numa_topology' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:10.805267 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event volume-extended-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:10.965210 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4b964453-1258-45e5-84eb-afbd46cbdca7 tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.110s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:11.233396 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:11.295288 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:11.303470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:11.303608 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:11.304321 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:09:11.307416 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Handling volume-extended event for volume b2dee0d7-c0cf-46d6-ac05-31b414a13f54 {{(pid=98297) extend_volume /opt/stack/nova/nova/compute/manager.py:11836}}
May 28 03:09:11.407846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 33000000011193771 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:09:11.408759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:11.409144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (2779ms) {'type': 'block', 'scsi_wwn': '33000000011193771', 'path': '/dev/dm-1', 'multipath_id': '33000000011193771'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:11.409526 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000011193771', 'path': '/dev/dm-1', 'multipath_id': '33000000011193771'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:09:11.414728 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:11.811319 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:11.818569 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Cinder extended volume b2dee0d7-c0cf-46d6-ac05-31b414a13f54; extending it to detect new size
May 28 03:09:11.933711 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Attempting to attach volume cffb3082-5b97-416e-a3ae-a7e93385154a with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:09:11.938663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:09:11.938663 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:11.938663 np0000001589 nova-compute[98297]:   <alias name="ua-cffb3082-5b97-416e-a3ae-a7e93385154a"/>
May 28 03:09:11.938663 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:09:11.938663 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:11.938663 np0000001589 nova-compute[98297]:   <serial>cffb3082-5b97-416e-a3ae-a7e93385154a</serial>
May 28 03:09:11.938663 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:09:11.938663 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:11.938663 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:09:12.235665 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:12.364045 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] calling os-brick to extend iSCSI Volume {{(pid=98297) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 28 03:09:12.365087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}), 'kwargs': {}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:12.365087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:12.365087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:12.365339 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}
May 28 03:09:12.365464 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Multipath discovery for iSCSI enabled
May 28 03:09:12.365648 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0']
May 28 03:09:12.365781 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0'] {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 28 03:09:12.390399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0'] {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 28 03:09:12.390689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Running cmd (subprocess): lsscsi {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:12.423290 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:12.440000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] CMD "lsscsi" returned: 0 in 0.049s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:12.440473 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98297) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 03:09:12.440666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 03:09:12.450374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Starting size: 1073741824 {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 03:09:12.488078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] volume size after scsi device rescan 2147483648 {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 03:09:12.488402 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Running cmd (subprocess): lsscsi {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:12.543822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] CMD "lsscsi" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:12.545995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0', 'host': '16', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98297) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 28 03:09:12.545995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54-lun-0', 'host': '16', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 28 03:09:12.558314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Starting size: 1073741824 {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 28 03:09:12.585415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] volume size after scsi device rescan 2147483648 {{(pid=98297) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 28 03:09:12.605947 np0000001589 nova-compute[98297]: INFO os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Find Multipath device file for volume WWN 330000000a50a3f23
May 28 03:09:12.605947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000a50a3f23 exists yet. {{(pid=98297) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 28 03:09:12.605947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] /dev/disk/by-id/dm-uuid-mpath-330000000a50a3f23 has shown up. {{(pid=98297) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 28 03:09:12.649936 np0000001589 nova-compute[98297]: INFO os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000a50a3f23) current size 1073741824
May 28 03:09:12.747039 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-803ffc3f-5dd6-4484-bf41-1170bece7fbc req-dc74f1bc-a238-4156-a774-35576b544ee8 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:12.747771 np0000001589 nova-compute[98297]: INFO os_brick.initiator.linuxscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000a50a3f23) new size 2147483648
May 28 03:09:12.749589 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-803ffc3f-5dd6-4484-bf41-1170bece7fbc req-dc74f1bc-a238-4156-a774-35576b544ee8 service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:12.752398 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.385s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:12.752398 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] <== extend_volume: return (387ms) 2147483648 {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:12.753676 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-803ffc3f-5dd6-4484-bf41-1170bece7fbc req-dc74f1bc-a238-4156-a774-35576b544ee8 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:12.754388 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Extend iSCSI Volume: new_size=2147483648 {{(pid=98297) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 28 03:09:12.755527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-803ffc3f-5dd6-4484-bf41-1170bece7fbc req-dc74f1bc-a238-4156-a774-35576b544ee8 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:12.755768 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-803ffc3f-5dd6-4484-bf41-1170bece7fbc req-dc74f1bc-a238-4156-a774-35576b544ee8 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] No waiting events found dispatching network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:12.756022 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-803ffc3f-5dd6-4484-bf41-1170bece7fbc req-dc74f1bc-a238-4156-a774-35576b544ee8 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received unexpected event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 for instance with vm_state active and task_state shelving.
May 28 03:09:12.759971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [req-edfeb655-6afe-4078-b318-887f8e68ec8f req-92406021-675a-426b-8eca-9dc3d8e9aebe service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Resizing target device /dev/dm-2 to 2147483648 {{(pid=98297) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 28 03:09:12.907532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:12.931879 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:12.933325 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:12.933708 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:13.526649 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance destroyed successfully.
May 28 03:09:13.527157 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'resources' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:13.550914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:13.551097 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:13.614977 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:13.617252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:13.617252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:13.617252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:12:88:e0, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:14.029787 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Object Instance<c792127f-b33e-48b3-8da7-ba4bd8ebeac0> lazy-loaded attributes: numa_topology,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:09:14.030716 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1722686750',display_name='tempest-TestShelveInstance-server-1722686750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testshelveinstance-server-1722686750',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRA+otnkfm7lbFsCKUzuGvqR+nbstrjEvckiUyG3QiLHC4l387rAxGfMMadCii8UDww36pB8lIkDSWkmlCz6/E47NEFRnn5NaQ3xMdlL4vFWn8T/60SSfxtyUXxMofy7A==',key_name='tempest-TestShelveInstance-1678016135',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:08:28Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b61f52dbd3ed46f4814f2c0b132c713d',ramdisk_id='',reservation_id='r-t5rvslrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1399725326',owner_user_name='tempest-TestShelveInstance-1399725326-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:08:29Z,user_data=None,user_id='1be2b4e542c34494a4052b18a1cea270',uuid=c792127f-b33e-48b3-8da7-ba4bd8ebeac0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:09:14.030935 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converting VIF {"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:14.031729 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:14.032007 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:09:14.033565 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:14.033825 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc68665e-2e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:14.044959 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:14.045847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:14.047681 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:14.049737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:14.049884 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6d59533-0fc1-4ee9-aa57-4749a4fc8028) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:14.050523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:14.051144 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:14.054741 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Detaching volume b2dee0d7-c0cf-46d6-ac05-31b414a13f54
May 28 03:09:14.057758 np0000001589 nova-compute[98297]: INFO os_vif [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e')
May 28 03:09:14.059371 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:09:14.059782 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:14.059955 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:14.099606 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Attempting to driver detach volume b2dee0d7-c0cf-46d6-ac05-31b414a13f54 from mountpoint /dev/vdb
May 28 03:09:14.105750 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Found disk vdb by alias ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:14.107469 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Found disk vdb by alias ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:14.107658 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Attempting to detach device vdb from instance 021bf930-a793-4075-893e-af588958bc9b from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:09:14.108021 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:14.108021 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:14.108021 np0000001589 nova-compute[98297]:   <alias name="ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54"/>
May 28 03:09:14.108021 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:09:14.108021 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:14.108021 np0000001589 nova-compute[98297]:   <serial>b2dee0d7-c0cf-46d6-ac05-31b414a13f54</serial>
May 28 03:09:14.108021 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:14.108021 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:14.108021 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:14.120030 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Successfully detached device vdb from instance 021bf930-a793-4075-893e-af588958bc9b from the persistent domain config.
May 28 03:09:14.120238 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] (1/8): Attempting to detach device vdb with device alias ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 from instance 021bf930-a793-4075-893e-af588958bc9b from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:09:14.120609 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:14.120609 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:14.120609 np0000001589 nova-compute[98297]:   <alias name="ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54"/>
May 28 03:09:14.120609 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:09:14.120609 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:14.120609 np0000001589 nova-compute[98297]:   <serial>b2dee0d7-c0cf-46d6-ac05-31b414a13f54</serial>
May 28 03:09:14.120609 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:14.120609 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:14.120609 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:14.615658 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937754.6152132, 021bf930-a793-4075-893e-af588958bc9b => ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:09:14.616896 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 for instance 021bf930-a793-4075-893e-af588958bc9b {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:09:14.618675 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Successfully detached device vdb from instance 021bf930-a793-4075-893e-af588958bc9b from the live domain config.
May 28 03:09:14.619857 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:09:14.620106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:14.620240 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:14.712915 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.653s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:14.713254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:09:14.713411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:14.742525 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:14.742977 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '98')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:09:14.742977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '97')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:14.743919 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '98')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:14.744899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4057b4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'): ({'sdj'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:09:14.745145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Removing multipathed devices sdj, sdi {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:09:14.745546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Flush multipath device 330000000436e0942 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:09:14.812594 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:14.812729 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing instance network info cache due to event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:14.812898 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:14.812976 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:14.813071 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:14.817289 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:14.857425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:14.905753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Checking to see if SCSI volumes sdj, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:09:14.905892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] SCSI volumes sdj, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:09:14.907031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Checking to see if device paths {'sdj', 'sdi'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:09:14.917367 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Device paths {'sdj', 'sdi'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:09:14.917557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:09:14.927674 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:14.970165 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260]
May 28 03:09:14.970165 np0000001589 nova-compute[98297]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260] successful.
May 28 03:09:14.970165 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:14.989070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.001113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.042163 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260]
May 28 03:09:15.042163 np0000001589 nova-compute[98297]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260] successful.
May 28 03:09:15.042163 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.059510 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.059690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:15.059815 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] <== disconnect_volume: return (1000ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:15.059926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:09:15.060174 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Deleting instance files /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0_del
May 28 03:09:15.060675 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Deletion of /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0_del complete
May 28 03:09:15.062766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.442s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:15.062824 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:09:15.062971 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:15.090098 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: tcp: [106] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: tcp: [107] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54 (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: tcp: [109] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:15.090409 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:15.090409 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '106'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '107'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '109'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '110'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:09:15.090611 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '106')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:15.091382 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', '107')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:15.092076 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40578860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'): ({'sdk'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:09:15.092076 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Removing multipathed devices sdf, sdk {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:09:15.092311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Flush multipath device 330000000a50a3f23 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:09:15.129587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:15.175121 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:15.177852 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c716e552-6519-4eec-a3ed-985c93c53544 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.278s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:15.224996 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Checking to see if SCSI volumes sdf, sdk have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:09:15.225259 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] SCSI volumes sdf, sdk have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:09:15.226990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Checking to see if device paths {'sdf', 'sdk'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:09:15.242206 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Device paths {'sdf', 'sdk'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:09:15.242322 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:09:15.256991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.298498 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 106, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.40.100,3260]
May 28 03:09:15.298498 np0000001589 nova-compute[98297]: Logout of [sid: 106, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.40.100,3260] successful.
May 28 03:09:15.298498 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.315332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.319072 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:15.333425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.375092 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 107, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.50.100,3260]
May 28 03:09:15.375092 np0000001589 nova-compute[98297]: Logout of [sid: 107, target: iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, portal: 192.168.50.100,3260] successful.
May 28 03:09:15.375092 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.393768 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:15.394000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:15.394159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] <== disconnect_volume: return (773ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:15.394353 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:09:15.675259 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:15.799245 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updated VIF entry in instance network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:09:15.799245 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": null, "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdc68665e-2e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:15.951809 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lazy-loading 'flavor' on Instance uuid 021bf930-a793-4075-893e-af588958bc9b {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:16.061104 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:16.061391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:16.300961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4fb42375-b8ec-44ca-9d73-8afee9738980 req-4775b127-3fe2-4a0d-b0e2-8589a9ccc7a9 service nova] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:16.566679 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Detaching volume cffb3082-5b97-416e-a3ae-a7e93385154a
May 28 03:09:16.635894 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Attempting to driver detach volume cffb3082-5b97-416e-a3ae-a7e93385154a from mountpoint /dev/vdb
May 28 03:09:16.645667 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:16.647343 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:16.647861 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Attempting to detach device vdb from instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:09:16.647861 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:   <alias name="ua-cffb3082-5b97-416e-a3ae-a7e93385154a"/>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:   <serial>cffb3082-5b97-416e-a3ae-a7e93385154a</serial>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:16.647861 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:16.655751 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 from the persistent domain config.
May 28 03:09:16.656012 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] (1/8): Attempting to detach device vdb with device alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a from instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:09:16.656258 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:   <alias name="ua-cffb3082-5b97-416e-a3ae-a7e93385154a"/>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:   <serial>cffb3082-5b97-416e-a3ae-a7e93385154a</serial>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:16.656258 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:16.761677 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Deleted allocations for instance c792127f-b33e-48b3-8da7-ba4bd8ebeac0
May 28 03:09:16.960951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4816ad8f-365e-45bb-bf54-a33b5177f19a tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.410s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:17.002155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:17.002388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:17.002719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:17.002911 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:17.003058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:17.005791 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Terminating instance
May 28 03:09:17.145085 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937757.1447644, b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 => ua-cffb3082-5b97-416e-a3ae-a7e93385154a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:09:17.145357 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a for instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:09:17.147386 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 from the live domain config.
May 28 03:09:17.268736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:17.270278 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:17.509541 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:09:17.529353 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:17.538527 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:17.555971 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:17.584446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:17.688646 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Detected multiple connections on this host for volume: cffb3082-5b97-416e-a3ae-a7e93385154a, skipping target disconnect.
May 28 03:09:17.697259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fcc26ef1-8bfb-4a93-b2b0-04d4355101e7 req-0c37794e-e051-4eba-b276-4bb7297a9168 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-vif-unplugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:17.697433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fcc26ef1-8bfb-4a93-b2b0-04d4355101e7 req-0c37794e-e051-4eba-b276-4bb7297a9168 service nova] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:17.697590 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fcc26ef1-8bfb-4a93-b2b0-04d4355101e7 req-0c37794e-e051-4eba-b276-4bb7297a9168 service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:17.697732 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fcc26ef1-8bfb-4a93-b2b0-04d4355101e7 req-0c37794e-e051-4eba-b276-4bb7297a9168 service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:17.697871 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fcc26ef1-8bfb-4a93-b2b0-04d4355101e7 req-0c37794e-e051-4eba-b276-4bb7297a9168 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] No waiting events found dispatching network-vif-unplugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:17.698250 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fcc26ef1-8bfb-4a93-b2b0-04d4355101e7 req-0c37794e-e051-4eba-b276-4bb7297a9168 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-vif-unplugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:09:17.706785 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:17.707005 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:17.764459 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc2806a5-c604-4af9-9797-80248d96e0c9 req-986d2899-b126-4450-90ae-a75801bd8c95 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event volume-reimaged-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:17.764838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc2806a5-c604-4af9-9797-80248d96e0c9 req-986d2899-b126-4450-90ae-a75801bd8c95 service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:17.765002 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc2806a5-c604-4af9-9797-80248d96e0c9 req-986d2899-b126-4450-90ae-a75801bd8c95 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:17.765110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dc2806a5-c604-4af9-9797-80248d96e0c9 req-986d2899-b126-4450-90ae-a75801bd8c95 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:17.768630 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dc2806a5-c604-4af9-9797-80248d96e0c9 req-986d2899-b126-4450-90ae-a75801bd8c95 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Processing event volume-reimaged-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:09:17.770294 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance event wait completed in 14 seconds for volume-reimaged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:09:17.833484 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:17.855103 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999720929999967 future=<Future at 0x7e4b64588f20 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:17.857760 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 021bf930-a793-4075-893e-af588958bc9b] Instance destroyed successfully.
May 28 03:09:17.857898 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lazy-loading 'resources' on Instance uuid 021bf930-a793-4075-893e-af588958bc9b {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:17.909924 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:18.209649 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:18.242682 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:18.275607 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Booting with volume 567fb5dd-f8c4-4085-80cd-a3709b2f4c65 at /dev/vda
May 28 03:09:18.320031 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:18.331618 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:09:18.351866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:18.364949 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-417171573',display_name='tempest-VolumesExtendAttachedTest-instance-417171573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesextendattachedtest-instance-417171573',id=37,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiJWzRjEfRgVOJ6JCWJrSQtlc6ndL3HHn97FR6UQDSy9SHOHh0q4An2q/1yB5ojOSkk2sFefjv0HrZ9uPHUgID9jdJHfolS0Chfy5kcNrlR44hXgWnYU4Hu5YeMYTy5pA==',key_name='tempest-keypair-46214365',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:08:20Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='528e86ab455d438bbf2f6d21a401e580',ramdisk_id='',reservation_id='r-qoy1nzng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-470485844',owner_user_name='tempest-VolumesExtendAttachedTest-470485844-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:08:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c0271f7e2e254067b3e5cadb9d232f04',uuid=021bf930-a793-4075-893e-af588958bc9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:09:18.365158 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Converting VIF {"id": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "address": "fa:16:3e:cc:56:3f", "network": {"id": "82136fb9-c9e0-4dcb-80c0-e0a912f926d1", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1940376960-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "528e86ab455d438bbf2f6d21a401e580", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32fc28df-a6", "ovs_interfaceid": "32fc28df-a6de-4eb8-8b65-2705be0d9eb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:18.366193 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:56:3f,bridge_name='br-int',has_traffic_filtering=True,id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3,network=Network(82136fb9-c9e0-4dcb-80c0-e0a912f926d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32fc28df-a6') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:18.366512 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:56:3f,bridge_name='br-int',has_traffic_filtering=True,id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3,network=Network(82136fb9-c9e0-4dcb-80c0-e0a912f926d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32fc28df-a6') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:09:18.372051 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:18.372051 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32fc28df-a6, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:18.373524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:18.375023 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:18.375920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:18.376165 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49312030-5d5b-41bb-bdb0-0e4b08e4cbdc) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:18.377194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:18.377862 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:18.379647 np0000001589 nova-compute[98297]: INFO os_vif [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:56:3f,bridge_name='br-int',has_traffic_filtering=True,id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3,network=Network(82136fb9-c9e0-4dcb-80c0-e0a912f926d1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32fc28df-a6')
May 28 03:09:18.382638 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:09:18.383716 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:18.383901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:18.389889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:09:18.390165 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:09:18.399037 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:09:18.400197 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb4:4ed6', 'fe80::545a:e5ff:fe25:2b5c', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe1c:b4b2', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:09:18.400382 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:09:18.400514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:09:18.400751 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:18.400945 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Updating existing volume attachment record: 34fd4463-1853-4d6d-a412-df034c746a04 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:09:18.715842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.446s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:19.152937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:19.153411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:19.153411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:19.153661 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:19.153816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:19.155817 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Terminating instance
May 28 03:09:19.173600 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:19.225546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a13767e6-82a8-478f-b7fd-74627f366859 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.823s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:19.226362 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.052s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:19.226501 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Unshelving
May 28 03:09:19.248877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5be39054-2d8b-4748-9c11-2951fe96588f tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.187s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:19.430216 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:19.430372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:19.638260 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.254s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:19.638783 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:09:19.639016 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:09:19.658804 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:09:19.667734 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:19.667734 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:19.667734 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:19.667734 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:19.667734 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:19.667734 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:19.667967 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:19.667967 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:19.667967 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:19.667967 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:19.667967 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:19.667967 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:19.668145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:09:19.668145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:19.668375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:09:19.668375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:19.668517 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b2dee0d7-c0cf-46d6-ac05-31b414a13f54') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:09:19.668577 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646ba160>, {}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:09:19.675145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Disconnecting from: [] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:09:19.675145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:19.675145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] <== disconnect_volume: return (1285ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:19.675145 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:09:19.675145 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Deleting instance files /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b_del
May 28 03:09:19.675145 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Deletion of /opt/stack/data/nova/instances/021bf930-a793-4075-893e-af588958bc9b_del complete
May 28 03:09:19.684627 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:19.706092 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:19.712481 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:19.730684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:19.736148 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:19.768912 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-06631b4f-8567-44e8-be7f-7dd5a52b4994 req-33c035ab-b0ac-491d-8fb1-baecd284850f service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-vif-unplugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:19.769299 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-06631b4f-8567-44e8-be7f-7dd5a52b4994 req-33c035ab-b0ac-491d-8fb1-baecd284850f service nova] Acquiring lock "021bf930-a793-4075-893e-af588958bc9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:19.769496 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-06631b4f-8567-44e8-be7f-7dd5a52b4994 req-33c035ab-b0ac-491d-8fb1-baecd284850f service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:19.769627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-06631b4f-8567-44e8-be7f-7dd5a52b4994 req-33c035ab-b0ac-491d-8fb1-baecd284850f service nova] Lock "021bf930-a793-4075-893e-af588958bc9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:19.769776 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-06631b4f-8567-44e8-be7f-7dd5a52b4994 req-33c035ab-b0ac-491d-8fb1-baecd284850f service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] No waiting events found dispatching network-vif-unplugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:19.769917 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-06631b4f-8567-44e8-be7f-7dd5a52b4994 req-33c035ab-b0ac-491d-8fb1-baecd284850f service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-vif-unplugged-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:09:19.850065 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8aa7a2c9-8b4d-45c5-b009-6317447c16e5 req-0e1ac1b1-1bb9-48f8-9a45-e4a82a8266ec service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-vif-unplugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:19.850885 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8aa7a2c9-8b4d-45c5-b009-6317447c16e5 req-0e1ac1b1-1bb9-48f8-9a45-e4a82a8266ec service nova] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:19.851136 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8aa7a2c9-8b4d-45c5-b009-6317447c16e5 req-0e1ac1b1-1bb9-48f8-9a45-e4a82a8266ec service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:19.851361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8aa7a2c9-8b4d-45c5-b009-6317447c16e5 req-0e1ac1b1-1bb9-48f8-9a45-e4a82a8266ec service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:19.851556 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8aa7a2c9-8b4d-45c5-b009-6317447c16e5 req-0e1ac1b1-1bb9-48f8-9a45-e4a82a8266ec service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] No waiting events found dispatching network-vif-unplugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:19.851835 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8aa7a2c9-8b4d-45c5-b009-6317447c16e5 req-0e1ac1b1-1bb9-48f8-9a45-e4a82a8266ec service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-vif-unplugged-3c087db3-1b24-4587-ae88-e36dceb37f8f for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:09:19.934163 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Detaching volume cffb3082-5b97-416e-a3ae-a7e93385154a
May 28 03:09:20.009053 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Attempting to driver detach volume cffb3082-5b97-416e-a3ae-a7e93385154a from mountpoint /dev/vdb
May 28 03:09:20.017317 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999712263999754 future=<Future at 0x7e4b40616780 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:20.018523 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Instance destroyed successfully.
May 28 03:09:20.019076 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lazy-loading 'resources' on Instance uuid 7aaca677-0143-4ffd-8206-e47614601132 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:20.021382 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:20.024017 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:20.026115 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Attempting to detach device vdb from instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:09:20.026115 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:   <alias name="ua-cffb3082-5b97-416e-a3ae-a7e93385154a"/>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:   <serial>cffb3082-5b97-416e-a3ae-a7e93385154a</serial>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:20.026115 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:20.030885 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 from the persistent domain config.
May 28 03:09:20.031051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] (1/8): Attempting to detach device vdb with device alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a from instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:09:20.031210 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:   <alias name="ua-cffb3082-5b97-416e-a3ae-a7e93385154a"/>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:   <serial>cffb3082-5b97-416e-a3ae-a7e93385154a</serial>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:20.031210 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:20.175985 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Took 2.67 seconds to destroy the instance on the hypervisor.
May 28 03:09:20.176863 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:09:20.177726 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 021bf930-a793-4075-893e-af588958bc9b] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:09:20.177941 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 021bf930-a793-4075-893e-af588958bc9b] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:09:20.178256 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:20.245211 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Booting with volume 95f8b2ce-63a6-4f18-92fd-0866d9c3a24a at /dev/vda
May 28 03:09:20.267709 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:20.331967 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:20.342448 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:09:20.364046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:20.419143 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:09:20.419323 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:09:20.431169 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:09:20.432240 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe1c:b4b2', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:09:20.432369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:09:20.432455 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:09:20.432968 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:20.432968 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating existing volume attachment record: e0a8a349-5d2c-4807-b5aa-9141d041d3d6 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:09:20.489873 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:09:20.490165 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Creating image(s)
May 28 03:09:20.490576 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:09:20.490756 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Ensure instance console log exists: /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:09:20.491060 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:20.491308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:20.491497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:20.492181 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Start _get_guest_xml network_info=[{"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T02:57:49Z,direct_url=<?>,disk_format='qcow2',id=fa0eb55a-2d07-4302-93b3-8cc680ecbfc7,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T02:57:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '34fd4463-1853-4d6d-a412-df034c746a04', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'bbe1fdbc-f534-444c-8ad2-982bf5108932', 'attached_at': '', 'detached_at': '', 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'serial': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:09:20.495300 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 28 03:09:20.496653 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-684942754', uuid='bbe1fdbc-f534-444c-8ad2-982bf5108932'), owner=OwnerMeta(userid='1f776b52236043fb9455d1ec9a21c765', username='tempest-ServerActionsV293TestJSON-1182810107-project-member', projectid='f4892c2979f14a6dbc055d3e2d359bfa', projectname='tempest-ServerActionsV293TestJSON-1182810107'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937760.496193) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:09:20.497693 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:09:20.498092 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:09:20.498880 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:09:20.499076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:09:20.499974 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:09:20.500235 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-28T02:57:49Z,direct_url=<?>,disk_format='qcow2',id=fa0eb55a-2d07-4302-93b3-8cc680ecbfc7,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-28T02:57:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:09:20.500431 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:09:20.500524 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:09:20.500675 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:09:20.500786 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:09:20.500908 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:09:20.501099 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:09:20.501235 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:09:20.501398 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:09:20.501532 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:09:20.501748 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:09:20.501862 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lazy-loading 'vcpu_model' on Instance uuid bbe1fdbc-f534-444c-8ad2-982bf5108932 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:20.521993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1612521818',display_name='tempest-SnapshotDataIntegrityTests-server-1612521818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-snapshotdataintegritytests-server-1612521818',id=29,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMuq7EtsCr7amxzbNook/UsIVApikWXdLv/f3GEVgcHYOVYE9T5FAHgY3DjaxT2+djl6yBEulP8ER2flSKQtBhbUnHX3TudxBMme/fsu/6FO/uVB/tIPQWFoFDNa+IBgA==',key_name='tempest-keypair-479045458',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:06:40Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80ff1bde877e4c3d9883c34167e979ce',ramdisk_id='',reservation_id='r-a9ujc4w7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1722793703',owner_user_name='tempest-SnapshotDataIntegrityTests-1722793703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='789a34f4e22e4235b9437415b1b4295f',uuid=7aaca677-0143-4ffd-8206-e47614601132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:09:20.522285 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Converting VIF {"id": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "address": "fa:16:3e:b4:4e:d6", "network": {"id": "7db0c81f-9026-4a18-9d89-174bcfbaed72", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-662282495-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "80ff1bde877e4c3d9883c34167e979ce", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c087db3-1b", "ovs_interfaceid": "3c087db3-1b24-4587-ae88-e36dceb37f8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:20.523115 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=3c087db3-1b24-4587-ae88-e36dceb37f8f,network=Network(7db0c81f-9026-4a18-9d89-174bcfbaed72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c087db3-1b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:20.523450 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=3c087db3-1b24-4587-ae88-e36dceb37f8f,network=Network(7db0c81f-9026-4a18-9d89-174bcfbaed72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c087db3-1b') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:09:20.525993 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:20.526508 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c087db3-1b, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:20.539060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:20.540705 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:20.541423 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:20.541620 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c69ad2d1-4f74-4744-acb0-3b6e0ec46547) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:20.542238 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:20.543160 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:20.545829 np0000001589 nova-compute[98297]: INFO os_vif [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=3c087db3-1b24-4587-ae88-e36dceb37f8f,network=Network(7db0c81f-9026-4a18-9d89-174bcfbaed72),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c087db3-1b')
May 28 03:09:20.546184 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Deleting instance files /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132_del
May 28 03:09:20.547005 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Deletion of /opt/stack/data/nova/instances/7aaca677-0143-4ffd-8206-e47614601132_del complete
May 28 03:09:20.781618 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-73150704-09d5-4d19-a5be-cde468ac468e req-85561f68-bae8-40a3-bc6a-a18339c36587 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Received event network-vif-deleted-32fc28df-a6de-4eb8-8b65-2705be0d9eb3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:20.781732 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-73150704-09d5-4d19-a5be-cde468ac468e req-85561f68-bae8-40a3-bc6a-a18339c36587 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Neutron deleted interface 32fc28df-a6de-4eb8-8b65-2705be0d9eb3; detaching it from the instance and deleting it from the info cache
May 28 03:09:20.783432 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-73150704-09d5-4d19-a5be-cde468ac468e req-85561f68-bae8-40a3-bc6a-a18339c36587 service nova] [instance: 021bf930-a793-4075-893e-af588958bc9b] Detach interface failed, port_id=32fc28df-a6de-4eb8-8b65-2705be0d9eb3, reason: Instance 021bf930-a793-4075-893e-af588958bc9b could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:09:21.021076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:09:21.022767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:21.022767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:21.022767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:21.022767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:09:21.035803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:21.036724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:21.037441 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:21.037634 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:21.038002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:21.038185 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:21.051486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:21.051486 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:21.056617 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 03:09:21.057152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:21.057152 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:21.057619 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:09:21.061569 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:09:21.061798 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7aaca677-0143-4ffd-8206-e47614601132] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:09:21.062219 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:21.067903 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65] added
May 28 03:09:21.067903 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:21.067903 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:21.067903 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:21.067903 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:21.067903 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:21.067903 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:21.068246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:21.068382 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:21.068813 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:21.071646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65] added
May 28 03:09:21.071646 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:21.071646 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:21.071646 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:21.071646 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:21.071646 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:21.071646 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:21.071646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:21.071646 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:21.072019 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:21.144893 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:21.224593 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 021bf930-a793-4075-893e-af588958bc9b] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:21.728420 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 021bf930-a793-4075-893e-af588958bc9b] Took 1.55 seconds to deallocate network for instance.
May 28 03:09:21.759065 np0000001589 nova-compute[98297]: WARNING nova.volume.cinder [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Attachment 29e25ec7-9efd-4f0b-8509-59a7bd38eb34 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 29e25ec7-9efd-4f0b-8509-59a7bd38eb34. (HTTP 404) (Request-ID: req-9df705b7-9bad-43e6-b807-1a3db1c6de08)
May 28 03:09:21.759347 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Took 0.03 seconds to detach 1 volumes for instance.
May 28 03:09:21.911437 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-vif-unplugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:21.911633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] Acquiring lock "7aaca677-0143-4ffd-8206-e47614601132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:21.911804 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:21.911931 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] Lock "7aaca677-0143-4ffd-8206-e47614601132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:21.912140 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] No waiting events found dispatching network-vif-unplugged-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:21.912254 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-vif-unplugged-3c087db3-1b24-4587-ae88-e36dceb37f8f for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:09:21.912389 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Received event network-vif-deleted-3c087db3-1b24-4587-ae88-e36dceb37f8f {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:21.912511 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Neutron deleted interface 3c087db3-1b24-4587-ae88-e36dceb37f8f; detaching it from the instance and deleting it from the info cache
May 28 03:09:21.913907 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-11568f07-4d3b-4efe-83ff-5ce7819b4042 req-c8fc37bc-01ae-4727-a3e1-9b9e7e34404e service nova] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Detach interface failed, port_id=3c087db3-1b24-4587-ae88-e36dceb37f8f, reason: Instance 7aaca677-0143-4ffd-8206-e47614601132 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:09:22.069157 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:22.077259 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:22.082038 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:22.082038 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:22.088397 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:22.088397 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.097562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.104494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:22.104654 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:22.105027 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.106095 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'pci_requests' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:22.115065 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.115065 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.115065 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.115065 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.115065 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.115065 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:22.115258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.115258 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.115258 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.115258 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.115258 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.115258 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:22.122554 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.122554 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.122554 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.122554 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.122554 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.122554 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:22.122758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.122758 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.122758 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.122758 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.122758 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.122758 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:22.155659 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260]
May 28 03:09:22.155659 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260] successful.
May 28 03:09:22.155659 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.161185 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:22.166786 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.172454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260]
May 28 03:09:22.172454 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260] successful.
May 28 03:09:22.172454 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.184537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:22.204109 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.204109 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.204109 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.204109 np0000001589 nova-compute[98297]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.204109 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.204109 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.204109 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.204109 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:22.204421 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.204421 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.204421 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.204421 np0000001589 nova-compute[98297]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.204421 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.204421 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.204421 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.204421 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:22.204622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:22.204742 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:22.205847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] HCTL ('11', '-', '-', 0) found on session 113 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:22.205847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:22.233809 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] HCTL ('8', '-', '-', 0) found on session 112 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:22.233809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching for a device in session 113 and hctl ['11', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:22.259051 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching for a device in session 112 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:22.268168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:22.610116 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'numa_topology' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:22.662937 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Took 1.60 seconds to deallocate network for instance.
May 28 03:09:22.917556 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:23.113255 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:09:23.113493 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Claim successful on node np0000001589
May 28 03:09:23.169083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:23.228417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching for a device in session 113 and hctl ['11', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:23.228417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:23.260353 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Searching for a device in session 112 and hctl ['8', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:23.260737 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:23.391374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937763.3903623, 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 => ua-cffb3082-5b97-416e-a3ae-a7e93385154a> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:09:23.391833 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-cffb3082-5b97-416e-a3ae-a7e93385154a for instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:09:23.394913 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 from the live domain config.
May 28 03:09:23.435781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:09:23.436060 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:23.436216 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:24.038471 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:09:24.403966 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:24.404395 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:24.564740 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:24.564942 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:24.907202 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid 8e34a9f9-f4aa-493a-8ca2-6998667e2580 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:25.059514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Found WWN 3300000007c93f769 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:09:25.059746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:25.059898 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '3300000007c93f769', 'path': '/dev/dm-0', 'multipath_id': '3300000007c93f769'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:25.060011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007c93f769', 'path': '/dev/dm-0', 'multipath_id': '3300000007c93f769'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:09:25.060502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.624s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:25.060824 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cffb3082-5b97-416e-a3ae-a7e93385154a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:09:25.060981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:09:25.067401 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [105] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [111] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:25.093139 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:25.093639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '104'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '105'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e3975d0f-a64b-4898-84d3-08f194ac440f', '111'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '113'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:09:25.093639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '104')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:25.094205 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a', '105')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:25.095305 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4051f4c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:09:25.095473 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:09:25.095678 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flush multipath device 33000000011193771 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:09:25.136544 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:25.180584 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:25.231858 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:09:25.232073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:09:25.233524 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:09:25.244325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:09:25.244505 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:09:25.254852 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:25.292584 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 104, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.40.100,3260]
May 28 03:09:25.292584 np0000001589 nova-compute[98297]: Logout of [sid: 104, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.40.100,3260] successful.
May 28 03:09:25.292584 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:25.309057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:25.323333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:25.355198 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 105, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.50.100,3260]
May 28 03:09:25.355198 np0000001589 nova-compute[98297]: Logout of [sid: 105, target: iqn.2023-03.storpool.com:os--volume-cffb3082-5b97-416e-a3ae-a7e93385154a, portal: 192.168.50.100,3260] successful.
May 28 03:09:25.355198 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:25.369424 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:25.369666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:25.369801 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== disconnect_volume: return (1933ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:25.369939 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:09:25.562693 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.565545 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-684942754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionsv293testjson-server-1321674240',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3hDIHKDwZCYjvIQ/AFuVBITm39hgX9ZkqgE1WS7Mwn+hc7CvfM7//lGgtkulsIwGUuyXwpO03DqyaRO+qN8oMsRIB8U2wC7XDILYN6XI/HRQ8z1XvjJ7U34UhbCRY/5Q==',key_name='tempest-keypair-64605543',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:53Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4892c2979f14a6dbc055d3e2d359bfa',ramdisk_id='',reservation_id='r-vj2w8kuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1182810107',owner_user_name='tempest-ServerActionsV293TestJSON-1182810107-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f776b52236043fb9455d1ec9a21c765',uuid=bbe1fdbc-f534-444c-8ad2-982bf5108932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:09:25.565852 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converting VIF {"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:25.566527 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:25.568215 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] End _get_guest_xml xml=<domain type="qemu">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <uuid>bbe1fdbc-f534-444c-8ad2-982bf5108932</uuid>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <name>instance-00000022</name>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerActionsV293TestJSON-server-684942754</nova:name>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:09:20</nova:creationTime>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:image uuid="fa0eb55a-2d07-4302-93b3-8cc680ecbfc7">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:user uuid="1f776b52236043fb9455d1ec9a21c765">tempest-ServerActionsV293TestJSON-1182810107-project-member</nova:user>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:project uuid="f4892c2979f14a6dbc055d3e2d359bfa">tempest-ServerActionsV293TestJSON-1182810107</nova:project>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid="fa0eb55a-2d07-4302-93b3-8cc680ecbfc7"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         <nova:port uuid="b1b2aac4-edce-455a-a545-2340a71b9bfa">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <system>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <entry name="serial">bbe1fdbc-f534-444c-8ad2-982bf5108932</entry>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <entry name="uuid">bbe1fdbc-f534-444c-8ad2-982bf5108932</entry>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </system>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <os>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   </os>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <features>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   </features>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   <devices>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <alias name="ua-567fb5dd-f8c4-4085-80cd-a3709b2f4c65"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <serial>567fb5dd-f8c4-4085-80cd-a3709b2f4c65</serial>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:94:9f:33"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <target dev="tapb1b2aac4-ed"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </interface>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/console.log" append="off"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </serial>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <video>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </video>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </rng>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:   </devices>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]: </domain>
May 28 03:09:25.568215 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:09:25.569815 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-684942754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionsv293testjson-server-1321674240',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3hDIHKDwZCYjvIQ/AFuVBITm39hgX9ZkqgE1WS7Mwn+hc7CvfM7//lGgtkulsIwGUuyXwpO03DqyaRO+qN8oMsRIB8U2wC7XDILYN6XI/HRQ8z1XvjJ7U34UhbCRY/5Q==',key_name='tempest-keypair-64605543',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:53Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4892c2979f14a6dbc055d3e2d359bfa',ramdisk_id='',reservation_id='r-vj2w8kuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1182810107',owner_user_name='tempest-ServerActionsV293TestJSON-1182810107-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f776b52236043fb9455d1ec9a21c765',uuid=bbe1fdbc-f534-444c-8ad2-982bf5108932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:09:25.569815 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converting VIF {"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:25.569815 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:25.569959 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:09:25.570178 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.570403 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:25.570588 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:09:25.571336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.571479 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbbe6921-a83c-542d-a5c7-86952f2cf9f3', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:25.572122 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.572744 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:25.574870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.470s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:25.575377 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.575530 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:25.577674 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.307s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:25.579479 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.579638 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1b2aac4-ed, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:25.579948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb1b2aac4-ed, col_values=(('qos', UUID('7181259c-c489-49e0-b779-3f988ae56a2a')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:25.580161 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb1b2aac4-ed, col_values=(('external_ids', {'iface-id': 'b1b2aac4-edce-455a-a545-2340a71b9bfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:9f:33', 'vm-uuid': 'bbe1fdbc-f534-444c-8ad2-982bf5108932'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:25.580879 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.582034 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:25.587590 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:25.591701 np0000001589 nova-compute[98297]: INFO os_vif [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed')
May 28 03:09:25.670567 np0000001589 nova-compute[98297]: INFO nova.network.neutron [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating port dc68665e-2eb3-4e6f-b031-e32d71c7fee2 with attributes {'binding:host_id': 'np0000001589', 'device_owner': 'compute:nova'}
May 28 03:09:25.787930 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003504689998408139 future=<Future at 0x7e4b40577830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:25.788448 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Emitting event <LifecycleEvent: 1779937750.7874577, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:25.788606 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:25.788804 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Stopped (Lifecycle Event)
May 28 03:09:25.789314 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.065483490999668 future=<Future at 0x7e4b64588f20 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:25.789410 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.065364519000013 future=<Future at 0x7e4b64588f20 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:25.912820 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:25.929540 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:26.044085 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:26.044383 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:26.145932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:26.146029 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:26.146150 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:09:26.196811 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:26.196971 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing instance network info cache due to event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:26.197133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:26.292821 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0f1a779e-819f-4cb1-8d9e-7f7cf06aadf4 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:26.549248 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:26.649837 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:26.939245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-675f2ac8-88fa-4c2a-832c-326007de18ca tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.509s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:26.953210 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:26.994221 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:26.994458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:26.994678 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Attaching volume f31fb8d8-9317-4b65-98a5-d8b4a15148c4 to /dev/vdb
May 28 03:09:27.050561 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:27.054401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.479s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:27.056296 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.886s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:27.063643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:09:27.090329 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:27.131254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:27.131254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:27.131254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] No VIF found with MAC fa:16:3e:94:9f:33, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:27.131254 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Using config drive
May 28 03:09:27.134672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:09:27.135305 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:09:27.145692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:09:27.146847 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe1c:b4b2', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:09:27.146987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:09:27.147104 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:09:27.147374 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:27.147548 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Updating existing volume attachment record: 6a75cad3-4aad-4ead-b391-255009a85656 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:09:27.164182 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Deleted allocations for instance 021bf930-a793-4075-893e-af588958bc9b
May 28 03:09:27.173687 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:27.527544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:27.527755 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:27.636430 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lazy-loading 'ec2_ids' on Instance uuid bbe1fdbc-f534-444c-8ad2-982bf5108932 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:27.683937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:27.685006 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:09:27.685254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:27.685412 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:27.689249 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Creating image(s)
May 28 03:09:27.689249 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:09:27.689249 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Ensure instance console log exists: /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:09:27.689249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:27.689249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:27.689249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:27.689249 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Start _get_guest_xml network_info=[{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'e0a8a349-5d2c-4807-b5aa-9141d041d3d6', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c792127f-b33e-48b3-8da7-ba4bd8ebeac0', 'attached_at': '', 'detached_at': '', 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'serial': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:09:27.694877 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:09:27.695959 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1722686750', uuid='c792127f-b33e-48b3-8da7-ba4bd8ebeac0'), owner=OwnerMeta(userid='1be2b4e542c34494a4052b18a1cea270', username='tempest-TestShelveInstance-1399725326-project-member', projectid='b61f52dbd3ed46f4814f2c0b132c713d', projectname='tempest-TestShelveInstance-1399725326'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937767.6956346) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:09:27.697477 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:09:27.697820 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:09:27.699046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:09:27.699640 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:09:27.701029 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:09:27.701029 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:09:27.701157 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:09:27.701193 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:09:27.702457 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:09:27.702457 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:09:27.702457 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:09:27.702457 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:09:27.702457 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:09:27.702457 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:09:27.702641 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:09:27.702755 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:09:27.703400 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'vcpu_model' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:27.708464 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:09:27.708869 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:27.709979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:27.709979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:27.709979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:09:27.723249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:27.723249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:27.723958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:27.723958 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:27.724783 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:27.724783 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:27.736178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:27.736178 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:27.746140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:27.746140 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4] added
May 28 03:09:27.751746 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:27.751746 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0276(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:27.751746 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4] added
May 28 03:09:27.758803 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:27.758803 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:27.758803 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:27.933214 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:28.030787 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:28.140747 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Object Instance<bbe1fdbc-f534-444c-8ad2-982bf5108932> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:09:28.140966 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lazy-loading 'keypairs' on Instance uuid bbe1fdbc-f534-444c-8ad2-982bf5108932 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:28.170143 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-a33e6bbe-fdfb-4539-8c21-e6bfbb446b92 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Lock "021bf930-a793-4075-893e-af588958bc9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.168s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:28.191296 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:28.207514 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Object Instance<c792127f-b33e-48b3-8da7-ba4bd8ebeac0> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:09:28.220988 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:09:28.221292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:28.222682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:28.526073 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:28.538825 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.484s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:28.613282 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Deleted allocations for instance 7aaca677-0143-4ffd-8206-e47614601132
May 28 03:09:28.643759 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Object Instance<bbe1fdbc-f534-444c-8ad2-982bf5108932> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:09:28.647923 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 28 03:09:28.694530 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updated VIF entry in instance network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:09:28.694884 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:28.752191 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:28.759295 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:28.764550 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:28.764550 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:28.772532 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:28.772532 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.784576 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:28.784795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:28.787596 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.788765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.794597 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Creating config drive at /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config
May 28 03:09:28.799393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptbiup9lz {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:28.812460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.812460 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.812460 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.812460 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.812460 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:28.812965 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.812965 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.812965 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.812965 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.812965 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:28.813690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.813690 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.813690 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.813690 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.813690 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:28.814557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.814557 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.814557 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.814557 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.814557 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:28.843339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.50.100,3260]
May 28 03:09:28.843339 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.50.100,3260] successful.
May 28 03:09:28.843339 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.854500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.40.100,3260]
May 28 03:09:28.854500 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.40.100,3260] successful.
May 28 03:09:28.854500 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.855209 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptbiup9lz" returned: 0 in 0.056s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:28.857516 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.870035 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:28.875899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.875899 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.875899 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.875899 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.875899 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.875899 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.875899 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.876658 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:28.876658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:28.877424 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] HCTL ('7', '-', '-', 0) found on session 114 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:28.877530 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:28.885927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.885927 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.885927 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.885927 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.885927 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.885927 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.885927 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:28.886335 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.886335 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:28.886335 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.886335 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:28.886335 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.886335 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:28.886335 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:28.886528 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:28.886528 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:28.887247 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] HCTL ('9', '-', '-', 0) found on session 115 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:28.887370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:28.895575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching for a device in session 114 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:28.895767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:28.904808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching for a device in session 115 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:28.904808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:29.199433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7a9ff3d-c18d-4d10-9d3f-962dab17cfdc req-63e98c50-f608-43f1-8401-2ac4f37dcf3b service nova] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:29.288315 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:09:29.324629 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:29.344868 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:29.425827 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:29.499994 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c0ecc9b-bce1-41f4-8c7f-55ca50980d85 req-d6f36e6e-c041-40f7-a204-83b9e17917d1 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:29.500317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c0ecc9b-bce1-41f4-8c7f-55ca50980d85 req-d6f36e6e-c041-40f7-a204-83b9e17917d1 service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:29.500557 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c0ecc9b-bce1-41f4-8c7f-55ca50980d85 req-d6f36e6e-c041-40f7-a204-83b9e17917d1 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:29.500742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c0ecc9b-bce1-41f4-8c7f-55ca50980d85 req-d6f36e6e-c041-40f7-a204-83b9e17917d1 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:29.500908 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c0ecc9b-bce1-41f4-8c7f-55ca50980d85 req-d6f36e6e-c041-40f7-a204-83b9e17917d1 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] No waiting events found dispatching network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:29.501075 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-3c0ecc9b-bce1-41f4-8c7f-55ca50980d85 req-d6f36e6e-c041-40f7-a204-83b9e17917d1 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received unexpected event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa for instance with vm_state active and task_state rebuild_spawning.
May 28 03:09:29.623162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e9cd150a-42b4-4722-a11f-56bbfa074c6f tempest-SnapshotDataIntegrityTests-1722793703 tempest-SnapshotDataIntegrityTests-1722793703-project-member] Lock "7aaca677-0143-4ffd-8206-e47614601132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.470s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:29.647481 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:29.649245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:29.652502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:29.677883 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:29.724404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:09:29.834962 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:29.835134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:29.838098 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:09:29.838243 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Claim successful on node np0000001589
May 28 03:09:30.038085 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937770.0377038, bbe1fdbc-f534-444c-8ad2-982bf5108932 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:30.038773 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:09:30.038994 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:09:30.039519 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] VM Resumed (Lifecycle Event)
May 28 03:09:30.043009 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance spawned successfully.
May 28 03:09:30.044625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:09:30.542424 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:30.544919 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:30.561468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:30.561468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:30.561468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:30.561468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:30.561468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:30.561468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:30.581952 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:30.743708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found WWN 330000000a5a2a1d8 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:09:30.746794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:30.746794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000a5a2a1d8', 'path': '/dev/dm-1', 'multipath_id': '330000000a5a2a1d8'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:30.746794 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a5a2a1d8', 'path': '/dev/dm-1', 'multipath_id': '330000000a5a2a1d8'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:09:30.747131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.525s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:30.747505 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:09:30.751489 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid 8e34a9f9-f4aa-493a-8ca2-6998667e2580 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:30.766981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:30.766981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:30.766981 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:30.768852 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:30.769439 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:30.769667 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:30.782079 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:30.782079 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:30.788669 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:30.788669 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:30.795262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a] added
May 28 03:09:30.795262 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:30.795262 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:30.795262 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:30.795262 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:30.795262 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:30.795262 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:30.795576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:30.795797 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0292(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:30.795963 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:30.809497 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a] added
May 28 03:09:30.809497 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:30.809497 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:30.809497 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:30.809497 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:30.809497 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:30.809497 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:30.809785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:30.809986 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0403(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:30.810210 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:31.054155 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 28 03:09:31.055998 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937771.0547078, bbe1fdbc-f534-444c-8ad2-982bf5108932 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:31.055998 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] VM Started (Lifecycle Event)
May 28 03:09:31.067016 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:31.137891 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:31.139514 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:09:31.255665 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Attempting to attach volume f31fb8d8-9317-4b65-98a5-d8b4a15148c4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:09:31.257209 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:09:31.257209 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:31.257209 np0000001589 nova-compute[98297]:   <alias name="ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4"/>
May 28 03:09:31.257209 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:09:31.257209 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:31.257209 np0000001589 nova-compute[98297]:   <serial>f31fb8d8-9317-4b65-98a5-d8b4a15148c4</serial>
May 28 03:09:31.257209 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:31.257209 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:09:31.336039 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:31.336425 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:31.558552 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:31.563388 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:31.578875 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:31.619110 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc74c7eb-8dda-4cf9-a9ae-f80c4489e166 req-595314ca-49a6-4e06-a6e9-8893a876b9d3 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:31.619282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc74c7eb-8dda-4cf9-a9ae-f80c4489e166 req-595314ca-49a6-4e06-a6e9-8893a876b9d3 service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:31.619424 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc74c7eb-8dda-4cf9-a9ae-f80c4489e166 req-595314ca-49a6-4e06-a6e9-8893a876b9d3 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:31.619538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc74c7eb-8dda-4cf9-a9ae-f80c4489e166 req-595314ca-49a6-4e06-a6e9-8893a876b9d3 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:31.619653 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc74c7eb-8dda-4cf9-a9ae-f80c4489e166 req-595314ca-49a6-4e06-a6e9-8893a876b9d3 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] No waiting events found dispatching network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:31.619771 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-bc74c7eb-8dda-4cf9-a9ae-f80c4489e166 req-595314ca-49a6-4e06-a6e9-8893a876b9d3 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received unexpected event network-vif-plugged-b1b2aac4-edce-455a-a545-2340a71b9bfa for instance with vm_state active and task_state None.
May 28 03:09:31.764046 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:31.796409 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:31.810652 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:31.811811 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:31.811811 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:31.824960 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:31.824960 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.832978 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.843577 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:31.851902 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.853573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.853573 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.853573 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.853573 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.853573 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.853573 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.853573 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:31.853940 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.853940 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.853940 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.853940 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.853940 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.853940 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.853940 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:31.871291 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.871291 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.871291 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.871291 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.871291 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.871291 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.871291 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:31.871502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.871502 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.871502 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.871502 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.871502 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.871502 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.871502 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:31.915330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260]
May 28 03:09:31.915330 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260] successful.
May 28 03:09:31.915330 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.924752 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260]
May 28 03:09:31.924752 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260] successful.
May 28 03:09:31.924752 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.929285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.943097 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.952294 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:31.952294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:31.953280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] HCTL ('10', '-', '-', 0) found on session 116 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:31.953470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:31.964399 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:31.964792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:31.964792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:31.965697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] HCTL ('14', '-', '-', 0) found on session 117 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:31.965830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:31.972984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching for a device in session 116 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:31.973305 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:31.980460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Searching for a device in session 117 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:31.981479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:32.353487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.518s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:32.353992 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:09:32.359262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.777s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:32.359262 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98297) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 28 03:09:32.770181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:09:32.796796 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:32.855330 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004753150001306494 future=<Future at 0x7e4b64588f20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:32.855736 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Emitting event <LifecycleEvent: 1779937757.8547091, 021bf930-a793-4075-893e-af588958bc9b => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:32.855853 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:32.855959 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.1609625920000326 future=<Future at 0x7e4b40616780 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:32.856045 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.1608727349998844 future=<Future at 0x7e4b40616780 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:32.856249 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] VM Stopped (Lifecycle Event)
May 28 03:09:32.867521 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:09:32.867977 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:09:32.868405 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:32.868654 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:32.934443 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:32.941645 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:32.941844 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:32.941954 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:32.942053 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No VIF found with MAC fa:16:3e:51:1d:91, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:32.986468 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada2cf15d86b4419ab73c67773ff8785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac8d769a2d4b49807632858d7e6423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:09:33.360790 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 021bf930-a793-4075-893e-af588958bc9b] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:33.368155 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:09:33.376066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dc2806a5-c604-4af9-9797-80248d96e0c9 tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.020s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:33.445219 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Successfully created port: bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:09:33.751062 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:33.790368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Found WWN 330000000436e0942 for multipath device dm-7 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:09:33.790770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:33.790770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] <== connect_volume: return (5569ms) {'type': 'block', 'scsi_wwn': '330000000436e0942', 'path': '/dev/dm-7', 'multipath_id': '330000000436e0942'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:33.790907 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000436e0942', 'path': '/dev/dm-7', 'multipath_id': '330000000436e0942'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:09:33.871216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:09:33.965436 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Successfully updated port: bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:09:34.054694 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:34.054905 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing instance network info cache due to event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:34.055135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:34.055343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:34.055561 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:34.137903 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:34.138033 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:09:34.138347 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:09:34.298495 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1722686750',display_name='tempest-TestShelveInstance-server-1722686750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testshelveinstance-server-1722686750',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1678016135',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:08:28Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b61f52dbd3ed46f4814f2c0b132c713d',ramdisk_id='',reservation_id='r-t5rvslrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1399725326',owner_user_name='tempest-TestShelveInstance-1399725326-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:09:20Z,user_data=None,user_id='1be2b4e542c34494a4052b18a1cea270',uuid=c792127f-b33e-48b3-8da7-ba4bd8ebeac0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:09:34.298714 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converting VIF {"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:34.299388 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:34.299958 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'pci_devices' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:34.467687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:34.498849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-77fa40b0-a93b-44bc-83ce-c08da3053e5b tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.504s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:34.559126 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:34.637637 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:09:34.801669 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Object Instance<c792127f-b33e-48b3-8da7-ba4bd8ebeac0> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:09:34.802723 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] End _get_guest_xml xml=<domain type="qemu">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <uuid>c792127f-b33e-48b3-8da7-ba4bd8ebeac0</uuid>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <name>instance-00000026</name>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestShelveInstance-server-1722686750</nova:name>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:09:27</nova:creationTime>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:user uuid="1be2b4e542c34494a4052b18a1cea270">tempest-TestShelveInstance-1399725326-project-member</nova:user>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:project uuid="b61f52dbd3ed46f4814f2c0b132c713d">tempest-TestShelveInstance-1399725326</nova:project>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         <nova:port uuid="dc68665e-2eb3-4e6f-b031-e32d71c7fee2">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <system>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <entry name="serial">c792127f-b33e-48b3-8da7-ba4bd8ebeac0</entry>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <entry name="uuid">c792127f-b33e-48b3-8da7-ba4bd8ebeac0</entry>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </system>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <os>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   </os>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <features>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   </features>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   <devices>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <alias name="ua-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-7"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <serial>95f8b2ce-63a6-4f18-92fd-0866d9c3a24a</serial>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ab:c4:80"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <target dev="tapdc68665e-2e"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </interface>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/console.log" append="off"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </serial>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <video>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </video>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </rng>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:   </devices>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]: </domain>
May 28 03:09:34.802723 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Preparing to wait for external event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1722686750',display_name='tempest-TestShelveInstance-server-1722686750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testshelveinstance-server-1722686750',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1678016135',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:08:28Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b61f52dbd3ed46f4814f2c0b132c713d',ramdisk_id='',reservation_id='r-t5rvslrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1399725326',owner_user_name='tempest-TestShelveInstance-1399725326-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:09:20Z,user_data=None,user_id='1be2b4e542c34494a4052b18a1cea270',uuid=c792127f-b33e-48b3-8da7-ba4bd8ebeac0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converting VIF {"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:34.805706 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:09:34.806059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:34.806059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '499e147e-b590-5ea5-b055-2cf4f0279b9d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:34.810101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:34.811530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:34.832209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:34.835540 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:34.835821 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc68665e-2e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:34.835980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc68665e-2e, col_values=(('qos', UUID('94202ef9-d558-4458-8f0e-e26426764033')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:34.836666 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc68665e-2e, col_values=(('external_ids', {'iface-id': 'dc68665e-2eb3-4e6f-b031-e32d71c7fee2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:c4:80', 'vm-uuid': 'c792127f-b33e-48b3-8da7-ba4bd8ebeac0'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:34.836858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:34.838801 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:34.844630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:34.845704 np0000001589 nova-compute[98297]: INFO os_vif [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e')
May 28 03:09:34.880169 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:09:34.881370 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:09:34.881625 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Creating image(s)
May 28 03:09:34.882048 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:34.882522 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:34.882877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:34.883359 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:34.886950 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:34.888566 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:34.932746 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:34.979832 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:34.979832 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:34.979832 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:34.979832 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:34.982826 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:34.983646 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:35.018191 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0011627190001490817 future=<Future at 0x7e4b40616780 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:35.018425 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:35.019295 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Emitting event <LifecycleEvent: 1779937760.0168514, 7aaca677-0143-4ffd-8206-e47614601132 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:35.019581 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] VM Stopped (Lifecycle Event)
May 28 03:09:35.072907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:35.077276 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:35.132744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk 1073741824" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:35.135301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:35.135301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:35.241726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:35.242801 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:09:35.242801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:35.344007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:35.344529 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Cannot resize image /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:09:35.345212 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:09:35.345212 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Ensure instance console log exists: /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:09:35.345351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:35.345572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:35.346080 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:35.438695 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1adb2723-89fb-4386-a7b7-0e4b051638b2 req-ae07045f-d614-45a5-b234-bd2881c4baeb service nova] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:35.439355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:35.439567 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:09:35.525442 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 7aaca677-0143-4ffd-8206-e47614601132] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:36.045185 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:09:36.137733 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:36.137988 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:36.217955 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:36.365858 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:36.366644 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:36.368038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] No VIF found with MAC fa:16:3e:ab:c4:80, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:36.369091 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:36.370037 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Using config drive
May 28 03:09:36.646140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:36.646418 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:36.646582 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:36.646730 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:09:36.871996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:36.872302 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance network_info: |[{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:09:36.874669 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Start _get_guest_xml network_info=[{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:09:36.875139 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'ec2_ids' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:36.880520 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:09:36.881889 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b00002ac-1bf2-43ff-9836-3aa0f11fdabb'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937776.8814924) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:09:36.882835 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:09:36.883208 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:09:36.884794 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:09:36.885014 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:09:36.885940 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:09:36.886316 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:09:36.886505 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:09:36.886639 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:09:36.886804 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:09:36.886929 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:09:36.887071 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:09:36.888939 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:09:36.889094 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:09:36.889281 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:09:36.889458 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:09:36.889653 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:09:36.904490 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=42,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-mscd5hbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b00002ac-1bf2-43ff-9836-3aa0f11fdabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:09:36.904815 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:36.905388 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:36.905977 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'pci_devices' on Instance uuid b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:36.912623 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:36.912863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:37.381996 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Object Instance<c792127f-b33e-48b3-8da7-ba4bd8ebeac0> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:09:37.381996 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'keypairs' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:37.413624 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] End _get_guest_xml xml=<domain type="qemu">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <uuid>b00002ac-1bf2-43ff-9836-3aa0f11fdabb</uuid>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <name>instance-0000002a</name>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:name>multiattach-server-0</nova:name>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:09:36</nova:creationTime>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         <nova:port uuid="bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <system>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <entry name="serial">b00002ac-1bf2-43ff-9836-3aa0f11fdabb</entry>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <entry name="uuid">b00002ac-1bf2-43ff-9836-3aa0f11fdabb</entry>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </system>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <os>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   </os>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <features>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   </features>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   <devices>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d3:5b:9c"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <target dev="tapbf6d0b8a-02"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </interface>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/console.log" append="off"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </serial>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <video>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </video>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </rng>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:   </devices>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]: </domain>
May 28 03:09:37.413624 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Preparing to wait for external event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=42,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-mscd5hbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b00002ac-1bf2-43ff-9836-3aa0f11fdabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:37.415721 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:09:37.416136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.416136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:37.416507 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:09:37.416854 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:09:37.419341 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.419513 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd9038b0-ebf3-585e-ba5c-a88082b8c770', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:37.420289 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.421126 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:37.426036 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.428171 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.428446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf6d0b8a-02, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:37.428833 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf6d0b8a-02, col_values=(('qos', UUID('10fe5aca-a8a1-4498-9801-31e36eb734b4')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:37.429375 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf6d0b8a-02, col_values=(('external_ids', {'iface-id': 'bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:5b:9c', 'vm-uuid': 'b00002ac-1bf2-43ff-9836-3aa0f11fdabb'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:37.429776 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.431061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:37.440284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.441242 np0000001589 nova-compute[98297]: INFO os_vif [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02')
May 28 03:09:37.677054 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000026, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config'
May 28 03:09:37.678712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:37.761153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:37.761616 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:37.848686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:37.852242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:37.886544 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Object Instance<c792127f-b33e-48b3-8da7-ba4bd8ebeac0> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:09:37.893263 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:37.935468 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:37.941768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:37.942134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:38.011588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:38.011870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:38.020005 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:09:38.020191 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Claim successful on node np0000001589
May 28 03:09:38.043077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:38.046240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:38.078924 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Creating config drive at /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config
May 28 03:09:38.086094 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl60fily5 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:38.138582 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl60fily5" returned: 0 in 0.052s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:38.159617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:38.160137 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:38.257270 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:38.261345 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:09:38.263376 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:09:38.265037 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:38.368892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:38.369354 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:38.465708 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:38.466291 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:09:38.472146 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:09:38.473587 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:38.520194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:38.522625 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=11984MB free_disk=73.84341812133789GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:09:38.523101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:38.565675 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:38.596428 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:38.691284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:38.747767 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:38.748002 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:38.777448 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c41dfa0-cd45-4732-8379-5f4d1651f39f req-34a11a0d-484e-451f-971c-c6212f4b7eb6 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:38.777673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c41dfa0-cd45-4732-8379-5f4d1651f39f req-34a11a0d-484e-451f-971c-c6212f4b7eb6 service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:38.778074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c41dfa0-cd45-4732-8379-5f4d1651f39f req-34a11a0d-484e-451f-971c-c6212f4b7eb6 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:38.778074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3c41dfa0-cd45-4732-8379-5f4d1651f39f req-34a11a0d-484e-451f-971c-c6212f4b7eb6 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:38.778219 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3c41dfa0-cd45-4732-8379-5f4d1651f39f req-34a11a0d-484e-451f-971c-c6212f4b7eb6 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Processing event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:09:38.947503 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:38.954644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:38.957330 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:38.981201 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:38.991323 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:39.001640 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:39.001829 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:39.001998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:d3:5b:9c, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:39.002607 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Using config drive
May 28 03:09:39.259440 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid 1d86d49f-8fd0-4682-b508-abb1b434b002 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:39.358121 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937779.357717, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:39.358541 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:09:39.359528 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Started (Lifecycle Event)
May 28 03:09:39.361811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:09:39.365574 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance spawned successfully.
May 28 03:09:39.366173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:39.477026 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:39.477413 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:39.509075 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:39.658940 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Creating config drive at /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config
May 28 03:09:39.663853 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx5imxptp {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:39.744855 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpx5imxptp" returned: 0 in 0.080s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:39.863785 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:39.870424 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:39.891805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1a446466-65ef-44b2-a28e-246df0620815 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 20.666s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:39.981428 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:40.218295 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:40.247612 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:40.266633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:40.347038 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:40.377101 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937780.3753777, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:40.377101 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Paused (Lifecycle Event)
May 28 03:09:40.424530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:40.425536 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:40.489195 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.477s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:40.490055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.966s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:40.491027 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:09:40.857289 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] No waiting events found dispatching network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received unexpected event network-vif-plugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 for instance with vm_state active and task_state None.
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Processing event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:40.860015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:40.860883 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] No waiting events found dispatching network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:40.861462 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-b554b9ee-f01c-492c-a097-7b5793e61b72 req-cacd4290-86b2-41d9-92a6-069533bd5069 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received unexpected event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 for instance with vm_state building and task_state spawning.
May 28 03:09:40.880386 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:40.886926 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937780.8867028, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:40.887066 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Resumed (Lifecycle Event)
May 28 03:09:40.998074 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:09:40.998630 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:09:40.998866 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:40.999144 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:41.041440 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:09:41.043269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:09:41.045072 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance spawned successfully.
May 28 03:09:41.045390 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:09:41.071445 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba297a0d43248c883c9b6100d92cae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094dc3cb80814083a18dc5026b895ec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:09:41.323548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:41.323805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:41.323875 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Attaching volume 2ec35251-dd7e-43f5-bbb5-bfc224b4f175 to /dev/vdb
May 28 03:09:41.366352 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:41.378708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:09:41.389908 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:41.393484 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:41.406689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:41.462870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:09:41.463906 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:09:41.474838 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:09:41.477195 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe1c:b4b2', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fe94:9f33', 'fe80::c062:69ff:feb9:518c', 'fe80::fc16:3eff:feab:c480', 'fe80::3073:48ff:fe9d:fe6f', 'fe80::fc16:3eff:fed3:5b9c'] 
May 28 03:09:41.477508 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:09:41.478630 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:09:41.479656 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:41.479656 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Updating existing volume attachment record: 0f7b72eb-79b9-4653-9dfd-7be296bd8225 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:09:41.503496 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:09:41.555619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:41.555999 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:41.556295 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:41.556578 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:41.556810 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:41.557047 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:41.591463 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance bbe1fdbc-f534-444c-8ad2-982bf5108932 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.591600 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.591710 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.591810 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.591899 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.592002 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1d86d49f-8fd0-4682-b508-abb1b434b002 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.592090 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance c792127f-b33e-48b3-8da7-ba4bd8ebeac0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.592185 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.592381 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b6062670-bd92-40aa-ab30-10f20543db3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:09:41.592587 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:09:41.592894 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:09:38 up 37 min,  2 users,  load average: 7.17, 6.69, 4.17\n', 'num_instances': '9', 'num_vm_active': '7', 'num_task_None': '8', 'num_os_type_None': '9', 'num_proj_52ac8d769a2d4b49807632858d7e6423': '4', 'io_workload': '2', 'num_proj_094dc3cb80814083a18dc5026b895ec5': '2', 'num_proj_0eee8d500ee84b5f86e297c2660e183b': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_f4892c2979f14a6dbc055d3e2d359bfa': '1', 'num_proj_b61f52dbd3ed46f4814f2c0b132c713d': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:09:41.609217 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Successfully created port: 34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:09:41.897178 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937781.8967912, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:41.897417 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] VM Started (Lifecycle Event)
May 28 03:09:42.014672 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:09:42.065111 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Took 7.18 seconds to spawn the instance on the hypervisor.
May 28 03:09:42.065950 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:42.091441 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:42.091626 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:42.094583 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d86d49f-8fd0-4682-b508-abb1b434b002', 'attached_at': '', 'detached_at': '', 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'serial': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:09:42.095570 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:09:42.096250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:42.096459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:42.096861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:42.097016 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:09:42.110532 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:42.111456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:42.112253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:42.112253 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:42.115433 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:42.115662 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:42.130336 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:42.130336 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:42.135822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:09:42.135822 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:42.145830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175] added
May 28 03:09:42.145830 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:42.145830 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:42.145830 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:42.145830 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:42.145830 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:42.145830 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:42.146481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:42.146810 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:42.146975 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:42.147449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175] added
May 28 03:09:42.147449 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:09:42.147449 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:42.147449 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:42.147449 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:09:42.147449 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:09:42.147449 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:42.147645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:09:42.147934 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:09:42.148078 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:09:42.218103 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Successfully updated port: 34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:09:42.260368 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-changed-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:42.260724 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Refreshing instance network info cache due to event network-changed-34ac475a-4f8d-4831-98d1-29ef9172a387. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:42.260919 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] Acquiring lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:42.261041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] Acquired lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:42.261187 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Refreshing network info cache for port 34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:42.404542 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:42.406087 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:42.430360 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:42.581624 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Took 12.79 seconds to build instance.
May 28 03:09:42.595120 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:42.720095 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:42.762795 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:42.825537 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:09:42.908238 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937782.9079688, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:42.908393 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] VM Paused (Lifecycle Event)
May 28 03:09:42.946358 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:42.959788 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:43.026039 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:09:43.026892 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:09:43.027102 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Creating image(s)
May 28 03:09:43.027642 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:43.027803 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:43.028279 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:43.028728 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:43.031237 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:43.032330 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:43.084145 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.299s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:43.103526 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:09:43.104043 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.614s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:43.104474 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:09:43.126411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:43.126809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:43.127216 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:43.127624 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:43.130455 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:43.130781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:43.150453 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:09:43.154210 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:43.165218 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:43.165218 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:09:43.169593 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:09:43.169593 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.182003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.188019 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.204063 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.204596 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.207203 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.207549 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:43.238061 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.106s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:43.241622 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:43.259445 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.40.100,3260]
May 28 03:09:43.259445 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.40.100,3260] successful.
May 28 03:09:43.259445 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.276131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.288799 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.50.100,3260]
May 28 03:09:43.288799 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.50.100,3260] successful.
May 28 03:09:43.288799 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.296167 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.296778 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:43.298122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:43.298122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:43.298935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('15', '-', '-', 0) found on session 118 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:43.299010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:43.304754 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk 1073741824" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:43.305921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:43.307684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:43.325378 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 118 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:43.325676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:43.327023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.347210 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:43.347731 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:43.348484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.235s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:43.349212 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:09:43.350030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('16', '-', '-', 0) found on session 119 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:09:43.350186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:09:43.373811 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 119 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:09:43.374462 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:09:43.412504 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:43.417544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.111s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:43.418491 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:09:43.419000 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937783.41861, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:43.419589 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] VM Resumed (Lifecycle Event)
May 28 03:09:43.421606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:43.462909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-81f20214-ef93-4514-9259-dc73d5ed00ad req-54a878fa-b634-4ece-8e5c-9946d868bb1d service nova] Releasing lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:43.465643 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquired lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:43.465643 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:09:43.534490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:43.534923 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Cannot resize image /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:09:43.535236 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:09:43.535490 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Ensure instance console log exists: /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:09:43.535779 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:43.536045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:43.536274 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:43.946612 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:43.949126 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:44.063371 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:09:44.100673 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:44.101878 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:44.102762 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:44.102963 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:44.103172 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:09:44.103462 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.03 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:09:44.113287 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:09:44.344719 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-changed-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:44.344857 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Refreshing instance network info cache due to event network-changed-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:44.345040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] Acquiring lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:44.345273 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] Acquired lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:44.346235 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Refreshing network info cache for port 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:44.730399 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:44.847310 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:44.922501 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Updating instance_info_cache with network_info: [{"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:44.959890 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:44.960497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:45.129031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found WWN 3300000005f2b805c for multipath device dm-10 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:09:45.129767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:45.131189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000005f2b805c', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '3300000005f2b805c'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:45.131352 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005f2b805c', 'path': '/dev/disk/by-id/os-brick+dev+dm-10', 'multipath_id': '3300000005f2b805c'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:09:45.132996 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:09:45.133190 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:09:45.133373 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:09:45.151278 np0000001589 nova-compute[98297]: WARNING os_brick.encryptors.luks [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 03:09:45.151617 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:09:45.151749 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:09:45.151894 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:09:45.152413 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7e4b4068e630>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': '1d86d49f-8fd0-4682-b508-abb1b434b002', 'attached_at': '', 'detached_at': '', 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'serial': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:09:45.152525 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] formatting encrypted volume /dev/dm-10 {{(pid=98297) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 03:09:45.218859 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:45.381103 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updated VIF entry in instance network info cache for port 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:09:45.381449 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updating instance_info_cache with network_info: [{"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:45.425271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Releasing lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:45.425631 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Instance network_info: |[{"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:09:45.428356 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Start _get_guest_xml network_info=[{"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:09:45.430918 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:09:45.432553 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1921991276', uuid='b6062670-bd92-40aa-ab30-10f20543db3a'), owner=OwnerMeta(userid='fba297a0d43248c883c9b6100d92cae8', username='tempest-AttachVolumeNegativeTest-414697469-project-member', projectid='094dc3cb80814083a18dc5026b895ec5', projectname='tempest-AttachVolumeNegativeTest-414697469'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937785.4320734) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:09:45.435390 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:09:45.436111 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:09:45.437039 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:09:45.437433 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:09:45.438740 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:09:45.439170 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:09:45.439411 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:09:45.439549 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:09:45.439721 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:09:45.439842 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:09:45.439976 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:09:45.440183 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:09:45.440421 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:09:45.440567 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:09:45.440718 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:09:45.440899 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:09:45.462095 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1921991276',display_name='tempest-AttachVolumeNegativeTest-server-1921991276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-1921991276',id=43,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7ZXh8DlLJAkFd2Y2E9nl41Mdz76uTZ9dw+UKfn40+POzt0+0uB1qokve0RoEyx7bw7ZsEjhH3JeldMLP4qsaj+3SMeNUVJ+8JCA/zehXFh/kGk3cxOLdEP0GOCDX0fBw==',key_name='tempest-keypair-345132425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-x6508qu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=b6062670-bd92-40aa-ab30-10f20543db3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:09:45.462800 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:09:45.467168 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:45.467168 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=34ac475a-4f8d-4831-98d1-29ef9172a387,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ac475a-4f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:45.467508 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'pci_devices' on Instance uuid b6062670-bd92-40aa-ab30-10f20543db3a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:45.889093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] Releasing lock "refresh_cache-0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:45.889093 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:45.889093 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing instance network info cache due to event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:45.889093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:45.889093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:45.889093 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:45.980697 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] End _get_guest_xml xml=<domain type="qemu">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <uuid>b6062670-bd92-40aa-ab30-10f20543db3a</uuid>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <name>instance-0000002b</name>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1921991276</nova:name>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:09:45</nova:creationTime>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:user uuid="fba297a0d43248c883c9b6100d92cae8">tempest-AttachVolumeNegativeTest-414697469-project-member</nova:user>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:project uuid="094dc3cb80814083a18dc5026b895ec5">tempest-AttachVolumeNegativeTest-414697469</nova:project>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         <nova:port uuid="34ac475a-4f8d-4831-98d1-29ef9172a387">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <system>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <entry name="serial">b6062670-bd92-40aa-ab30-10f20543db3a</entry>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <entry name="uuid">b6062670-bd92-40aa-ab30-10f20543db3a</entry>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </system>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <os>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   </os>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <features>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   </features>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   <devices>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk.config"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:2f:67:e5"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <target dev="tap34ac475a-4f"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </interface>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/console.log" append="off"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </serial>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <video>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </video>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </rng>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:   </devices>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]: </domain>
May 28 03:09:45.980697 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:09:45.982955 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Preparing to wait for external event network-vif-plugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:09:45.982955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:45.982955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:45.982955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:45.982955 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1921991276',display_name='tempest-AttachVolumeNegativeTest-server-1921991276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-1921991276',id=43,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7ZXh8DlLJAkFd2Y2E9nl41Mdz76uTZ9dw+UKfn40+POzt0+0uB1qokve0RoEyx7bw7ZsEjhH3JeldMLP4qsaj+3SMeNUVJ+8JCA/zehXFh/kGk3cxOLdEP0GOCDX0fBw==',key_name='tempest-keypair-345132425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-x6508qu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=b6062670-bd92-40aa-ab30-10f20543db3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:09:45.982955 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:45.984003 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=34ac475a-4f8d-4831-98d1-29ef9172a387,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ac475a-4f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:45.984003 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=34ac475a-4f8d-4831-98d1-29ef9172a387,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ac475a-4f') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:09:45.985111 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:45.985111 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:45.985913 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:09:45.988096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:45.988096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e7d566d-29af-5ffc-b7fe-bff75f90560c', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:45.990133 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:45.993617 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:45.993897 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34ac475a-4f, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:45.994398 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34ac475a-4f, col_values=(('qos', UUID('1bec264f-209c-4a8c-949e-05fe95e3b1d3')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:45.995303 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34ac475a-4f, col_values=(('external_ids', {'iface-id': '34ac475a-4f8d-4831-98d1-29ef9172a387', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:67:e5', 'vm-uuid': 'b6062670-bd92-40aa-ab30-10f20543db3a'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:45.997290 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:46.002149 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:46.003426 np0000001589 nova-compute[98297]: INFO os_vif [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=34ac475a-4f8d-4831-98d1-29ef9172a387,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ac475a-4f')
May 28 03:09:46.032555 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:46.032849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:46.036365 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:09:46.036547 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Claim successful on node np0000001589
May 28 03:09:46.391637 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:46.767761 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:46.904098 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updated VIF entry in instance network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:09:46.904098 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:47.405979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f6fe828-af51-4c88-b176-3273f92a0e56 req-545155c4-0d5a-4137-926b-9fcef07b1d99 service nova] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:47.508343 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:09:47.508583 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:09:47.527900 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:47.527900 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:47.527900 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No VIF found with MAC fa:16:3e:2f:67:e5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:47.527900 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Using config drive
May 28 03:09:47.948663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:48.011389 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:09:48.035212 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:48.204814 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Creating config drive at /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk.config
May 28 03:09:48.209880 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps482__ta {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:48.276465 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps482__ta" returned: 0 in 0.066s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:48.519458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.486s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:48.520708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:09:48.784517 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:48.815631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:48.903000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:48.983996 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:48.985187 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:49.028481 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:09:49.030370 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:09:49.030370 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:49.030370 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:49.038828 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ee1582c5-f059-4e68-b786-e594ddee82aa req-a043941b-a233-4766-8206-bc6a23e589b0 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-vif-plugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:49.038828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee1582c5-f059-4e68-b786-e594ddee82aa req-a043941b-a233-4766-8206-bc6a23e589b0 service nova] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:49.038828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee1582c5-f059-4e68-b786-e594ddee82aa req-a043941b-a233-4766-8206-bc6a23e589b0 service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:49.038828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee1582c5-f059-4e68-b786-e594ddee82aa req-a043941b-a233-4766-8206-bc6a23e589b0 service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:49.039024 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ee1582c5-f059-4e68-b786-e594ddee82aa req-a043941b-a233-4766-8206-bc6a23e589b0 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Processing event network-vif-plugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:09:49.165064 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada2cf15d86b4419ab73c67773ff8785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac8d769a2d4b49807632858d7e6423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:09:49.245051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:09:49.245051 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:09:49.245051 np0000001589 nova-compute[98297]:     <volume>2ec35251-dd7e-43f5-bbb5-bfc224b4f175</volume>
May 28 03:09:49.245051 np0000001589 nova-compute[98297]:   </usage>
May 28 03:09:49.245051 np0000001589 nova-compute[98297]: </secret>
May 28 03:09:49.245051 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:09:49.253798 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid 1d86d49f-8fd0-4682-b508-abb1b434b002 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:49.532707 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:09:49.757112 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Attempting to attach volume 2ec35251-dd7e-43f5-bbb5-bfc224b4f175 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:09:49.758534 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:   <alias name="ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175"/>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:   <serial>2ec35251-dd7e-43f5-bbb5-bfc224b4f175</serial>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="df41b701-b01b-4328-a710-9d8c4b0e470f"/>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:49.758534 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:09:49.767831 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:09:49.770056 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Successfully created port: c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:09:49.775802 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937789.771977, b6062670-bd92-40aa-ab30-10f20543db3a => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:49.775802 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] VM Started (Lifecycle Event)
May 28 03:09:49.775802 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:09:49.783044 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Instance spawned successfully.
May 28 03:09:49.783657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:09:50.037680 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:09:50.278506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:50.280681 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:50.293308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:50.293308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:50.293308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:50.293308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:50.293308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:50.293308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:50.357581 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Successfully updated port: c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:09:50.403468 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:50.404539 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing instance network info cache due to event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:50.404688 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:50.404791 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:50.404918 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing network info cache for port c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:50.783221 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:09:50.783739 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937790.7832036, b6062670-bd92-40aa-ab30-10f20543db3a => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:50.783739 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] VM Paused (Lifecycle Event)
May 28 03:09:50.799119 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Took 7.77 seconds to spawn the instance on the hypervisor.
May 28 03:09:50.799394 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:50.858550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:50.908557 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:50.975457 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:09:50.996305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:51.050657 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:09:51.051837 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:09:51.052522 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Creating image(s)
May 28 03:09:51.053020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:51.053347 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:51.054218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:51.055284 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:51.058749 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:51.059872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:51.118607 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e3dc672-1e93-47b1-bf73-0628e61f0830 req-8d14bd08-e0ef-456a-b8ec-f3f614b52d64 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-vif-plugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:51.118843 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e3dc672-1e93-47b1-bf73-0628e61f0830 req-8d14bd08-e0ef-456a-b8ec-f3f614b52d64 service nova] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:51.119171 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e3dc672-1e93-47b1-bf73-0628e61f0830 req-8d14bd08-e0ef-456a-b8ec-f3f614b52d64 service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:51.119247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8e3dc672-1e93-47b1-bf73-0628e61f0830 req-8d14bd08-e0ef-456a-b8ec-f3f614b52d64 service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:51.119419 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8e3dc672-1e93-47b1-bf73-0628e61f0830 req-8d14bd08-e0ef-456a-b8ec-f3f614b52d64 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] No waiting events found dispatching network-vif-plugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:51.119552 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8e3dc672-1e93-47b1-bf73-0628e61f0830 req-8d14bd08-e0ef-456a-b8ec-f3f614b52d64 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received unexpected event network-vif-plugged-34ac475a-4f8d-4831-98d1-29ef9172a387 for instance with vm_state active and task_state None.
May 28 03:09:51.156673 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:51.159059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:51.159558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:51.160399 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:51.160813 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:51.163616 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:09:51.164391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:51.274716 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:51.275892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:51.295101 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:51.302369 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937791.3019648, b6062670-bd92-40aa-ab30-10f20543db3a => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:51.302501 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] VM Resumed (Lifecycle Event)
May 28 03:09:51.319064 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Took 13.40 seconds to build instance.
May 28 03:09:51.342479 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk 1073741824" returned: 0 in 0.067s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:51.342854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:51.343093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:51.441774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:51.442685 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:09:51.443063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:51.568636 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:51.569009 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Cannot resize image /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:09:51.569694 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:09:51.569908 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Ensure instance console log exists: /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:09:51.570311 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:51.570570 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:51.570727 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:51.661087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fed06220-8e83-4dfc-abb2-8c7239f41952 req-688a8056-171a-434e-b732-0386fb0e615e service nova] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:51.661738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:51.662008 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:09:51.763974 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:09:51.815515 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:51.819085 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:51.822871 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f4add53-fedc-45fa-a086-20e8375ae1f3 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.910s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:52.256600 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:09:52.420864 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:52.437479 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:52.437648 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:52.437797 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:52.437954 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:1c:b4:b2, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:52.623417 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:52.957826 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.032361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-changed-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:53.032361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Refreshing instance network info cache due to event network-changed-34ac475a-4f8d-4831-98d1-29ef9172a387. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:09:53.032361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] Acquiring lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:09:53.032361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] Acquired lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:09:53.032361 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Refreshing network info cache for port 34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:09:53.125862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:53.126546 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance network_info: |[{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:09:53.128703 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Start _get_guest_xml network_info=[{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:09:53.130791 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:09:53.132410 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='b3b73e16-989c-483c-866f-4e179edfbeef'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937793.1319726) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:09:53.133575 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:09:53.134009 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:09:53.134856 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:09:53.135049 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:09:53.136323 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:09:53.136754 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:09:53.136951 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:09:53.137087 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:09:53.137288 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:09:53.137423 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:09:53.137554 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:09:53.137762 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:09:53.137899 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:09:53.138031 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:09:53.138170 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:09:53.138455 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:09:53.153896 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=44,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-p6bko20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3b73e16-989c-483c-866f-4e179edfbeef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:09:53.154070 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:53.154595 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:53.155065 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'pci_devices' on Instance uuid b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:53.535039 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:53.657463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] End _get_guest_xml xml=<domain type="qemu">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <uuid>b3b73e16-989c-483c-866f-4e179edfbeef</uuid>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <name>instance-0000002c</name>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:name>multiattach-server-1</nova:name>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:09:53</nova:creationTime>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         <nova:port uuid="c80fcc18-0110-4f7b-97b1-60565e8719a9">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <system>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <entry name="serial">b3b73e16-989c-483c-866f-4e179edfbeef</entry>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <entry name="uuid">b3b73e16-989c-483c-866f-4e179edfbeef</entry>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </system>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <os>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   </os>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <features>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   </features>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   <devices>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </disk>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:24:3d:ed"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <target dev="tapc80fcc18-01"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </interface>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/console.log" append="off"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </serial>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <video>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </video>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </rng>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:   </devices>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]: </domain>
May 28 03:09:53.657463 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Preparing to wait for external event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=44,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-p6bko20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3b73e16-989c-483c-866f-4e179edfbeef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:53.659738 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:09:53.661599 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.661599 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:53.661599 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:09:53.663038 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.663038 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32ea6024-2629-5d3a-ba58-c7542aec791d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:53.664550 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.664550 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:53.668069 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.673570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.673570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc80fcc18-01, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:53.673570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc80fcc18-01, col_values=(('qos', UUID('4420c06f-0e0b-4121-9cb5-dd6a9c182beb')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:53.673570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc80fcc18-01, col_values=(('external_ids', {'iface-id': 'c80fcc18-0110-4f7b-97b1-60565e8719a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:3d:ed', 'vm-uuid': 'b3b73e16-989c-483c-866f-4e179edfbeef'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:53.675103 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.675492 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:53.680331 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:53.681477 np0000001589 nova-compute[98297]: INFO os_vif [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01')
May 28 03:09:53.908703 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:54.006004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76f5fe90-3537-436b-82f9-f9b79c54df79 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.682s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:54.100748 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Updated VIF entry in instance network info cache for port 34ac475a-4f8d-4831-98d1-29ef9172a387. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:09:54.101275 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Updating instance_info_cache with network_info: [{"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:09:54.548543 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:54.548543 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:54.603534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-609b23c9-1df9-4f62-b156-121190744cbf req-f0ffdac5-a3e9-4d14-ac66-4cba5160f637 service nova] Releasing lock "refresh_cache-b6062670-bd92-40aa-ab30-10f20543db3a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:09:55.049936 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Detaching volume 2ec35251-dd7e-43f5-bbb5-bfc224b4f175
May 28 03:09:55.090061 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Attempting to driver detach volume 2ec35251-dd7e-43f5-bbb5-bfc224b4f175 from mountpoint /dev/vdb
May 28 03:09:55.122079 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, 'status': 'reserved', 'instance': '1d86d49f-8fd0-4682-b508-abb1b434b002', 'attached_at': '', 'detached_at': '', 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'serial': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:09:55.131699 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:55.133272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:09:55.133272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Attempting to detach device vdb from instance 1d86d49f-8fd0-4682-b508-abb1b434b002 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:09:55.133272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   <alias name="ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175"/>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   <serial>2ec35251-dd7e-43f5-bbb5-bfc224b4f175</serial>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="df41b701-b01b-4328-a710-9d8c4b0e470f"/>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:55.133272 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:55.142073 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance 1d86d49f-8fd0-4682-b508-abb1b434b002 from the persistent domain config.
May 28 03:09:55.143096 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] (1/8): Attempting to detach device vdb with device alias ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 from instance 1d86d49f-8fd0-4682-b508-abb1b434b002 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:09:55.143096 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   <alias name="ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175"/>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-10"/>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   <serial>2ec35251-dd7e-43f5-bbb5-bfc224b4f175</serial>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="df41b701-b01b-4328-a710-9d8c4b0e470f"/>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]: </disk>
May 28 03:09:55.143096 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:09:55.201239 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:55.201423 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:09:55.201600 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:24:3d:ed, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:09:55.202190 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Using config drive
May 28 03:09:55.672686 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937795.671978, 1d86d49f-8fd0-4682-b508-abb1b434b002 => ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:09:55.675039 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 for instance 1d86d49f-8fd0-4682-b508-abb1b434b002 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:09:55.677656 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance 1d86d49f-8fd0-4682-b508-abb1b434b002 from the live domain config.
May 28 03:09:55.681728 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:09:55.681728 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:09:55.681972 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:09:55.682509 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:09:55.682940 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:09:55.683140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:09:55.708657 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:55.718894 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [118] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175 (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:09:55.719430 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:09:55.719430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '117'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:09:55.719860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', '118')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:55.721405 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175', '119')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:09:55.722564 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b645ba660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'): ({'sdk'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:09:55.722898 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Removing multipathed devices sdk, sdj {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:09:55.723258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flush multipath device 3300000005f2b805c {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:09:55.756725 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:55.790923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:09:55.846834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:09:55.847026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:09:55.849377 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:09:55.863639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:09:55.863920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:09:55.883171 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Creating config drive at /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config
May 28 03:09:55.884067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:55.889497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzpq_n8ao {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:09:55.924204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.40.100,3260]
May 28 03:09:55.924204 np0000001589 nova-compute[98297]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.40.100,3260] successful.
May 28 03:09:55.924204 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:55.944074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:55.957034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzpq_n8ao" returned: 0 in 0.068s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:09:55.961103 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:55.996769 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.50.100,3260]
May 28 03:09:55.996769 np0000001589 nova-compute[98297]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-2ec35251-dd7e-43f5-bbb5-bfc224b4f175, portal: 192.168.50.100,3260] successful.
May 28 03:09:55.996769 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:56.023069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:09:56.026347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:09:56.026347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== disconnect_volume: return (342ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:09:56.026347 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:09:56.466585 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:56.497736 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:56.503917 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:56.603056 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:56.627576 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid 1d86d49f-8fd0-4682-b508-abb1b434b002 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:56.715945 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:56.719704 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:56.739273 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-861ca3d7-9057-4bf5-960f-5a8b522f074e req-862223b4-2078-4b86-a98c-12e35367fc1a service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:56.739572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-861ca3d7-9057-4bf5-960f-5a8b522f074e req-862223b4-2078-4b86-a98c-12e35367fc1a service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:56.739854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-861ca3d7-9057-4bf5-960f-5a8b522f074e req-862223b4-2078-4b86-a98c-12e35367fc1a service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:56.742344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-861ca3d7-9057-4bf5-960f-5a8b522f074e req-862223b4-2078-4b86-a98c-12e35367fc1a service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:56.742623 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-861ca3d7-9057-4bf5-960f-5a8b522f074e req-862223b4-2078-4b86-a98c-12e35367fc1a service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Processing event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:09:57.377703 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:09:57.378193 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937797.3778574, b3b73e16-989c-483c-866f-4e179edfbeef => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:57.378618 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] VM Started (Lifecycle Event)
May 28 03:09:57.381027 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:09:57.383791 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance spawned successfully.
May 28 03:09:57.385341 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:09:57.639617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab5cdc0b-ee64-4518-958e-1813a5741120 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.092s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:57.882437 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:57.884048 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:57.893859 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:57.897572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:57.897572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:57.897572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:57.897572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:57.898366 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:09:57.902201 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:57.902769 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:57.903044 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:57.903307 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:57.903391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:57.905714 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Terminating instance
May 28 03:09:57.961074 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:58.386138 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:09:58.386466 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937798.3861969, b3b73e16-989c-483c-866f-4e179edfbeef => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:58.386650 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] VM Paused (Lifecycle Event)
May 28 03:09:58.406928 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Took 7.36 seconds to spawn the instance on the hypervisor.
May 28 03:09:58.407884 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:58.408369 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:09:58.435485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:58.439013 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:58.466205 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:58.470386 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:58.494469 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:58.592659 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a08521a0-6930-45e8-9753-75816a6c3dcb req-1d92c57f-bd72-4696-a765-0432cdac6c6c service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-vif-unplugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:58.592911 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a08521a0-6930-45e8-9753-75816a6c3dcb req-1d92c57f-bd72-4696-a765-0432cdac6c6c service nova] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:58.593147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a08521a0-6930-45e8-9753-75816a6c3dcb req-1d92c57f-bd72-4696-a765-0432cdac6c6c service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:58.593373 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a08521a0-6930-45e8-9753-75816a6c3dcb req-1d92c57f-bd72-4696-a765-0432cdac6c6c service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:58.594087 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a08521a0-6930-45e8-9753-75816a6c3dcb req-1d92c57f-bd72-4696-a765-0432cdac6c6c service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] No waiting events found dispatching network-vif-unplugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:58.594546 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a08521a0-6930-45e8-9753-75816a6c3dcb req-1d92c57f-bd72-4696-a765-0432cdac6c6c service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-vif-unplugged-d8858067-1d26-4553-ba2d-4341e6450d66 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:09:58.674801 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:58.753730 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Instance destroyed successfully.
May 28 03:09:58.754134 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'resources' on Instance uuid 1d86d49f-8fd0-4682-b508-abb1b434b002 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:09:58.814074 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dfcb24c0-bb52-4186-a454-0cb3e14f09c5 req-34abafe4-307a-4006-9d31-87c7eda0a261 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:09:58.814288 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dfcb24c0-bb52-4186-a454-0cb3e14f09c5 req-34abafe4-307a-4006-9d31-87c7eda0a261 service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:09:58.814436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dfcb24c0-bb52-4186-a454-0cb3e14f09c5 req-34abafe4-307a-4006-9d31-87c7eda0a261 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:09:58.814548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dfcb24c0-bb52-4186-a454-0cb3e14f09c5 req-34abafe4-307a-4006-9d31-87c7eda0a261 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:58.814684 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dfcb24c0-bb52-4186-a454-0cb3e14f09c5 req-34abafe4-307a-4006-9d31-87c7eda0a261 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] No waiting events found dispatching network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:09:58.814978 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-dfcb24c0-bb52-4186-a454-0cb3e14f09c5 req-34abafe4-307a-4006-9d31-87c7eda0a261 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received unexpected event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 for instance with vm_state active and task_state None.
May 28 03:09:58.892935 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:58.896391 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937798.8951838, b3b73e16-989c-483c-866f-4e179edfbeef => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:09:58.896391 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] VM Resumed (Lifecycle Event)
May 28 03:09:58.923026 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Took 12.95 seconds to build instance.
May 28 03:09:58.966383 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:59.213494 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:59.257111 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-628878147',display_name='tempest-TestEncryptedCinderVolumes-server-628878147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-628878147',id=41,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtSYLL3Q+r016U21YaWd/+UpRWoHfrn68uyMec37BqHrccHPH8qSbXF3vunlrHuOdvUa2EFO8IOk0Cii7ZLIfrv3eLzvj0aoxTL9djtqNALqW7W9k3rIxxq2D8r2fWU8g==',key_name='tempest-keypair-754997858',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-xqdtqhhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=1d86d49f-8fd0-4682-b508-abb1b434b002,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:09:59.257355 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "d8858067-1d26-4553-ba2d-4341e6450d66", "address": "fa:16:3e:1c:b4:b2", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8858067-1d", "ovs_interfaceid": "d8858067-1d26-4553-ba2d-4341e6450d66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:09:59.257991 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b4:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8858067-1d26-4553-ba2d-4341e6450d66,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8858067-1d') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:09:59.258239 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b4:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8858067-1d26-4553-ba2d-4341e6450d66,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8858067-1d') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:09:59.259971 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:59.261858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8858067-1d, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:59.263773 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:59.265062 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:09:59.265361 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98b3e849-e52c-41fa-bf3b-25110c76492f) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:09:59.267296 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:09:59.272885 np0000001589 nova-compute[98297]: INFO os_vif [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:b4:b2,bridge_name='br-int',has_traffic_filtering=True,id=d8858067-1d26-4553-ba2d-4341e6450d66,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8858067-1d')
May 28 03:09:59.273373 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Deleting instance files /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002_del
May 28 03:09:59.274112 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Deletion of /opt/stack/data/nova/instances/1d86d49f-8fd0-4682-b508-abb1b434b002_del complete
May 28 03:09:59.404440 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:09:59.407693 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:09:59.425135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f21f22fa-b2e3-4009-b4fd-3a94944bba03 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.465s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:09:59.779575 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 03:09:59.780054 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:09:59.780173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:09:59.780296 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:09:59.780584 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:59.905949 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:09:59.911590 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99973354399981 future=<Future at 0x7e4b40617b90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:59.912419 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998905895000007 future=<Future at 0x7e4b40617b90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:09:59.912542 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998760814999969 future=<Future at 0x7e4b40617b90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:00.114336 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:00.114403 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing instance network info cache due to event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:00.114579 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:00.114672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:00.114788 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:00.602333 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:00.619250 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:00.673954 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-vif-unplugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:00.674146 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] Acquiring lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:00.674336 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:00.674453 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:00.676124 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] No waiting events found dispatching network-vif-unplugged-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:00.676272 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-vif-unplugged-d8858067-1d26-4553-ba2d-4341e6450d66 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:00.676434 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Received event network-vif-deleted-d8858067-1d26-4553-ba2d-4341e6450d66 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:00.676490 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Neutron deleted interface d8858067-1d26-4553-ba2d-4341e6450d66; detaching it from the instance and deleting it from the info cache
May 28 03:10:00.677996 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8f951f0-9d81-4338-92bc-9b1b22d6ee6e req-05f35e28-8a45-44be-9c6c-0c67d93fcb31 service nova] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Detach interface failed, port_id=d8858067-1d26-4553-ba2d-4341e6450d66, reason: Instance 1d86d49f-8fd0-4682-b508-abb1b434b002 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:10:00.973660 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:01.013592 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:01.098648 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updated VIF entry in instance network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:10:01.098869 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:01.515964 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Took 1.74 seconds to deallocate network for instance.
May 28 03:10:01.601071 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8b56d11b-ca39-4bf5-9745-5414bcb3e0c7 req-d611c4bd-d800-4583-a131-9dc3bc034819 service nova] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:01.903191 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:01.903480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:02.026897 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:02.027374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:02.201050 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:02.201218 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing instance network info cache due to event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:02.201430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:02.201563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:02.201681 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing network info cache for port c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:02.409413 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:02.563593 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:02.563830 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:02.713249 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:02.961693 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:03.022625 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:03.066105 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:03.150714 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updated VIF entry in instance network info cache for port c80fcc18-0110-4f7b-97b1-60565e8719a9. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:10:03.151077 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:03.419302 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:03.577392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.548s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:03.630498 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:03.642020 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deleted allocations for instance 1d86d49f-8fd0-4682-b508-abb1b434b002
May 28 03:10:03.653126 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-db714d79-c7bc-409f-b09c-bfe7684ffc1c req-7c0a8cc4-d286-47ee-b24d-328f428a201f service nova] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:04.267320 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:04.492967 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:04.493241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:04.493564 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Attaching volume 0efa3c41-7988-4a44-805e-8d6483085f9b to /dev/vdb
May 28 03:10:04.655155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71b81b35-185b-4c16-8293-deec7754a5e0 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "1d86d49f-8fd0-4682-b508-abb1b434b002" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.752s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:04.718292 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:04.732030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:10:04.759501 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:04.810690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:10:04.811109 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:10:04.822276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:10:04.823831 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe94:9f33', 'fe80::c062:69ff:feb9:518c', 'fe80::fc16:3eff:feab:c480', 'fe80::3073:48ff:fe9d:fe6f', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fe2f:67e5', 'fe80::fc16:3eff:fe24:3ded'] 
May 28 03:10:04.825130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:10:04.825130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:10:04.825130 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:04.825130 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating existing volume attachment record: 92582077-25d0-4966-a72c-0bca29008e5b {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:10:05.293572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:05.401829 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:10:05.402601 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:05.402601 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:05.403111 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:05.403480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:10:05.416253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:05.416827 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:05.417312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:05.417498 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:10:05.417935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:05.418139 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:10:05.429148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:10:05.429148 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:05.436878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:10:05.436878 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:05.445258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b] added
May 28 03:10:05.445258 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:10:05.445258 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:10:05.445258 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:10:05.445258 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:10:05.445258 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:10:05.445258 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:05.445410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:10:05.445596 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0281(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:10:05.445740 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:10:05.449304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b] added
May 28 03:10:05.449304 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:10:05.449304 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:10:05.449304 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:10:05.449304 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:10:05.449304 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:10:05.449304 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:05.449511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:10:05.449511 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0314(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:10:05.449646 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:10:06.446287 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:10:06.450198 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:10:06.464029 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:10:06.464029 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:10:06.474726 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:10:06.474726 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.481755 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.488190 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.498126 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.498522 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.519172 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.519912 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:06.549634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.50.100,3260]
May 28 03:10:06.549634 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.50.100,3260] successful.
May 28 03:10:06.549634 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.566925 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.582988 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.40.100,3260]
May 28 03:10:06.582988 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.40.100,3260] successful.
May 28 03:10:06.582988 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.589876 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.590150 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:06.590413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:06.590531 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:10:06.591583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('15', '-', '-', 0) found on session 120 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:10:06.591700 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:10:06.597954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:06.610255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 120 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:10:06.610470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.621041 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:06.621393 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:06.621625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.204s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:06.621625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:10:06.624313 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('16', '-', '-', 0) found on session 121 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:10:06.624313 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:10:06.640890 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 121 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:10:06.640890 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:10:07.419106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:10:07.974018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:08.438761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 330000000bb4f5b77 for multipath device dm-10 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:10:08.439006 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:08.439150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:08.439319 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:10:08.442148 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:08.796642 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:08.797385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:08.811993 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:08.812144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:08.812349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:08.812474 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:08.812578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:08.814502 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Terminating instance
May 28 03:10:08.946600 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Attempting to attach volume 0efa3c41-7988-4a44-805e-8d6483085f9b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:10:08.947850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:10:08.947850 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:10:08.947850 np0000001589 nova-compute[98297]:   <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:10:08.947850 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-10"/>
May 28 03:10:08.947850 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:10:08.947850 np0000001589 nova-compute[98297]:   <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:10:08.947850 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:10:08.947850 np0000001589 nova-compute[98297]: </disk>
May 28 03:10:08.947850 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:10:09.240912 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:09.241326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:09.272253 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:09.299190 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:10:09.317603 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:10:09.342692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:09.343278 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:09.365332 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:09.369436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:09.387143 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:09.392409 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:09.494735 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-03754ed8-8532-4264-b2a4-5b4e5d4f8f19 req-11836743-351b-432c-89a5-7a8ee11009e0 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:09.495557 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-03754ed8-8532-4264-b2a4-5b4e5d4f8f19 req-11836743-351b-432c-89a5-7a8ee11009e0 service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:09.495689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-03754ed8-8532-4264-b2a4-5b4e5d4f8f19 req-11836743-351b-432c-89a5-7a8ee11009e0 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:09.496731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-03754ed8-8532-4264-b2a4-5b4e5d4f8f19 req-11836743-351b-432c-89a5-7a8ee11009e0 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:09.497354 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-03754ed8-8532-4264-b2a4-5b4e5d4f8f19 req-11836743-351b-432c-89a5-7a8ee11009e0 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] No waiting events found dispatching network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:09.497496 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-03754ed8-8532-4264-b2a4-5b4e5d4f8f19 req-11836743-351b-432c-89a5-7a8ee11009e0 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:09.664389 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999561064000318 future=<Future at 0x7e4b405221e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:09.667048 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Instance destroyed successfully.
May 28 03:10:09.667614 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lazy-loading 'resources' on Instance uuid bbe1fdbc-f534-444c-8ad2-982bf5108932 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:09.742728 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:10:09.852611 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:09.852810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:09.856487 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:10:09.856662 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Claim successful on node np0000001589
May 28 03:10:10.170024 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:07:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-684942754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serveractionsv293testjson-server-1321674240',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3hDIHKDwZCYjvIQ/AFuVBITm39hgX9ZkqgE1WS7Mwn+hc7CvfM7//lGgtkulsIwGUuyXwpO03DqyaRO+qN8oMsRIB8U2wC7XDILYN6XI/HRQ8z1XvjJ7U34UhbCRY/5Q==',key_name='tempest-keypair-64605543',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:31Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4892c2979f14a6dbc055d3e2d359bfa',ramdisk_id='',reservation_id='r-vj2w8kuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='fa0eb55a-2d07-4302-93b3-8cc680ecbfc7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1182810107',owner_user_name='tempest-ServerActionsV293TestJSON-1182810107-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f776b52236043fb9455d1ec9a21c765',uuid=bbe1fdbc-f534-444c-8ad2-982bf5108932,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:10:10.170287 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converting VIF {"id": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "address": "fa:16:3e:94:9f:33", "network": {"id": "26ba4e09-1492-4080-b4cf-d9aeb4a4a78e", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1422581581-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f4892c2979f14a6dbc055d3e2d359bfa", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b2aac4-ed", "ovs_interfaceid": "b1b2aac4-edce-455a-a545-2340a71b9bfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:10.170820 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:10.171038 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:10:10.172186 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:10.172448 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1b2aac4-ed, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:10.180897 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:10.181921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:10.182491 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:10.183389 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:10.183529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7181259c-c489-49e0-b779-3f988ae56a2a) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:10.183973 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:10.184541 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:10.184820 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:10.186457 np0000001589 nova-compute[98297]: INFO os_vif [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:9f:33,bridge_name='br-int',has_traffic_filtering=True,id=b1b2aac4-edce-455a-a545-2340a71b9bfa,network=Network(26ba4e09-1492-4080-b4cf-d9aeb4a4a78e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b2aac4-ed')
May 28 03:10:10.190251 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:10:10.190251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:10.190251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:10.190251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:10.190251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:10:10.190251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:10.217455 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsi session list stdout=tcp: [112] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65 (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:10.217814 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '112'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '113'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:10:10.217814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '113')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:10:10.218845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65', '112')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:10:10.219646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4069bba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:10:10.219823 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Removing multipathed devices sdf, sdc {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:10:10.220015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Flush multipath device 3300000007c93f769 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:10:10.274626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:10:10.294689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:10.328590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:10:10.378793 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:10:10.379186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:10:10.380400 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:10:10.392040 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:10:10.392256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:10:10.411029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:10.459576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 113, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260]
May 28 03:10:10.459576 np0000001589 nova-compute[98297]: Logout of [sid: 113, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.40.100,3260] successful.
May 28 03:10:10.459576 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:10.477273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:10.491486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:10.527525 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 112, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260]
May 28 03:10:10.527525 np0000001589 nova-compute[98297]: Logout of [sid: 112, target: iqn.2023-03.storpool.com:os--volume-567fb5dd-f8c4-4085-80cd-a3709b2f4c65, portal: 192.168.50.100,3260] successful.
May 28 03:10:10.527525 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:10.544476 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:10.544694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:10.544806 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] <== disconnect_volume: return (356ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:10.544915 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:10:10.545158 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Deleting instance files /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932_del
May 28 03:10:10.545673 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Deletion of /opt/stack/data/nova/instances/bbe1fdbc-f534-444c-8ad2-982bf5108932_del complete
May 28 03:10:10.589989 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:10.590158 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:10.590158 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:10.590341 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:d3:5b:9c, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:11.064033 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Took 1.75 seconds to destroy the instance on the hypervisor.
May 28 03:10:11.064822 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:10:11.065310 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:10:11.065450 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:10:11.065813 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:11.141800 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:11.506735 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:11.507105 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:11.558930 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3da4a7c2-854d-4d3f-91ab-bde49da26071 req-a8d7b46c-4bc7-498b-a0e6-32c72843d3e2 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:11.559115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3da4a7c2-854d-4d3f-91ab-bde49da26071 req-a8d7b46c-4bc7-498b-a0e6-32c72843d3e2 service nova] Acquiring lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:11.559705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3da4a7c2-854d-4d3f-91ab-bde49da26071 req-a8d7b46c-4bc7-498b-a0e6-32c72843d3e2 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:11.560338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3da4a7c2-854d-4d3f-91ab-bde49da26071 req-a8d7b46c-4bc7-498b-a0e6-32c72843d3e2 service nova] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:11.560598 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3da4a7c2-854d-4d3f-91ab-bde49da26071 req-a8d7b46c-4bc7-498b-a0e6-32c72843d3e2 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] No waiting events found dispatching network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:11.561154 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3da4a7c2-854d-4d3f-91ab-bde49da26071 req-a8d7b46c-4bc7-498b-a0e6-32c72843d3e2 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-unplugged-b1b2aac4-edce-455a-a545-2340a71b9bfa for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:11.642768 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8cd1a925-017a-4eb5-a335-4f4515f16680 req-b96b84ad-878b-4c4d-8114-6053e6daf512 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Received event network-vif-deleted-b1b2aac4-edce-455a-a545-2340a71b9bfa {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:11.642768 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-8cd1a925-017a-4eb5-a335-4f4515f16680 req-b96b84ad-878b-4c4d-8114-6053e6daf512 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Neutron deleted interface b1b2aac4-edce-455a-a545-2340a71b9bfa; detaching it from the instance and deleting it from the info cache
May 28 03:10:11.643596 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8cd1a925-017a-4eb5-a335-4f4515f16680 req-b96b84ad-878b-4c4d-8114-6053e6daf512 service nova] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Detach interface failed, port_id=b1b2aac4-edce-455a-a545-2340a71b9bfa, reason: Instance bbe1fdbc-f534-444c-8ad2-982bf5108932 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:10:11.809612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:11.810032 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:12.010247 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:12.055157 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:12.164565 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d6af9c9a-5528-40b8-afe7-c4e7e9ff3906 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.671s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:12.313108 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:12.518006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.665s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:12.518831 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.224s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:12.519048 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:10:12.524822 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:10:12.527738 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Claim successful on node np0000001589
May 28 03:10:12.559029 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Took 1.49 seconds to deallocate network for instance.
May 28 03:10:12.972252 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:13.025280 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:10:13.025542 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:10:13.025818 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:13.026046 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:13.100184 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '950fe02a802540548a5bea56d69f41e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0375d757ca43e3aa5d0d4435fafd3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:10:13.106015 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Took 0.55 seconds to detach 1 volumes for instance.
May 28 03:10:13.110636 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Deleting volume: 567fb5dd-f8c4-4085-80cd-a3709b2f4c65 {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:10:13.318887 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:13.535401 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:10:13.658968 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:13.660827 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Successfully created port: 6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:10:14.039739 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:10:14.093521 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:14.093706 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:14.269199 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Successfully updated port: 6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:10:14.324062 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-changed-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:14.324542 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Refreshing instance network info cache due to event network-changed-6fc4fde1-f427-427b-a178-76de4efe0bb5. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:14.324778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] Acquiring lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:14.324928 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] Acquired lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:14.325104 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Refreshing network info cache for port 6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:14.409694 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:14.409865 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:14.410061 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Attaching volume 0efa3c41-7988-4a44-805e-8d6483085f9b to /dev/vdb
May 28 03:10:14.456461 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:14.466777 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:10:14.487753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:14.546015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:10:14.546457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:10:14.556397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:10:14.558107 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:feab:c480', 'fe80::3073:48ff:fe9d:fe6f', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fe2f:67e5', 'fe80::fc16:3eff:fe24:3ded'] 
May 28 03:10:14.558335 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:10:14.558485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:10:14.558784 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:14.559047 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating existing volume attachment record: d2e878f8-06f6-41ab-a06b-5a6c96deff14 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:10:14.596492 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:14.771595 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:14.827820 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:14.886223 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:14.913542 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00042557799997666734 future=<Future at 0x7e4b40617b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:14.913542 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:14.913542 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.751899695000247 future=<Future at 0x7e4b405221e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:14.913542 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.751825357000143 future=<Future at 0x7e4b405221e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:14.913542 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] Emitting event <LifecycleEvent: 1779937799.911238, 1d86d49f-8fd0-4682-b508-abb1b434b002 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:14.913542 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] VM Stopped (Lifecycle Event)
May 28 03:10:15.016545 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:15.053676 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:10:15.054663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:10:15.054887 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Creating image(s)
May 28 03:10:15.055422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:15.055636 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "/opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:15.056071 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "/opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:15.057480 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:15.059988 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:15.060903 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:15.105525 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.587s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:15.106058 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:10:15.108921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.450s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:15.122625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:10:15.122989 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:15.123169 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:15.123577 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:15.123778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:10:15.135589 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:15.136215 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:15.137148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:15.137358 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:10:15.137795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:15.138024 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:10:15.154250 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:10:15.154250 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:10:15.159600 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:10:15.159600 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:15.171923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.109s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:15.171923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:15.171923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:15.171923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:15.172130 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:15.177307 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:15.177800 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:15.179059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:15.193343 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.201135 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.201790 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.203001 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:15.203352 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:15.203889 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.066s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:15.204126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:10:15.204975 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:15.205321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:10:15.206688 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('15', '0', '0', 0) found on session 120 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:10:15.206846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:10:15.207718 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('16', '0', '0', 0) found on session 121 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:10:15.208082 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:10:15.217194 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 120 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:10:15.217440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:10:15.219830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 121 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:10:15.219830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:10:15.260037 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:15.260377 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:15.310430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk 1073741824" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:15.310951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:15.311367 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:15.394366 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:15.394366 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:10:15.394366 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:15.418095 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b76feea4-0fdd-49d1-ac61-c95fb049c262 tempest-VolumesExtendAttachedTest-470485844 tempest-VolumesExtendAttachedTest-470485844-project-member] [instance: 1d86d49f-8fd0-4682-b508-abb1b434b002] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:15.480757 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:15.481196 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Cannot resize image /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:10:15.481632 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:10:15.481876 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Ensure instance console log exists: /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:10:15.482212 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:15.482504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:15.482683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:15.519676 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-075a7752-3472-4882-9274-97d607e4c938 req-44f14d3a-9071-4063-adef-22360d2675df service nova] Releasing lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:15.519676 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquired lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:15.519809 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:15.614578 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:10:15.614988 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:10:15.616004 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:15.616378 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:15.708927 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d927d6b89cf4f0c96580968ea9c3791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee8d500ee84b5f86e297c2660e183b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:10:15.759401 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:15.759597 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:16.107901 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:16.118985 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:10:16.137581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:10:16.202240 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Successfully created port: 1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:10:16.262846 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:16.271358 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:16.423480 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Updating instance_info_cache with network_info: [{"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:16.622647 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:10:16.740851 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Successfully updated port: 1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:10:16.774875 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.666s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:16.849309 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Deleted allocations for instance bbe1fdbc-f534-444c-8ad2-982bf5108932
May 28 03:10:16.854475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-changed-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:16.858358 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Refreshing instance network info cache due to event network-changed-1b0e475b-4b81-4aa4-a87e-6c86df950129. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:16.858605 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] Acquiring lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:16.858979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] Acquired lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:16.859471 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Refreshing network info cache for port 1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:16.924977 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Releasing lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:16.925333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Instance network_info: |[{"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:10:16.927062 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Start _get_guest_xml network_info=[{"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:10:16.929619 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:16.930864 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-1836637591', uuid='7fb36d37-75ef-49e7-82c0-28fecba99383'), owner=OwnerMeta(userid='950fe02a802540548a5bea56d69f41e1', username='tempest-TestServerVolumeAttachmentScenario-1569926520-project-member', projectid='be0375d757ca43e3aa5d0d4435fafd3f', projectname='tempest-TestServerVolumeAttachmentScenario-1569926520'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937816.9305093) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:10:16.931774 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:10:16.932109 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:10:16.933102 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:10:16.933363 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:10:16.934354 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:10:16.934762 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:10:16.934922 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:10:16.935015 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:10:16.935138 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:10:16.935282 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:10:16.935470 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:10:16.935551 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:10:16.935655 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:10:16.935758 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:10:16.935857 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:10:16.935975 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:10:16.948789 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1836637591',display_name='tempest-TestServerVolumeAttachmentScenario-server-1836637591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testservervolumeattachmentscenario-server-1836637591',id=45,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI04xpegRK3OmUIzLS06ZzdSUmIlnOWWyZ/CFmdiTHsuEv2jkYlEI8pjFZm6PrfTYAssrD1MmAUuGzYccz/WNGvW3QQiA2MyUtwPQNGEhV/Qwg1xfDjCs680rwl6yB33Q==',key_name='tempest-keypair-103191297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be0375d757ca43e3aa5d0d4435fafd3f',ramdisk_id='',reservation_id='r-ujl94g16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1569926520',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1569926520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='950fe02a802540548a5bea56d69f41e1',uuid=7fb36d37-75ef-49e7-82c0-28fecba99383,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:10:16.949036 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Converting VIF {"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:16.949673 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=6fc4fde1-f427-427b-a178-76de4efe0bb5,network=Network(6d21853d-c6c1-4964-a02f-db4282de40c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc4fde1-f4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:16.950255 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:17.058461 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:17.058856 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing instance network info cache due to event network-changed-dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:17.059026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] Acquiring lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:17.059145 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] Acquired lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:17.059312 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Refreshing network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:17.154042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 330000000bb4f5b77 for multipath device dm-10 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:10:17.154888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:17.154888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (2031ms) {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:17.154888 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:10:17.157111 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:17.245117 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:17.361842 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:17.435749 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:17.452671 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] End _get_guest_xml xml=<domain type="qemu">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <uuid>7fb36d37-75ef-49e7-82c0-28fecba99383</uuid>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <name>instance-0000002d</name>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1836637591</nova:name>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:10:16</nova:creationTime>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:user uuid="950fe02a802540548a5bea56d69f41e1">tempest-TestServerVolumeAttachmentScenario-1569926520-project-member</nova:user>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:project uuid="be0375d757ca43e3aa5d0d4435fafd3f">tempest-TestServerVolumeAttachmentScenario-1569926520</nova:project>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         <nova:port uuid="6fc4fde1-f427-427b-a178-76de4efe0bb5">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <system>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <entry name="serial">7fb36d37-75ef-49e7-82c0-28fecba99383</entry>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <entry name="uuid">7fb36d37-75ef-49e7-82c0-28fecba99383</entry>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </system>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <os>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   </os>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <features>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   </features>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   <devices>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk.config"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:f3:86:cf"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <target dev="tap6fc4fde1-f4"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </interface>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/console.log" append="off"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </serial>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <video>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </video>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </rng>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:   </devices>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]: </domain>
May 28 03:10:17.452671 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Preparing to wait for external event network-vif-plugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1836637591',display_name='tempest-TestServerVolumeAttachmentScenario-server-1836637591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testservervolumeattachmentscenario-server-1836637591',id=45,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI04xpegRK3OmUIzLS06ZzdSUmIlnOWWyZ/CFmdiTHsuEv2jkYlEI8pjFZm6PrfTYAssrD1MmAUuGzYccz/WNGvW3QQiA2MyUtwPQNGEhV/Qwg1xfDjCs680rwl6yB33Q==',key_name='tempest-keypair-103191297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be0375d757ca43e3aa5d0d4435fafd3f',ramdisk_id='',reservation_id='r-ujl94g16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1569926520',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1569926520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='950fe02a802540548a5bea56d69f41e1',uuid=7fb36d37-75ef-49e7-82c0-28fecba99383,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Converting VIF {"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=6fc4fde1-f427-427b-a178-76de4efe0bb5,network=Network(6d21853d-c6c1-4964-a02f-db4282de40c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc4fde1-f4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=6fc4fde1-f427-427b-a178-76de4efe0bb5,network=Network(6d21853d-c6c1-4964-a02f-db4282de40c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc4fde1-f4') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:17.456788 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:10:17.457335 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:17.457335 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74f01e2b-fd27-5dbc-8dcb-98c18f1a02ca', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:17.458209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:17.458844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:17.460124 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:17.463156 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:17.463408 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fc4fde1-f4, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:17.463799 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6fc4fde1-f4, col_values=(('qos', UUID('8ce621c8-b3c9-492d-a202-75f26360430f')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:17.463981 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6fc4fde1-f4, col_values=(('external_ids', {'iface-id': '6fc4fde1-f427-427b-a178-76de4efe0bb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:86:cf', 'vm-uuid': '7fb36d37-75ef-49e7-82c0-28fecba99383'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:17.464810 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:17.465956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:17.471273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:17.472128 np0000001589 nova-compute[98297]: INFO os_vif [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=6fc4fde1-f427-427b-a178-76de4efe0bb5,network=Network(6d21853d-c6c1-4964-a02f-db4282de40c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc4fde1-f4')
May 28 03:10:17.562616 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:17.564220 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:17.584851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:17.585049 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:17.585202 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:17.585345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:17.585441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:17.587476 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Terminating instance
May 28 03:10:17.634748 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:10:17.635619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:10:17.635886 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Creating image(s)
May 28 03:10:17.636298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:17.636442 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:17.636818 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:17.637301 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:17.639826 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:17.640944 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:17.666860 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Attempting to attach volume 0efa3c41-7988-4a44-805e-8d6483085f9b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:10:17.672567 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:10:17.672567 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:10:17.672567 np0000001589 nova-compute[98297]:   <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:10:17.672567 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-10"/>
May 28 03:10:17.672567 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:10:17.672567 np0000001589 nova-compute[98297]:   <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:10:17.672567 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:10:17.672567 np0000001589 nova-compute[98297]: </disk>
May 28 03:10:17.672567 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:10:17.723961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:17.724352 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:17.724768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:17.725165 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:17.729303 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:17.729707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:17.818665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:17.819343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:17.863352 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6690c490-81c4-4432-9b9a-9b8a4bf6d99e tempest-ServerActionsV293TestJSON-1182810107 tempest-ServerActionsV293TestJSON-1182810107-project-member] Lock "bbe1fdbc-f534-444c-8ad2-982bf5108932" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.049s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:17.876566 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk 1073741824" returned: 0 in 0.057s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:17.877385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.152s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:17.877814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:17.933015 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:17.969625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:17.972595 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:10:17.972595 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:17.991680 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.064695 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:18.067544 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Cannot resize image /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:10:18.067544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:10:18.067544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Ensure instance console log exists: /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:10:18.067544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:18.067544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:18.067910 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:18.068865 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d019ae03-e5e8-44a7-8d6e-e6dbf6518b67 req-1051b332-62a3-4415-98e1-0188895b7955 service nova] Releasing lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:18.069509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:18.069678 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:18.085083 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updated VIF entry in instance network info cache for port dc68665e-2eb3-4e6f-b031-e32d71c7fee2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:10:18.085508 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [{"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:18.090572 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:10:18.122500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.123894 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.143357 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.148939 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.178519 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.435137 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99971127400022 future=<Future at 0x7e4b64569520 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:18.438838 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Instance destroyed successfully.
May 28 03:10:18.441406 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lazy-loading 'resources' on Instance uuid c792127f-b33e-48b3-8da7-ba4bd8ebeac0 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:18.588532 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f509b936-c835-453a-9c77-8723bad307a7 req-edc4fc2b-279c-48e7-a8df-2ffacbec3645 service nova] Releasing lock "refresh_cache-c792127f-b33e-48b3-8da7-ba4bd8ebeac0" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:18.651286 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:18.801492 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:18.927248 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Updating instance_info_cache with network_info: [{"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:18.943898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1722686750',display_name='tempest-TestShelveInstance-server-1722686750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testshelveinstance-server-1722686750',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRA+otnkfm7lbFsCKUzuGvqR+nbstrjEvckiUyG3QiLHC4l387rAxGfMMadCii8UDww36pB8lIkDSWkmlCz6/E47NEFRnn5NaQ3xMdlL4vFWn8T/60SSfxtyUXxMofy7A==',key_name='tempest-TestShelveInstance-1678016135',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:39Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b61f52dbd3ed46f4814f2c0b132c713d',ramdisk_id='',reservation_id='r-t5rvslrj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1399725326',owner_user_name='tempest-TestShelveInstance-1399725326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:09:39Z,user_data=None,user_id='1be2b4e542c34494a4052b18a1cea270',uuid=c792127f-b33e-48b3-8da7-ba4bd8ebeac0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:10:18.944117 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converting VIF {"id": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "address": "fa:16:3e:ab:c4:80", "network": {"id": "ba77b73c-6901-471a-aaef-455025858ae1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1853342550-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b61f52dbd3ed46f4814f2c0b132c713d", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc68665e-2e", "ovs_interfaceid": "dc68665e-2eb3-4e6f-b031-e32d71c7fee2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:18.944689 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:18.944908 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:10:18.946310 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.946614 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc68665e-2e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:18.948804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.948996 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:18.953297 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.954425 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.954579 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=94202ef9-d558-4458-8f0e-e26426764033) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:18.955711 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.955711 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:18.959956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:18.961994 np0000001589 nova-compute[98297]: INFO os_vif [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c4:80,bridge_name='br-int',has_traffic_filtering=True,id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2,network=Network(ba77b73c-6901-471a-aaef-455025858ae1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc68665e-2e')
May 28 03:10:18.963421 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:10:18.963746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:18.963878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:18.964201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:18.964484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:10:18.964608 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:18.994113 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsi session list stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: tcp: [117] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:18.994420 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:18.994420 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:10:18.994636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '116')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:10:18.995420 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a', '117')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:10:18.996383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b83667880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'): ({'sdi'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:10:18.996773 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Removing multipathed devices sde, sdi {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:10:18.997001 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Flush multipath device 330000000436e0942 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:10:19.001560 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:19.001560 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:19.001560 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No VIF found with MAC fa:16:3e:f3:86:cf, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:19.001560 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Using config drive
May 28 03:10:19.063088 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:10:19.101586 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:10:19.127917 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:19.128140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:19.128364 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:19.128496 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:19.128633 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] No waiting events found dispatching network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:19.128769 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:19.128859 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:19.128978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] Acquiring lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:19.129167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:19.129255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:19.129342 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] No waiting events found dispatching network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:19.129441 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-88fc2418-5948-4853-a26d-c537ac66ccb4 req-970d5ca8-8293-49e4-a5d0-d92841fab6bb service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-unplugged-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:19.148932 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Checking to see if SCSI volumes sde, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:10:19.149121 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] SCSI volumes sde, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:10:19.150359 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Checking to see if device paths {'sde', 'sdi'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:10:19.161646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Device paths {'sde', 'sdi'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:10:19.161921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:10:19.174674 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:19.203979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 116, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260]
May 28 03:10:19.203979 np0000001589 nova-compute[98297]: Logout of [sid: 116, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.40.100,3260] successful.
May 28 03:10:19.203979 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:19.219059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:19.229022 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:19.262207 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260]
May 28 03:10:19.262207 np0000001589 nova-compute[98297]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-95f8b2ce-63a6-4f18-92fd-0866d9c3a24a, portal: 192.168.50.100,3260] successful.
May 28 03:10:19.262207 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:19.276730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:19.276966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:19.277095 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] <== disconnect_volume: return (313ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:19.277217 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:10:19.277503 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Deleting instance files /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0_del
May 28 03:10:19.277949 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Deletion of /opt/stack/data/nova/instances/c792127f-b33e-48b3-8da7-ba4bd8ebeac0_del complete
May 28 03:10:19.324462 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:19.324580 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:19.324650 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:19.324724 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:24:3d:ed, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:19.429875 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:19.429875 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Instance network_info: |[{"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:10:19.431587 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Start _get_guest_xml network_info=[{"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:10:19.434242 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:19.435507 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-434285491', uuid='d5d49eed-1046-4ba3-840f-25b755d33eaf'), owner=OwnerMeta(userid='2d927d6b89cf4f0c96580968ea9c3791', username='tempest-TestEncryptedCinderVolumes-781621704-project-member', projectid='0eee8d500ee84b5f86e297c2660e183b', projectname='tempest-TestEncryptedCinderVolumes-781621704'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937819.4350986) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:10:19.437108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:10:19.437581 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:10:19.438641 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:10:19.438892 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:10:19.439859 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:10:19.440243 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:10:19.440480 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:10:19.440602 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:10:19.440814 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:10:19.440957 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:10:19.441087 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:10:19.441314 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:10:19.441470 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:10:19.441712 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:10:19.441820 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:10:19.441935 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:10:19.455863 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-434285491',display_name='tempest-TestEncryptedCinderVolumes-server-434285491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-434285491',id=46,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuRsZaPp+IkaD/xB/fVI4ZjnQx3ehOgyY3IGkFpRBHvqUpk5jFw25Qtm6KyjCkSgI1RB90SPy29GYgmOv9sPA7iu6bm6VoMe/cuEWGOGXD55VlPJbaY3dhdv4BsSZYnbw==',key_name='tempest-keypair-179206037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-mfixxw99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=d5d49eed-1046-4ba3-840f-25b755d33eaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:10:19.456695 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:19.458072 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:cc,bridge_name='br-int',has_traffic_filtering=True,id=1b0e475b-4b81-4aa4-a87e-6c86df950129,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0e475b-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:19.458708 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'pci_devices' on Instance uuid d5d49eed-1046-4ba3-840f-25b755d33eaf {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:19.506170 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:19.633353 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Creating config drive at /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk.config
May 28 03:10:19.637069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv48m88sv {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:19.690755 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpv48m88sv" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:19.756526 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:19.789889 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Took 1.70 seconds to destroy the instance on the hypervisor.
May 28 03:10:19.791115 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:10:19.791501 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:10:19.791663 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:10:19.792070 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:19.874560 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:19.961773 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] End _get_guest_xml xml=<domain type="qemu">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <uuid>d5d49eed-1046-4ba3-840f-25b755d33eaf</uuid>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <name>instance-0000002e</name>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-434285491</nova:name>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:10:19</nova:creationTime>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:user uuid="2d927d6b89cf4f0c96580968ea9c3791">tempest-TestEncryptedCinderVolumes-781621704-project-member</nova:user>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:project uuid="0eee8d500ee84b5f86e297c2660e183b">tempest-TestEncryptedCinderVolumes-781621704</nova:project>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         <nova:port uuid="1b0e475b-4b81-4aa4-a87e-6c86df950129">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <system>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <entry name="serial">d5d49eed-1046-4ba3-840f-25b755d33eaf</entry>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <entry name="uuid">d5d49eed-1046-4ba3-840f-25b755d33eaf</entry>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </system>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <os>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   </os>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <features>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   </features>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   <devices>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk.config"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:b6:35:cc"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <target dev="tap1b0e475b-4b"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </interface>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/console.log" append="off"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </serial>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <video>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </video>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </rng>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:   </devices>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]: </domain>
May 28 03:10:19.961773 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:10:19.964413 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Preparing to wait for external event network-vif-plugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:10:19.964413 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:19.964413 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:19.964413 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:19.964413 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-434285491',display_name='tempest-TestEncryptedCinderVolumes-server-434285491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-434285491',id=46,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuRsZaPp+IkaD/xB/fVI4ZjnQx3ehOgyY3IGkFpRBHvqUpk5jFw25Qtm6KyjCkSgI1RB90SPy29GYgmOv9sPA7iu6bm6VoMe/cuEWGOGXD55VlPJbaY3dhdv4BsSZYnbw==',key_name='tempest-keypair-179206037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-mfixxw99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=d5d49eed-1046-4ba3-840f-25b755d33eaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:10:19.968305 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:19.968305 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:cc,bridge_name='br-int',has_traffic_filtering=True,id=1b0e475b-4b81-4aa4-a87e-6c86df950129,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0e475b-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:19.968305 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:cc,bridge_name='br-int',has_traffic_filtering=True,id=1b0e475b-4b81-4aa4-a87e-6c86df950129,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0e475b-4b') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:10:19.968305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:19.968305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:19.968305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:10:19.968305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:19.968659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fa99064-4a68-5471-9acb-3bc24492c423', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:19.970124 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:19.979349 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:19.981854 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:19.982087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b0e475b-4b, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:19.982699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b0e475b-4b, col_values=(('qos', UUID('9eeb1b85-0aa1-4a6e-944d-f3fa90a5caa0')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:19.982959 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b0e475b-4b, col_values=(('external_ids', {'iface-id': '1b0e475b-4b81-4aa4-a87e-6c86df950129', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:35:cc', 'vm-uuid': 'd5d49eed-1046-4ba3-840f-25b755d33eaf'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:19.984462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:19.986060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:19.996528 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:19.998035 np0000001589 nova-compute[98297]: INFO os_vif [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:35:cc,bridge_name='br-int',has_traffic_filtering=True,id=1b0e475b-4b81-4aa4-a87e-6c86df950129,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0e475b-4b')
May 28 03:10:20.211644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:20.240840 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:20.242881 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:20.253156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4cda05c5-1618-4054-8739-0762b47b1cc8 req-964fc5a8-4ae2-4cba-b102-51b1c0f8a80b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Received event network-vif-deleted-dc68665e-2eb3-4e6f-b031-e32d71c7fee2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:20.253156 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-4cda05c5-1618-4054-8739-0762b47b1cc8 req-964fc5a8-4ae2-4cba-b102-51b1c0f8a80b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Neutron deleted interface dc68665e-2eb3-4e6f-b031-e32d71c7fee2; detaching it from the instance and deleting it from the info cache
May 28 03:10:20.253969 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4cda05c5-1618-4054-8739-0762b47b1cc8 req-964fc5a8-4ae2-4cba-b102-51b1c0f8a80b service nova] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Detach interface failed, port_id=dc68665e-2eb3-4e6f-b031-e32d71c7fee2, reason: Instance c792127f-b33e-48b3-8da7-ba4bd8ebeac0 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:10:20.343621 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:20.413272 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-21ed7228-083b-4b66-98eb-9d34d85d8451 req-6e354f9a-99f1-482d-8325-4edff48b7089 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-vif-plugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:20.413272 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-21ed7228-083b-4b66-98eb-9d34d85d8451 req-6e354f9a-99f1-482d-8325-4edff48b7089 service nova] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:20.413526 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-21ed7228-083b-4b66-98eb-9d34d85d8451 req-6e354f9a-99f1-482d-8325-4edff48b7089 service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:20.413526 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-21ed7228-083b-4b66-98eb-9d34d85d8451 req-6e354f9a-99f1-482d-8325-4edff48b7089 service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:20.413638 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-21ed7228-083b-4b66-98eb-9d34d85d8451 req-6e354f9a-99f1-482d-8325-4edff48b7089 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Processing event network-vif-plugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:10:20.588930 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:20.597622 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:20.629646 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:20.689040 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:20.879219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4aff6bdf-992f-4337-9a0c-d3516ee856c7 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.469s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:21.127746 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937821.1272962, 7fb36d37-75ef-49e7-82c0-28fecba99383 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:21.127926 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] VM Started (Lifecycle Event)
May 28 03:10:21.129737 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:10:21.132603 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:10:21.134872 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Instance spawned successfully.
May 28 03:10:21.135262 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:10:21.191652 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Took 1.40 seconds to deallocate network for instance.
May 28 03:10:21.519255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:21.519255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:21.519255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:b6:35:cc, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:21.519255 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Using config drive
May 28 03:10:21.634747 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:21.637251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:21.644098 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:21.644288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:21.644592 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:21.644846 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:21.645088 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:21.645383 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:21.753731 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Took 0.56 seconds to detach 1 volumes for instance.
May 28 03:10:21.755456 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Deleting volume: 95f8b2ce-63a6-4f18-92fd-0866d9c3a24a {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:10:22.024540 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:22.140449 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:10:22.140751 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937822.1405365, 7fb36d37-75ef-49e7-82c0-28fecba99383 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:22.140903 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] VM Paused (Lifecycle Event)
May 28 03:10:22.153093 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Took 7.10 seconds to spawn the instance on the hypervisor.
May 28 03:10:22.154300 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:22.171975 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Creating config drive at /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk.config
May 28 03:10:22.178135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfq573ex4 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:22.250691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfq573ex4" returned: 0 in 0.069s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:22.300318 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:22.300521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:22.501489 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-522280f8-2436-43f1-86f3-7e0997d85659 req-3e2e9fbd-7a74-42d3-9612-59acb97c4f0e service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-vif-plugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:22.502019 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-522280f8-2436-43f1-86f3-7e0997d85659 req-3e2e9fbd-7a74-42d3-9612-59acb97c4f0e service nova] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:22.502888 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-522280f8-2436-43f1-86f3-7e0997d85659 req-3e2e9fbd-7a74-42d3-9612-59acb97c4f0e service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:22.506020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-522280f8-2436-43f1-86f3-7e0997d85659 req-3e2e9fbd-7a74-42d3-9612-59acb97c4f0e service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:22.506307 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-522280f8-2436-43f1-86f3-7e0997d85659 req-3e2e9fbd-7a74-42d3-9612-59acb97c4f0e service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] No waiting events found dispatching network-vif-plugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:22.506479 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-522280f8-2436-43f1-86f3-7e0997d85659 req-3e2e9fbd-7a74-42d3-9612-59acb97c4f0e service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received unexpected event network-vif-plugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 for instance with vm_state active and task_state None.
May 28 03:10:22.645479 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:22.646577 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937822.6462593, 7fb36d37-75ef-49e7-82c0-28fecba99383 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:22.646882 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] VM Resumed (Lifecycle Event)
May 28 03:10:22.676434 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Took 12.87 seconds to build instance.
May 28 03:10:22.725486 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:22.758174 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:22.764473 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:22.854241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:22.869054 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Stashing vm_state: active {{(pid=98297) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 03:10:22.933690 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:22.934111 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:22.980019 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:23.110009 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7fbc885-cdda-4d5a-9566-bac547360be1 req-12bbc58f-152d-410b-8655-fbe2b4dec9f5 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-vif-plugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:23.112107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7fbc885-cdda-4d5a-9566-bac547360be1 req-12bbc58f-152d-410b-8655-fbe2b4dec9f5 service nova] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:23.112107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7fbc885-cdda-4d5a-9566-bac547360be1 req-12bbc58f-152d-410b-8655-fbe2b4dec9f5 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:23.112107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f7fbc885-cdda-4d5a-9566-bac547360be1 req-12bbc58f-152d-410b-8655-fbe2b4dec9f5 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:23.112107 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f7fbc885-cdda-4d5a-9566-bac547360be1 req-12bbc58f-152d-410b-8655-fbe2b4dec9f5 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Processing event network-vif-plugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:10:23.150334 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:23.153337 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:23.158338 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:23.173019 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:23.181878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.384s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:23.426658 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:23.436889 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:23.584604 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:10:23.586269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:10:23.587936 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Instance spawned successfully.
May 28 03:10:23.588383 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:10:23.661629 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937823.660208, d5d49eed-1046-4ba3-840f-25b755d33eaf => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:23.661629 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] VM Started (Lifecycle Event)
May 28 03:10:23.946485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.646s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:23.948100 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.520s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:24.015333 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Deleted allocations for instance c792127f-b33e-48b3-8da7-ba4bd8ebeac0
May 28 03:10:24.099450 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:24.100717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:24.100717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:24.100717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:24.101203 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:24.101203 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:24.163041 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:24.165262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:24.176364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:24.455619 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:10:24.455831 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Claim successful on node np0000001589
May 28 03:10:24.573251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-changed-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:24.573439 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Refreshing instance network info cache due to event network-changed-6fc4fde1-f427-427b-a178-76de4efe0bb5. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:24.574064 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] Acquiring lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:24.574196 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] Acquired lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:24.574354 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Refreshing network info cache for port 6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:24.606136 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Took 6.97 seconds to spawn the instance on the hypervisor.
May 28 03:10:24.606345 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:24.664298 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00038442100003521773 future=<Future at 0x7e4b405221e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:24.664398 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:24.664481 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.77031791699983 future=<Future at 0x7e4b64569520 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:24.664551 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=8.77023915000018 future=<Future at 0x7e4b64569520 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:24.665133 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779937809.6637855, bbe1fdbc-f534-444c-8ad2-982bf5108932 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:24.665347 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] VM Stopped (Lifecycle Event)
May 28 03:10:24.668993 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:10:24.670351 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937824.6690767, d5d49eed-1046-4ba3-840f-25b755d33eaf => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:24.670351 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] VM Paused (Lifecycle Event)
May 28 03:10:24.962404 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating resource usage from migration 9a2eb8ee-20f3-499a-a365-f015a60b970a
May 28 03:10:24.984244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:25.024322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56a61473-4347-46f5-a0f9-307ec7e37779 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Lock "c792127f-b33e-48b3-8da7-ba4bd8ebeac0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.439s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:25.078778 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:25.115108 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Took 14.87 seconds to build instance.
May 28 03:10:25.167648 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2f51f7f4-dfb9-469e-a274-4567256fcbf1 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: bbe1fdbc-f534-444c-8ad2-982bf5108932] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:25.171781 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:25.173142 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937825.1729655, d5d49eed-1046-4ba3-840f-25b755d33eaf => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:25.173337 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] VM Resumed (Lifecycle Event)
May 28 03:10:25.184158 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-684fc440-17a5-4f96-88bf-36ddd9fa615e req-22435ce0-d51f-4899-aa69-83d8c8ffbda4 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-vif-plugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:25.184158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-684fc440-17a5-4f96-88bf-36ddd9fa615e req-22435ce0-d51f-4899-aa69-83d8c8ffbda4 service nova] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:25.184340 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-684fc440-17a5-4f96-88bf-36ddd9fa615e req-22435ce0-d51f-4899-aa69-83d8c8ffbda4 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:25.184428 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-684fc440-17a5-4f96-88bf-36ddd9fa615e req-22435ce0-d51f-4899-aa69-83d8c8ffbda4 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:25.184639 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-684fc440-17a5-4f96-88bf-36ddd9fa615e req-22435ce0-d51f-4899-aa69-83d8c8ffbda4 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] No waiting events found dispatching network-vif-plugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:25.186119 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-684fc440-17a5-4f96-88bf-36ddd9fa615e req-22435ce0-d51f-4899-aa69-83d8c8ffbda4 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received unexpected event network-vif-plugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 for instance with vm_state active and task_state None.
May 28 03:10:25.482879 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:25.542897 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:25.543019 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:25.616640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e4f3e3ae-b95c-4eef-afcd-c4c70da59118 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.375s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:25.675758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:25.679747 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:26.045547 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:26.199806 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Updated VIF entry in instance network info cache for port 6fc4fde1-f427-427b-a178-76de4efe0bb5. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:10:26.199806 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Updating instance_info_cache with network_info: [{"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:26.551762 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.605s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:26.551887 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Migrating
May 28 03:10:26.552062 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:10:26.706337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7d6c6cdc-f8d6-4219-96d5-dee59750506e req-272a8266-76b2-4902-afa6-a815d8a342c8 service nova] Releasing lock "refresh_cache-7fb36d37-75ef-49e7-82c0-28fecba99383" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:26.707376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:27.071937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:27.072655 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:27.072655 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:27.267328 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-changed-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:27.267751 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Refreshing instance network info cache due to event network-changed-1b0e475b-4b81-4aa4-a87e-6c86df950129. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:27.268148 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] Acquiring lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:27.269246 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] Acquired lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:27.269246 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Refreshing network info cache for port 1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:27.574279 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:27.774291 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:27.828087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:27.982242 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:27.998439 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:28.154415 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:28.159729 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:28.288758 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Updated VIF entry in instance network info cache for port 1b0e475b-4b81-4aa4-a87e-6c86df950129. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:10:28.289182 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Updating instance_info_cache with network_info: [{"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:28.519886 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:28.520111 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:28.661624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:28.793351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9154fafe-2716-470e-88bd-586ac42e65f6 req-b28d8bb5-eb9e-468a-ac18-4cae8608cc82 service nova] Releasing lock "refresh_cache-d5d49eed-1046-4ba3-840f-25b755d33eaf" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:29.021955 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:10:29.286865 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:29.287238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:29.577015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:29.577358 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:29.581122 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:10:29.581740 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Claim successful on node np0000001589
May 28 03:10:29.670967 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:29.673108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:29.673394 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:29.674409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:29.674558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:29.676459 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Terminating instance
May 28 03:10:29.790818 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:10:29.985105 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.115830 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.177928 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Starting migrate_disk_and_power_off {{(pid=98297) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 03:10:30.179535 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:10:30.219376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.255190 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.350129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:30.411756 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6270fcd1-df73-4e04-9828-e42cb9be8fc9 req-7bd3745a-3427-4d73-a413-e37756ecc78b service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-vif-unplugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:30.411756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6270fcd1-df73-4e04-9828-e42cb9be8fc9 req-7bd3745a-3427-4d73-a413-e37756ecc78b service nova] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:30.411756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6270fcd1-df73-4e04-9828-e42cb9be8fc9 req-7bd3745a-3427-4d73-a413-e37756ecc78b service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:30.411756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6270fcd1-df73-4e04-9828-e42cb9be8fc9 req-7bd3745a-3427-4d73-a413-e37756ecc78b service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:30.411756 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6270fcd1-df73-4e04-9828-e42cb9be8fc9 req-7bd3745a-3427-4d73-a413-e37756ecc78b service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] No waiting events found dispatching network-vif-unplugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:30.411756 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6270fcd1-df73-4e04-9828-e42cb9be8fc9 req-7bd3745a-3427-4d73-a413-e37756ecc78b service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-vif-unplugged-34ac475a-4f8d-4831-98d1-29ef9172a387 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:30.455916 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.466004 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.643051 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999750024999685 future=<Future at 0x7e4b406e3920 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:30.648832 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.654691 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance destroyed successfully.
May 28 03:10:30.660583 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=42,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:42Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-mscd5hbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b00002ac-1bf2-43ff-9836-3aa0f11fdabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:10:30.660793 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:30.662172 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:30.662172 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:10:30.666968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.666968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf6d0b8a-02, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:30.669252 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:30.672899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.675771 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.678977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.679157 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10fe5aca-a8a1-4498-9801-31e36eb734b4) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:30.680601 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:30.681961 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999754543000108 future=<Future at 0x7e4b644b0b90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:30.684547 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Instance destroyed successfully.
May 28 03:10:30.687391 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'resources' on Instance uuid b6062670-bd92-40aa-ab30-10f20543db3a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:30.688362 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:30.691744 np0000001589 nova-compute[98297]: INFO os_vif [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02')
May 28 03:10:31.137900 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:31.138271 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:10:31.165176 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:31.165418 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:31.191317 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1921991276',display_name='tempest-AttachVolumeNegativeTest-server-1921991276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-1921991276',id=43,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7ZXh8DlLJAkFd2Y2E9nl41Mdz76uTZ9dw+UKfn40+POzt0+0uB1qokve0RoEyx7bw7ZsEjhH3JeldMLP4qsaj+3SMeNUVJ+8JCA/zehXFh/kGk3cxOLdEP0GOCDX0fBw==',key_name='tempest-keypair-345132425',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:50Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-x6508qu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:09:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=b6062670-bd92-40aa-ab30-10f20543db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:10:31.191586 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "34ac475a-4f8d-4831-98d1-29ef9172a387", "address": "fa:16:3e:2f:67:e5", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ac475a-4f", "ovs_interfaceid": "34ac475a-4f8d-4831-98d1-29ef9172a387", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:31.192350 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=34ac475a-4f8d-4831-98d1-29ef9172a387,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ac475a-4f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:31.192656 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=34ac475a-4f8d-4831-98d1-29ef9172a387,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ac475a-4f') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:10:31.194030 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:31.194244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34ac475a-4f, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:31.197179 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:31.198772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:31.198896 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bec264f-209c-4a8c-949e-05fe95e3b1d3) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:31.200164 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:31.200713 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:31.202583 np0000001589 nova-compute[98297]: INFO os_vif [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:67:e5,bridge_name='br-int',has_traffic_filtering=True,id=34ac475a-4f8d-4831-98d1-29ef9172a387,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ac475a-4f')
May 28 03:10:31.202986 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Deleting instance files /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a_del
May 28 03:10:31.203995 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Deletion of /opt/stack/data/nova/instances/b6062670-bd92-40aa-ab30-10f20543db3a_del complete
May 28 03:10:31.235996 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Detected multiple connections on this host for volume: 0efa3c41-7988-4a44-805e-8d6483085f9b, skipping target disconnect.
May 28 03:10:31.243261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:31.329961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:31.330600 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:31.418925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:31.421708 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:10:31.422298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_resize/disk /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:31.513194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "cp -r /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_resize/disk /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:31.513942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_resize/disk.config /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:31.561533 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "cp -r /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_resize/disk.config /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:31.562485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_resize/disk.info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:31.610351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "cp -r /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_resize/disk.info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:31.669007 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:31.711630 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Took 1.53 seconds to destroy the instance on the hypervisor.
May 28 03:10:31.712559 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:10:31.713003 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:10:31.713003 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:10:31.713256 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:31.820492 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:32.177000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.600s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:32.177636 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.828s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:32.178192 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:10:32.184605 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:10:32.184605 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Claim successful on node np0000001589
May 28 03:10:32.487860 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-vif-unplugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:32.488332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Acquiring lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:32.488520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:32.488639 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Lock "b6062670-bd92-40aa-ab30-10f20543db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:32.488764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] No waiting events found dispatching network-vif-unplugged-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:32.488934 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-vif-unplugged-34ac475a-4f8d-4831-98d1-29ef9172a387 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:32.488978 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:32.489098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:32.489209 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:32.489507 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:32.489604 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] No waiting events found dispatching network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:32.489738 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received unexpected event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 for instance with vm_state active and task_state resize_migrating.
May 28 03:10:32.489834 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:32.489945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:32.490054 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:32.490169 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:32.490319 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] No waiting events found dispatching network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:32.490426 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received unexpected event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 for instance with vm_state active and task_state resize_migrating.
May 28 03:10:32.490538 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Received event network-vif-deleted-34ac475a-4f8d-4831-98d1-29ef9172a387 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:32.490689 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Neutron deleted interface 34ac475a-4f8d-4831-98d1-29ef9172a387; detaching it from the instance and deleting it from the info cache
May 28 03:10:32.491616 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-04b59188-edbd-48a8-bd1c-30397412b298 req-db158fee-d204-45b8-afbd-bce3bdedb19e service nova] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Detach interface failed, port_id=34ac475a-4f8d-4831-98d1-29ef9172a387, reason: Instance b6062670-bd92-40aa-ab30-10f20543db3a could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:10:32.692098 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:10:32.692554 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:10:32.692717 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:32.693246 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:32.731200 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:32.749103 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:32.750281 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:32.768007 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f21fb57a7c104603aa9c06ad57a1ebc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594031941474707b7b4dbe1e8124dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:10:32.828395 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 binding to destination host np0000001589 is already ACTIVE {{(pid=98297) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 03:10:32.992281 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:33.197035 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:10:33.229588 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Successfully created port: e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:10:33.234410 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Took 1.52 seconds to deallocate network for instance.
May 28 03:10:33.436244 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0013963599999442522 future=<Future at 0x7e4b64569520 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:33.436995 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Emitting event <LifecycleEvent: 1779937818.434723, c792127f-b33e-48b3-8da7-ba4bd8ebeac0 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:33.437256 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:33.437364 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=12.20538429499993 future=<Future at 0x7e4b406e3920 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:33.437463 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=12.205277175999981 future=<Future at 0x7e4b406e3920 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:33.437985 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] VM Stopped (Lifecycle Event)
May 28 03:10:33.702609 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:10:33.742899 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:33.801578 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:33.801833 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:33.813838 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Successfully updated port: e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:10:33.839945 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:10:33.853824 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:33.853995 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:33.854158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:33.943117 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: c792127f-b33e-48b3-8da7-ba4bd8ebeac0] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:34.306586 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:34.320164 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:34.320164 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:34.320164 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:34.384696 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:34.546989 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-changed-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:34.547193 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Refreshing instance network info cache due to event network-changed-e848b1f6-2106-4918-8d83-ef483c8c12f9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:34.547386 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] Acquiring lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:34.712849 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:10:34.712849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:10:34.712849 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Creating image(s)
May 28 03:10:34.712849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:34.712849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:34.716507 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:34.717625 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:34.719390 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:34.721775 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:34.819918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:34.821024 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:34.821719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:34.822260 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:34.832544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.653s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:34.832544 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:10:34.834914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.092s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:34.836357 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:34.843361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:34.878266 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:34.954165 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.111s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:34.954647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:34.987312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:34.987514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:34.987825 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:34.991449 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:35.019796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk 1073741824" returned: 0 in 0.065s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:35.020220 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:35.020625 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:35.113306 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:35.113306 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:10:35.113306 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:35.201102 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:35.202085 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Cannot resize image /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:10:35.204608 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:10:35.204608 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Ensure instance console log exists: /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:10:35.206892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:35.207219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:35.207423 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:35.221379 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:35.339663 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:10:35.339850 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:10:35.340155 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:35.340395 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:35.403193 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Updating instance_info_cache with network_info: [{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:35.440148 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f21fb57a7c104603aa9c06ad57a1ebc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594031941474707b7b4dbe1e8124dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:10:35.497955 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:35.662166 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:35.662382 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:35.842122 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:10:35.847900 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Successfully created port: ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:10:35.905245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:35.905481 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance network_info: |[{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:10:35.907644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] Acquired lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:35.907868 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Refreshing network info cache for port e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:35.913110 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Start _get_guest_xml network_info=[{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:10:35.918471 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:35.919585 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-631836882', uuid='5683aa74-b79d-4dbf-9a99-796cbff0c04d'), owner=OwnerMeta(userid='f21fb57a7c104603aa9c06ad57a1ebc8', username='tempest-ServerRescueNegativeTestJSON-1294831380-project-member', projectid='9594031941474707b7b4dbe1e8124dde', projectname='tempest-ServerRescueNegativeTestJSON-1294831380'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937835.919218) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:10:35.921209 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:10:35.921566 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:10:35.923958 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:10:35.924096 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:10:35.925217 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:10:35.925322 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:10:35.925456 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:10:35.925546 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:10:35.925656 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:10:35.925734 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:10:35.925852 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:10:35.925972 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:10:35.926061 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:10:35.926202 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:10:35.926365 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:10:35.928100 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:10:35.946718 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-631836882',display_name='tempest-ServerRescueNegativeTestJSON-server-631836882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-631836882',id=47,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-0jlzqija',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:34Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=5683aa74-b79d-4dbf-9a99-796cbff0c04d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:10:35.947073 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:35.947922 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:35.948717 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'pci_devices' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:36.137725 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:36.137927 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:10:36.138235 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:36.167728 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:36.202074 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:36.348733 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:36.352494 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:10:36.415479 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:36.443518 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Successfully updated port: ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:10:36.453591 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] End _get_guest_xml xml=<domain type="qemu">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <uuid>5683aa74-b79d-4dbf-9a99-796cbff0c04d</uuid>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <name>instance-0000002f</name>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-631836882</nova:name>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:10:35</nova:creationTime>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:user uuid="f21fb57a7c104603aa9c06ad57a1ebc8">tempest-ServerRescueNegativeTestJSON-1294831380-project-member</nova:user>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:project uuid="9594031941474707b7b4dbe1e8124dde">tempest-ServerRescueNegativeTestJSON-1294831380</nova:project>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         <nova:port uuid="e848b1f6-2106-4918-8d83-ef483c8c12f9">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <system>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <entry name="serial">5683aa74-b79d-4dbf-9a99-796cbff0c04d</entry>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <entry name="uuid">5683aa74-b79d-4dbf-9a99-796cbff0c04d</entry>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </system>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <os>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   </os>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <features>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   </features>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   <devices>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:8e:4b:79"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <target dev="tape848b1f6-21"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </interface>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/console.log" append="off"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </serial>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <video>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </video>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </rng>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:   </devices>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]: </domain>
May 28 03:10:36.453591 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:10:36.453591 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Preparing to wait for external event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:10:36.453591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:36.453591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:36.453591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:36.457867 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-631836882',display_name='tempest-ServerRescueNegativeTestJSON-server-631836882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-631836882',id=47,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-0jlzqija',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:34Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=5683aa74-b79d-4dbf-9a99-796cbff0c04d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:10:36.457867 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:36.457867 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:36.457867 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:10:36.457867 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:36.457867 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:36.457867 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:10:36.458579 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:36.458866 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14ce5850-47bd-56f4-aa73-ef1a4d74739e', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:36.461316 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:36.462345 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:36.465347 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:36.465557 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape848b1f6-21, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:36.465913 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape848b1f6-21, col_values=(('qos', UUID('28734349-56af-42e1-8c43-78d3c72831f2')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:36.466077 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape848b1f6-21, col_values=(('external_ids', {'iface-id': 'e848b1f6-2106-4918-8d83-ef483c8c12f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:4b:79', 'vm-uuid': '5683aa74-b79d-4dbf-9a99-796cbff0c04d'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:36.468911 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:36.474558 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:36.475404 np0000001589 nova-compute[98297]: INFO os_vif [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21')
May 28 03:10:36.542945 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:36.614830 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-changed-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:36.614830 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Refreshing instance network info cache due to event network-changed-ba208e14-55c6-4fdf-933b-cf2baad34ce4. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:36.614830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] Acquiring lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:36.614830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] Acquired lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:36.614830 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Refreshing network info cache for port ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:36.644045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:36.677316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.842s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:36.679098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:36.679395 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:36.679630 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:10:36.746454 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Deleted allocations for instance b6062670-bd92-40aa-ab30-10f20543db3a
May 28 03:10:36.787888 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:36.926820 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Updated VIF entry in instance network info cache for port e848b1f6-2106-4918-8d83-ef483c8c12f9. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:10:36.927153 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Updating instance_info_cache with network_info: [{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:36.945431 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:37.045034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:37.117987 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:37.147558 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:37.210740 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:37.361364 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:10:37.361904 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:10:37.363723 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Creating image(s)
May 28 03:10:37.363723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:37.363723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:37.363723 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:37.364016 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:37.366844 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:37.367889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.388126 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:37.429425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-226337ed-c0e2-47e4-aa87-0e18c8093abd req-1691aec9-53b5-441d-b6af-3f4e2e6923dd service nova] Releasing lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:37.480025 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.112s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:37.480291 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:37.480703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:37.481059 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:37.483736 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:37.484105 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.557820 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:37.572426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:10:37.588693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:37.589089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.609375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.652727 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk 1073741824" returned: 0 in 0.062s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:37.652870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:37.653303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.677395 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:10:37.678048 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:10:37.690352 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:10:37.692041 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe51:1d91', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fef3:86cf', 'fe80::5022:feff:fe2f:5264', 'fe80::fc16:3eff:feb6:35cc', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:10:37.692462 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:10:37.692462 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:10:37.692777 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:37.726010 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.766984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.113s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:37.768650 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:10:37.769979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.797969 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0e30fb27-3448-49f4-80ea-c9259de5a1f5 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "b6062670-bd92-40aa-ab30-10f20543db3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.124s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:37.837606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:37.838112 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.889104 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:37.889596 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Cannot resize image /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:10:37.890036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:10:37.890286 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Ensure instance console log exists: /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:10:37.890602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:37.890883 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:37.891042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:37.896364 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6ddab0b8-0014-4fed-8fca-089d686c5511 req-76b39568-9c32-4c14-a66b-a824246e8cd1 service nova] Releasing lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:37.896909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:37.897139 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:37.945355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:37.948817 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:37.992560 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:38.004803 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:38.004920 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:38.005028 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No VIF found with MAC fa:16:3e:8e:4b:79, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:38.006092 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Using config drive
May 28 03:10:38.036010 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.036533 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.124310 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.127861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.214585 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.215254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.300651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.305820 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.397409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.398248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.475628 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:38.498074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.500476 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:10:38.504717 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:10:38.506728 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.534565 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:38.605618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.606021 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.697210 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Creating config drive at /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config
May 28 03:10:38.700602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw8u786q9 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.712873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.719275 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:38.731263 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.752465 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:38.753620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:38.760590 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw8u786q9" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.834349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.834776 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.893478 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Starting finish_migration {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 03:10:38.894828 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:10:38.894952 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Creating image(s)
May 28 03:10:38.895728 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.917304 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Updating instance_info_cache with network_info: [{"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:38.929017 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.929513 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:10:38.938393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:38.996926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:38.997471 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:10:38.997978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:39.036035 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:39.036595 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:39.082430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:39.082839 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Cannot resize image /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:10:39.132454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:39.132910 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:10:39.218742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:39.250037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:39.262436 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Detaching volume f31fb8d8-9317-4b65-98a5-d8b4a15148c4
May 28 03:10:39.314260 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Attempting to driver detach volume f31fb8d8-9317-4b65-98a5-d8b4a15148c4 from mountpoint /dev/vdb
May 28 03:10:39.319544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found disk vdb by alias ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:10:39.320907 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found disk vdb by alias ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:10:39.322885 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Attempting to detach device vdb from instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:10:39.323271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:10:39.323271 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:10:39.323271 np0000001589 nova-compute[98297]:   <alias name="ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4"/>
May 28 03:10:39.323271 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:10:39.323271 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:10:39.323271 np0000001589 nova-compute[98297]:   <serial>f31fb8d8-9317-4b65-98a5-d8b4a15148c4</serial>
May 28 03:10:39.323271 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:10:39.323271 np0000001589 nova-compute[98297]: </disk>
May 28 03:10:39.323271 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:10:39.333002 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully detached device vdb from instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 from the persistent domain config.
May 28 03:10:39.333002 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] (1/8): Attempting to detach device vdb with device alias ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 from instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:10:39.333002 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:10:39.333002 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:10:39.333002 np0000001589 nova-compute[98297]:   <alias name="ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4"/>
May 28 03:10:39.333002 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:10:39.333002 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:10:39.333002 np0000001589 nova-compute[98297]:   <serial>f31fb8d8-9317-4b65-98a5-d8b4a15148c4</serial>
May 28 03:10:39.333002 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:10:39.333002 np0000001589 nova-compute[98297]: </disk>
May 28 03:10:39.333002 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:10:39.353350 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:39.421045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:39.421881 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance network_info: |[{"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:10:39.424665 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Start _get_guest_xml network_info=[{"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:10:39.426507 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:39.461677 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:39.462518 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1250321770', uuid='4811783e-66bd-4c41-8a99-e73bc6c22369'), owner=OwnerMeta(userid='f21fb57a7c104603aa9c06ad57a1ebc8', username='tempest-ServerRescueNegativeTestJSON-1294831380-project-member', projectid='9594031941474707b7b4dbe1e8124dde', projectname='tempest-ServerRescueNegativeTestJSON-1294831380'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937839.4617429) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:10:39.464832 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:10:39.465267 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:10:39.467555 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:10:39.467850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:10:39.469625 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:10:39.470341 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:10:39.470525 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:10:39.470705 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:10:39.470898 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:10:39.471020 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:10:39.471153 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:10:39.471393 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:10:39.472803 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:10:39.472803 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:10:39.472803 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:10:39.472803 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:10:39.488586 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1250321770',display_name='tempest-ServerRescueNegativeTestJSON-server-1250321770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-1250321770',id=48,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-t7ezqaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:36Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=4811783e-66bd-4c41-8a99-e73bc6c22369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:10:39.488782 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:39.489989 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:39.490721 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'pci_devices' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:39.545376 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-be7633df-e95f-4351-bc4e-fd2758256364 req-2e6101fa-3234-4aab-8acd-bb967097a10f service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:39.545376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-be7633df-e95f-4351-bc4e-fd2758256364 req-2e6101fa-3234-4aab-8acd-bb967097a10f service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:39.545376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-be7633df-e95f-4351-bc4e-fd2758256364 req-2e6101fa-3234-4aab-8acd-bb967097a10f service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:39.545376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-be7633df-e95f-4351-bc4e-fd2758256364 req-2e6101fa-3234-4aab-8acd-bb967097a10f service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:39.545376 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-be7633df-e95f-4351-bc4e-fd2758256364 req-2e6101fa-3234-4aab-8acd-bb967097a10f service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Processing event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:10:39.550812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:39.552980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:39.588066 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:10:39.591148 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Ensure instance console log exists: /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:10:39.592387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:39.592898 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:39.593172 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:39.598837 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Start _get_guest_xml network_info=[{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'fcd96bb5-9e56-4b5d-9bc2-ec45c1d23116', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'b00002ac-1bf2-43ff-9836-3aa0f11fdabb', 'attached_at': '2026-05-28T03:10:38.000000', 'detached_at': '', 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'multiattach': True, 'serial': '0efa3c41-7988-4a44-805e-8d6483085f9b'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:10:39.613998 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:39.615862 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='b00002ac-1bf2-43ff-9836-3aa0f11fdabb'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937839.6153674) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:10:39.618314 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:10:39.618692 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:10:39.619723 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:10:39.619919 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:10:39.621030 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:10:39.621429 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:10:39.621588 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:10:39.621706 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:10:39.621806 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:10:39.621894 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:10:39.621982 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:10:39.622175 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:10:39.622327 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:10:39.622474 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:10:39.622579 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:10:39.622699 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:10:39.633029 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:39.645828 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:39.670709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:39.673620 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:39.679353 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:39.682683 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:39.684915 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:39.736481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:39.736845 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=11624MB free_disk=73.69186782836914GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:10:39.736980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:39.737238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:39.755020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config --force-share --output=json" returned: 0 in 0.122s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:39.755476 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:39.755678 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:39.756315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:39.756655 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:10:39.757012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:39.757159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:39.757485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:39.757664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:10:39.773938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:39.773938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:39.773938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:39.774249 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:10:39.777243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:39.777243 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:10:39.790491 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:10:39.790491 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:10:39.793535 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:10:39.793535 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:39.807294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:39.815483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:39.829782 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.829782 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.829782 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.829782 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.829782 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.829782 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.829782 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:39.830032 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.830032 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.830032 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.830032 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.830032 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.830032 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.830032 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:39.830255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:39.830319 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:10:39.830859 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('16', '0', '0', 0) found on session 121 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:10:39.830966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:10:39.838313 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.838313 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.838313 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.838313 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.838313 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.838313 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.838313 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:39.838516 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.838516 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:39.838516 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.838516 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:39.838516 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.838516 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:39.838516 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:39.838806 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:39.838942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:10:39.839456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('15', '0', '0', 0) found on session 120 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:10:39.839560 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:10:39.849308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 121 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:10:39.849452 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:10:39.851363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 120 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:10:39.851545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:10:39.875493 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937839.8748546, 8e34a9f9-f4aa-493a-8ca2-6998667e2580 => ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:10:39.876043 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 for instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:10:39.879685 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully detached device vdb from instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 from the live domain config.
May 28 03:10:39.881951 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:10:39.881951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:10:39.881951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:10:39.994809 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] End _get_guest_xml xml=<domain type="qemu">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <uuid>4811783e-66bd-4c41-8a99-e73bc6c22369</uuid>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <name>instance-00000030</name>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1250321770</nova:name>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:10:39</nova:creationTime>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:user uuid="f21fb57a7c104603aa9c06ad57a1ebc8">tempest-ServerRescueNegativeTestJSON-1294831380-project-member</nova:user>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:project uuid="9594031941474707b7b4dbe1e8124dde">tempest-ServerRescueNegativeTestJSON-1294831380</nova:project>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         <nova:port uuid="ba208e14-55c6-4fdf-933b-cf2baad34ce4">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <system>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <entry name="serial">4811783e-66bd-4c41-8a99-e73bc6c22369</entry>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <entry name="uuid">4811783e-66bd-4c41-8a99-e73bc6c22369</entry>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </system>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <os>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   </os>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <features>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   </features>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   <devices>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:7e:fa:65"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <target dev="tapba208e14-55"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </interface>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/console.log" append="off"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </serial>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <video>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </video>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </rng>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:   </devices>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]: </domain>
May 28 03:10:39.994809 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:10:39.996929 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Preparing to wait for external event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:10:39.996929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:39.996929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:39.996929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:39.996929 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1250321770',display_name='tempest-ServerRescueNegativeTestJSON-server-1250321770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-1250321770',id=48,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-t7ezqaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:36Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=4811783e-66bd-4c41-8a99-e73bc6c22369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:10:39.996929 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:39.997495 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:39.997674 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:10:39.998563 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:39.998909 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:39.999220 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:10:40.001609 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:40.001609 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72c1dca7-c6e9-5192-a63c-a084060f90c2', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:40.003007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:40.003894 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:40.009098 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:40.009098 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba208e14-55, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:40.009098 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba208e14-55, col_values=(('qos', UUID('81f2cc78-93ad-4aa0-86f2-d52812b82380')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:40.009098 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba208e14-55, col_values=(('external_ids', {'iface-id': 'ba208e14-55c6-4fdf-933b-cf2baad34ce4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:fa:65', 'vm-uuid': '4811783e-66bd-4c41-8a99-e73bc6c22369'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:40.012865 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:40.014785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:40.016252 np0000001589 nova-compute[98297]: INFO os_vif [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55')
May 28 03:10:40.117655 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937840.1172836, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:40.118379 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:10:40.118595 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Started (Lifecycle Event)
May 28 03:10:40.120595 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:10:40.123930 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance spawned successfully.
May 28 03:10:40.124309 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:10:40.434007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:40.622501 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:40.624723 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:40.630247 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:40.630410 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:40.630774 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:40.631085 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:40.631455 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:40.631795 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:40.750010 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Applying migration context for instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb as it has an incoming, in-progress migration 9a2eb8ee-20f3-499a-a365-f015a60b970a. Migration status is post-migrating {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 03:10:40.751591 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating resource usage from migration 9a2eb8ee-20f3-499a-a365-f015a60b970a
May 28 03:10:40.773961 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:10:40.801742 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.801945 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.802107 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.802680 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.802786 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3b73e16-989c-483c-866f-4e179edfbeef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.802991 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 7fb36d37-75ef-49e7-82c0-28fecba99383 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.803103 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance d5d49eed-1046-4ba3-840f-25b755d33eaf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.803269 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Migration 9a2eb8ee-20f3-499a-a365-f015a60b970a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 03:10:40.803388 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.803833 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 5683aa74-b79d-4dbf-9a99-796cbff0c04d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.803983 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 4811783e-66bd-4c41-8a99-e73bc6c22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:10:40.804802 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:10:40.804989 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=2688MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:10:39 up 38 min,  2 users,  load average: 8.08, 7.01, 4.44\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_52ac8d769a2d4b49807632858d7e6423': '5', 'io_workload': '2', 'num_proj_094dc3cb80814083a18dc5026b895ec5': '1', 'num_task_resize_finish': '1', 'num_proj_be0375d757ca43e3aa5d0d4435fafd3f': '1', 'num_proj_0eee8d500ee84b5f86e297c2660e183b': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_9594031941474707b7b4dbe1e8124dde': '2'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:10:41.125778 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:10:41.127664 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937841.1265304, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:41.127664 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Paused (Lifecycle Event)
May 28 03:10:41.137002 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Took 6.43 seconds to spawn the instance on the hypervisor.
May 28 03:10:41.137430 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:41.385744 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:41.386008 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:41.535447 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:41.535578 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:41.535651 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No VIF found with MAC fa:16:3e:7e:fa:65, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:41.536175 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Using config drive
May 28 03:10:41.603711 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0c3176ba-1989-4261-8c12-d60600453ce4 req-078475fe-8aec-4f7c-9604-1059144132ea service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:41.603904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0c3176ba-1989-4261-8c12-d60600453ce4 req-078475fe-8aec-4f7c-9604-1059144132ea service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:41.604263 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0c3176ba-1989-4261-8c12-d60600453ce4 req-078475fe-8aec-4f7c-9604-1059144132ea service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:41.604381 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0c3176ba-1989-4261-8c12-d60600453ce4 req-078475fe-8aec-4f7c-9604-1059144132ea service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:41.604486 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0c3176ba-1989-4261-8c12-d60600453ce4 req-078475fe-8aec-4f7c-9604-1059144132ea service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:41.604608 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-0c3176ba-1989-4261-8c12-d60600453ce4 req-078475fe-8aec-4f7c-9604-1059144132ea service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state active and task_state None.
May 28 03:10:41.629595 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:41.631114 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937841.6309297, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:41.631334 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Resumed (Lifecycle Event)
May 28 03:10:41.646437 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Took 12.12 seconds to build instance.
May 28 03:10:41.888585 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:42.040451 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:42.133939 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:42.136596 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:42.150195 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-30d22204-7540-45ec-8ef9-2c392b8e028d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.630s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:42.169617 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Creating config drive at /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config
May 28 03:10:42.172620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9zdiwd9l {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:42.238283 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9zdiwd9l" returned: 0 in 0.065s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:42.398005 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:10:42.398221 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.661s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:42.398688 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:10:42.505932 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:42.683767 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:42.710923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:42.710923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:42.790999 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:42.850735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:42.851787 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:42.995800 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:43.394353 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937843.3939517, 4811783e-66bd-4c41-8a99-e73bc6c22369 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:43.394719 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] VM Started (Lifecycle Event)
May 28 03:10:43.398538 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:43.398911 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:43.399164 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:43.399412 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:43.399659 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:10:43.399900 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.74 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:10:43.851948 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ba1c8a7b-8117-4c2a-b33c-2cb0349e3866 req-12a39fd4-591c-4cfa-ad75-88e3888ccd4a service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:43.852192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ba1c8a7b-8117-4c2a-b33c-2cb0349e3866 req-12a39fd4-591c-4cfa-ad75-88e3888ccd4a service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:43.852447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ba1c8a7b-8117-4c2a-b33c-2cb0349e3866 req-12a39fd4-591c-4cfa-ad75-88e3888ccd4a service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:43.852803 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ba1c8a7b-8117-4c2a-b33c-2cb0349e3866 req-12a39fd4-591c-4cfa-ad75-88e3888ccd4a service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:43.853002 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ba1c8a7b-8117-4c2a-b33c-2cb0349e3866 req-12a39fd4-591c-4cfa-ad75-88e3888ccd4a service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Processing event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:10:43.853511 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:10:43.857008 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:10:43.859490 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance spawned successfully.
May 28 03:10:43.859792 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:10:43.897816 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:43.901084 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:44.364843 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:44.364988 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:44.365218 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:44.365459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:44.365684 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:44.365902 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:44.403621 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:10:44.404138 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937844.4037375, 4811783e-66bd-4c41-8a99-e73bc6c22369 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:44.404182 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] VM Paused (Lifecycle Event)
May 28 03:10:44.870256 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Took 7.51 seconds to spawn the instance on the hypervisor.
May 28 03:10:44.870452 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:44.906571 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:44.911834 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937844.9116035, 4811783e-66bd-4c41-8a99-e73bc6c22369 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:44.911944 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] VM Resumed (Lifecycle Event)
May 28 03:10:45.010861 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:45.379526 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Took 15.09 seconds to build instance.
May 28 03:10:45.413947 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:45.415408 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:45.506026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:45.506202 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:45.643981 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0010974050001095748 future=<Future at 0x7e4b406e3920 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:45.644119 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:45.644278 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.037427560000196536 future=<Future at 0x7e4b644b0b90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:45.644403 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.037275076000241825 future=<Future at 0x7e4b644b0b90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:45.644766 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] Emitting event <LifecycleEvent: 1779937830.6426845, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:45.644937 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] VM Stopped (Lifecycle Event)
May 28 03:10:45.682032 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003083379997406155 future=<Future at 0x7e4b644b0b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:45.682592 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Emitting event <LifecycleEvent: 1779937830.6816201, b6062670-bd92-40aa-ab30-10f20543db3a => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:45.682838 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:45.682903 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] VM Stopped (Lifecycle Event)
May 28 03:10:45.880817 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.594s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:45.907374 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-733e4c61-0b6b-47dc-a811-fbd7319e43ca req-387c2994-0ed0-470e-88d4-4171b058e7ab service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:45.907374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-733e4c61-0b6b-47dc-a811-fbd7319e43ca req-387c2994-0ed0-470e-88d4-4171b058e7ab service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:45.907374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-733e4c61-0b6b-47dc-a811-fbd7319e43ca req-387c2994-0ed0-470e-88d4-4171b058e7ab service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:45.907374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-733e4c61-0b6b-47dc-a811-fbd7319e43ca req-387c2994-0ed0-470e-88d4-4171b058e7ab service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:45.907374 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-733e4c61-0b6b-47dc-a811-fbd7319e43ca req-387c2994-0ed0-470e-88d4-4171b058e7ab service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] No waiting events found dispatching network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:45.907374 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-733e4c61-0b6b-47dc-a811-fbd7319e43ca req-387c2994-0ed0-470e-88d4-4171b058e7ab service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received unexpected event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 for instance with vm_state active and task_state None.
May 28 03:10:46.009420 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:10:46.147811 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:46.149622 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:46.185241 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: b6062670-bd92-40aa-ab30-10f20543db3a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:46.464273 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Rescuing
May 28 03:10:46.464687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:46.464687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:46.464777 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:46.562470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:46.562680 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:46.565725 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:10:46.565869 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Claim successful on node np0000001589
May 28 03:10:46.651748 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-18c36c93-ce3e-46be-87ef-68e0aab0d3b7 tempest-TaggedAttachmentsTest-1991660198 tempest-TaggedAttachmentsTest-1991660198-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 03:10:46.966659 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:47.288127 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:47.428523 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Updating instance_info_cache with network_info: [{"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:47.809709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 330000000bb4f5b77 for multipath device dm-10 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:10:47.810297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.053s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:47.810813 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (8053ms) {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:47.811001 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:10:47.811679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 7.930s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:10:47.812246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:10:47.812541 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:10:47.837546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:47.837546 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:47.837546 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:47.837546 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:47.837546 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:47.837546 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:47.837546 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:10:47.837766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [114] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:47.837766 np0000001589 nova-compute[98297]: tcp: [115] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4 (non-flash)
May 28 03:10:47.837766 np0000001589 nova-compute[98297]: tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:47.837766 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:10:47.837766 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:47.837766 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:10:47.837766 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:10:47.837766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '114'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '115'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:10:47.837984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '115')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:10:47.838688 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4', '114')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:10:47.840178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b6446b880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:10:47.840373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Removing multipathed devices sdd, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:10:47.840779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flush multipath device 330000000a5a2a1d8 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:10:47.874021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:10:47.921678 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:10:47.930455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-4811783e-66bd-4c41-8a99-e73bc6c22369" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:47.966691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking to see if SCSI volumes sdd, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:10:47.966893 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] SCSI volumes sdd, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:10:47.967970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking to see if device paths {'sdd', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:10:47.981372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Device paths {'sdd', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:10:47.981634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:10:47.993056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:47.998531 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:48.024804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.40.100,3260]
May 28 03:10:48.024804 np0000001589 nova-compute[98297]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.40.100,3260] successful.
May 28 03:10:48.024804 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:48.043294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:48.057260 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:48.088639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.50.100,3260]
May 28 03:10:48.088639 np0000001589 nova-compute[98297]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-f31fb8d8-9317-4b65-98a5-d8b4a15148c4, portal: 192.168.50.100,3260] successful.
May 28 03:10:48.088639 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:48.107660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:10:48.107839 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:10:48.107963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== disconnect_volume: return (8226ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:10:48.108071 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:10:48.152992 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:48.153338 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:48.316712 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=42,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:42Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-mscd5hbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b00002ac-1bf2-43ff-9836-3aa0f11fdabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:10:48.316996 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:48.317446 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:48.318725 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] End _get_guest_xml xml=<domain type="qemu">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <uuid>b00002ac-1bf2-43ff-9836-3aa0f11fdabb</uuid>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <name>instance-0000002a</name>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <memory>262144</memory>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:name>multiattach-server-0</nova:name>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:10:39</nova:creationTime>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.micro" id="84">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:memory>256</nova:memory>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         <nova:port uuid="bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <system>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <entry name="serial">b00002ac-1bf2-43ff-9836-3aa0f11fdabb</entry>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <entry name="uuid">b00002ac-1bf2-43ff-9836-3aa0f11fdabb</entry>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </system>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <os>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   </os>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <features>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   </features>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   <devices>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk.config"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-10"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <shareable/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d3:5b:9c"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <target dev="tapbf6d0b8a-02"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </interface>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/console.log" append="off"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </serial>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <video>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </video>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </rng>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:   </devices>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]: </domain>
May 28 03:10:48.318725 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:10:48.321731 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=42,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:42Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-mscd5hbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b00002ac-1bf2-43ff-9836-3aa0f11fdabb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:10:48.321731 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:d3:5b:9c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:48.321731 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:48.321731 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:10:48.321731 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:48.321731 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:48.321731 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:10:48.321992 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:48.322449 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cd9038b0-ebf3-585e-ba5c-a88082b8c770', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:48.330785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:48.332321 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:48.334502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:48.334723 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf6d0b8a-02, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:48.335124 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf6d0b8a-02, col_values=(('qos', UUID('d1d8fdba-7477-46f7-b7a5-ec1088e84535')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:48.335386 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf6d0b8a-02, col_values=(('external_ids', {'iface-id': 'bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:5b:9c', 'vm-uuid': 'b00002ac-1bf2-43ff-9836-3aa0f11fdabb'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:48.336542 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:48.337969 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:48.341701 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:48.342696 np0000001589 nova-compute[98297]: INFO os_vif [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02')
May 28 03:10:48.656728 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:48.663496 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid 8e34a9f9-f4aa-493a-8ca2-6998667e2580 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:49.170754 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.608s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:49.171383 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:10:49.609371 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:49.611910 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:49.634675 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:49.681290 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8cdd453a-03d9-42e8-a304-19d583959858 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 10.924s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:49.683066 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:10:49.686251 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:10:49.686251 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:49.686251 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:49.772348 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e16a5f4c7c34b3f9e725ac1fd8884cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367ea52eb22f43adb2cd01467b3473ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:10:49.796577 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cc16a0b7-6497-4954-b321-e6ccecfdb6d1 req-d18bc80f-35d5-498b-893f-26299e5989da service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:49.796577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cc16a0b7-6497-4954-b321-e6ccecfdb6d1 req-d18bc80f-35d5-498b-893f-26299e5989da service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:49.796577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cc16a0b7-6497-4954-b321-e6ccecfdb6d1 req-d18bc80f-35d5-498b-893f-26299e5989da service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:49.796577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cc16a0b7-6497-4954-b321-e6ccecfdb6d1 req-d18bc80f-35d5-498b-893f-26299e5989da service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:49.796577 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cc16a0b7-6497-4954-b321-e6ccecfdb6d1 req-d18bc80f-35d5-498b-893f-26299e5989da service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] No waiting events found dispatching network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:49.796577 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-cc16a0b7-6497-4954-b321-e6ccecfdb6d1 req-d18bc80f-35d5-498b-893f-26299e5989da service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received unexpected event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 for instance with vm_state active and task_state rescuing.
May 28 03:10:49.821065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:49.832607 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:49.859524 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:49.859647 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:49.859724 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:49.859874 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:d3:5b:9c, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:49.860403 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Using config drive
May 28 03:10:50.000349 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.016270 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.184200 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:10:50.226889 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.9996925989999 future=<Future at 0x7e4b407f6a50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:50.227111 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999448614999892 future=<Future at 0x7e4b407f6a50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:50.227211 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999325917000078 future=<Future at 0x7e4b407f6a50 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:50.230472 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance destroyed successfully.
May 28 03:10:50.231579 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'numa_topology' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:50.277680 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Successfully created port: 4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:10:50.342397 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.372411 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.383481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:50.383669 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:50.383832 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:50.383986 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:50.384205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:50.389873 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Terminating instance
May 28 03:10:50.471654 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.531964 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.538834 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.551085 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eaa94516-df12-44fd-8b14-1c01d3c16d53 req-88a8479b-dd0d-4d1b-bffe-e370c225c4cd service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:50.551530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eaa94516-df12-44fd-8b14-1c01d3c16d53 req-88a8479b-dd0d-4d1b-bffe-e370c225c4cd service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:50.551689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eaa94516-df12-44fd-8b14-1c01d3c16d53 req-88a8479b-dd0d-4d1b-bffe-e370c225c4cd service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:50.551793 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-eaa94516-df12-44fd-8b14-1c01d3c16d53 req-88a8479b-dd0d-4d1b-bffe-e370c225c4cd service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:50.552016 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-eaa94516-df12-44fd-8b14-1c01d3c16d53 req-88a8479b-dd0d-4d1b-bffe-e370c225c4cd service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] No waiting events found dispatching network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:50.552016 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-eaa94516-df12-44fd-8b14-1c01d3c16d53 req-88a8479b-dd0d-4d1b-bffe-e370c225c4cd service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received unexpected event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 for instance with vm_state active and task_state resize_finish.
May 28 03:10:50.687139 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:10:50.736749 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Attempting rescue
May 28 03:10:50.739734 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98297) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 03:10:50.753355 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:10:50.753355 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Creating image(s)
May 28 03:10:50.754245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:50.754245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:50.755287 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:50.755287 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:50.869081 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Successfully updated port: 4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:10:50.897541 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:10:50.922947 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-changed-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:50.923089 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Refreshing instance network info cache due to event network-changed-4b43a2e0-2651-4b1c-8a03-ace93250f6a3. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:10:50.923350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] Acquiring lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:50.923497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] Acquired lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:50.923898 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Refreshing network info cache for port 4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:10:50.926063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.952500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.956696 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.987692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:50.988573 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:51.234815 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999675457999729 future=<Future at 0x7e4b407c3cb0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:10:51.235352 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Instance destroyed successfully.
May 28 03:10:51.236478 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'resources' on Instance uuid 8e34a9f9-f4aa-493a-8ca2-6998667e2580 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:51.257210 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<4811783e-66bd-4c41-8a99-e73bc6c22369> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:51.257841 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.260912 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.262424 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:51.262808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:51.263101 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.265533 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.266108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:51.310520 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937851.3095558, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:51.310715 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] VM Resumed (Lifecycle Event)
May 28 03:10:51.313057 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:10:51.318263 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance running successfully.
May 28 03:10:51.318637 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Failed to set time: agent not configured {{(pid=98297) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 03:10:51.318793 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e9d2879-d994-4054-a204-8df55661d413 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] finish_migration finished successfully. {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 03:10:51.363845 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:51.364188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:51.377987 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:51.422633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:51.423055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:51.423428 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'migration_context' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:51.431642 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:51.511151 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:51.652242 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:51.699544 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:10:51.700647 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:10:51.700912 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Creating image(s)
May 28 03:10:51.701488 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "/opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:51.701741 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "/opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:51.702238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "/opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:51.702834 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.705865 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.706956 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:51.741119 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624632726',display_name='tempest-AttachVolumeNegativeTest-server-624632726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-624632726',id=40,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDyLk2zmKDleJgS/EZ1kzCy/5ZLm4DKxSzFIyzhdHCKpmMfrXxXWTCOzLHsaMydOZkmRzXtDbS7LzUQKaOYTUaw4rIexGgt70PFvrD24FKqHk9RrcZiu8cLhHZqZ6bu5HA==',key_name='tempest-keypair-11038288',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:08:44Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-5rhlh4qs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:08:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=8e34a9f9-f4aa-493a-8ca2-6998667e2580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:10:51.741395 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "address": "fa:16:3e:51:1d:91", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d8c2700-ba", "ovs_interfaceid": "9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:51.742559 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8c2700-ba') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:51.742910 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8c2700-ba') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:10:51.746876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:51.747354 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d8c2700-ba, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:51.759942 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:51.762646 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:51.766360 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:51.767668 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:51.767914 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e95d347e-2193-4f0f-856e-a39a74aecfa7) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:51.768822 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:51.769489 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:51.774048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:51.776433 np0000001589 nova-compute[98297]: INFO os_vif [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:1d:91,bridge_name='br-int',has_traffic_filtering=True,id=9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d8c2700-ba')
May 28 03:10:51.776784 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Deleting instance files /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580_del
May 28 03:10:51.779340 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Deletion of /opt/stack/data/nova/instances/8e34a9f9-f4aa-493a-8ca2-6998667e2580_del complete
May 28 03:10:51.809853 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.103s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:51.810557 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:51.811303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:51.811733 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.818794 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:10:51.819374 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:51.819868 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:51.848324 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:51.879966 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:51.880386 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:51.881044 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:51.881221 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:51.881432 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] No waiting events found dispatching network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:51.881586 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received unexpected event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 for instance with vm_state active and task_state rescuing.
May 28 03:10:51.881729 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-vif-unplugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:51.881855 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:51.881978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:51.882109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:51.882315 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] No waiting events found dispatching network-vif-unplugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:51.882379 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-vif-unplugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:51.882650 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-vif-unplugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:51.882811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Acquiring lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:51.882933 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:51.883042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:51.883163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] No waiting events found dispatching network-vif-unplugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:51.883300 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f8eb951-597d-4b8b-b3af-39b199d7f772 req-fdcee241-6e5c-4fb2-9f9f-1a6b56ce2247 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-vif-unplugged-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:10:51.930077 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<4811783e-66bd-4c41-8a99-e73bc6c22369> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:51.930443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:10:51.930944 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Start _get_guest_xml network_info=[{"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:7e:fa:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:10:51.931126 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'resources' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:51.940055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.120s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:51.940468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:52.001571 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk 1073741824" returned: 0 in 0.061s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:52.002031 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:52.002413 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:52.092786 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:52.093319 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Checking if we can resize image /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:10:52.093601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:52.154969 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e9ef73e9-083b-43fb-92c0-92aad4327d6d req-3a59cec8-9f95-4910-9c87-6354e01ecabd service nova] Releasing lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:52.155800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquired lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:52.156039 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:52.194284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:52.194810 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Cannot resize image /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:10:52.195293 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:10:52.195521 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Ensure instance console log exists: /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:10:52.195850 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:52.196142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:52.196351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:52.286198 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Took 1.39 seconds to destroy the instance on the hypervisor.
May 28 03:10:52.286614 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:10:52.286765 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:10:52.286898 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:10:52.287337 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:52.353724 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:52.360120 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 03:10:52.360120 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937852.355752, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:52.360120 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] VM Started (Lifecycle Event)
May 28 03:10:52.434638 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<4811783e-66bd-4c41-8a99-e73bc6c22369> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:52.440363 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:52.440556 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1250321770', uuid='4811783e-66bd-4c41-8a99-e73bc6c22369'), owner=OwnerMeta(userid='f21fb57a7c104603aa9c06ad57a1ebc8', username='tempest-ServerRescueNegativeTestJSON-1294831380-project-member', projectid='9594031941474707b7b4dbe1e8124dde', projectname='tempest-ServerRescueNegativeTestJSON-1294831380'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:7e:fa:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937852.4399881) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:10:52.442329 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:10:52.442806 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:10:52.444948 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:10:52.445985 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:10:52.447523 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:10:52.447878 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:10:52.448042 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:10:52.448501 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:10:52.449901 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:52.637730 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5016e866-8c90-4b57-857a-045522cd5952 req-6fa0f987-e383-4578-a219-2e52cbedd96e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:52.638288 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5016e866-8c90-4b57-857a-045522cd5952 req-6fa0f987-e383-4578-a219-2e52cbedd96e service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:52.638477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5016e866-8c90-4b57-857a-045522cd5952 req-6fa0f987-e383-4578-a219-2e52cbedd96e service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:52.638624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5016e866-8c90-4b57-857a-045522cd5952 req-6fa0f987-e383-4578-a219-2e52cbedd96e service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:52.638777 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5016e866-8c90-4b57-857a-045522cd5952 req-6fa0f987-e383-4578-a219-2e52cbedd96e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] No waiting events found dispatching network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:52.638916 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-5016e866-8c90-4b57-857a-045522cd5952 req-6fa0f987-e383-4578-a219-2e52cbedd96e service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received unexpected event network-vif-plugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 for instance with vm_state resized and task_state None.
May 28 03:10:52.746024 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:10:52.862248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:52.864159 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:52.898253 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:52.922890 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:52.922890 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:52.922890 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Going to confirm migration 3 {{(pid=98297) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 03:10:52.954887 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<4811783e-66bd-4c41-8a99-e73bc6c22369> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:52.979537 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1250321770',display_name='tempest-ServerRescueNegativeTestJSON-server-1250321770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-1250321770',id=48,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:10:44Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-t7ezqaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:45Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=4811783e-66bd-4c41-8a99-e73bc6c22369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:7e:fa:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:10:52.980950 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:7e:fa:65"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:52.981219 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:52.982065 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'pci_devices' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:53.000529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:53.038012 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updating instance_info_cache with network_info: [{"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:53.322121 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:53.432304 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:53.483947 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<4811783e-66bd-4c41-8a99-e73bc6c22369> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:53.485369 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] End _get_guest_xml xml=<domain type="qemu">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <uuid>4811783e-66bd-4c41-8a99-e73bc6c22369</uuid>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <name>instance-00000030</name>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1250321770</nova:name>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:10:52</nova:creationTime>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:user uuid="f21fb57a7c104603aa9c06ad57a1ebc8">tempest-ServerRescueNegativeTestJSON-1294831380-project-member</nova:user>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:project uuid="9594031941474707b7b4dbe1e8124dde">tempest-ServerRescueNegativeTestJSON-1294831380</nova:project>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         <nova:port uuid="ba208e14-55c6-4fdf-933b-cf2baad34ce4">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <system>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <entry name="serial">4811783e-66bd-4c41-8a99-e73bc6c22369</entry>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <entry name="uuid">4811783e-66bd-4c41-8a99-e73bc6c22369</entry>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </system>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <os>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   </os>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <features>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   </features>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   <devices>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config.rescue"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:7e:fa:65"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <target dev="tapba208e14-55"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </interface>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/console.log" append="off"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </serial>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <video>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </video>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </rng>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:   </devices>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]: </domain>
May 28 03:10:53.485369 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:10:53.492314 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance destroyed successfully.
May 28 03:10:53.539829 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Releasing lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:53.540108 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Instance network_info: |[{"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:10:53.542414 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Start _get_guest_xml network_info=[{"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:10:53.544942 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:10:53.546143 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-1249486223', uuid='090d3888-c5fe-4b64-8caa-d93fc3f39bf3'), owner=OwnerMeta(userid='4e16a5f4c7c34b3f9e725ac1fd8884cd', username='tempest-TestStampPattern-277675958-project-member', projectid='367ea52eb22f43adb2cd01467b3473ae', projectname='tempest-TestStampPattern-277675958'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937853.5458024) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:10:53.547526 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:10:53.548170 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:10:53.548780 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:10:53.549152 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:10:53.550024 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:10:53.550489 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:10:53.550796 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:10:53.550993 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:10:53.551346 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:10:53.552271 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:10:53.552271 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:10:53.552271 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:10:53.552271 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:10:53.552271 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:10:53.552271 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:10:53.552683 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:10:53.569539 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1249486223',display_name='tempest-TestStampPattern-server-1249486223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-teststamppattern-server-1249486223',id=49,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKEgysMdWopO6E3aAZPHlXvRqDZ+TYxL5JhnJTwlr4MspE/uoCewfhs6aHx4RT/K6l3FanqteTUkMjEY/GUBECAVHfwAYzhiHcP0zlwzDEZm0H6EvR9YWcZvaI8+O+Z7g==',key_name='tempest-TestStampPattern-70636981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367ea52eb22f43adb2cd01467b3473ae',ramdisk_id='',reservation_id='r-4cetocqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-277675958',owner_user_name='tempest-TestStampPattern-277675958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:51Z,user_data=None,user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',uuid=090d3888-c5fe-4b64-8caa-d93fc3f39bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:10:53.570014 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converting VIF {"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:53.572469 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:35,bridge_name='br-int',has_traffic_filtering=True,id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b43a2e0-26') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:53.572469 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'pci_devices' on Instance uuid 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:53.574447 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:53.574658 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:10:53.574749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:10:53.575076 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:10:53.575204 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'info_cache' on Instance uuid b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:53.824593 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Took 1.54 seconds to deallocate network for instance.
May 28 03:10:54.076269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] End _get_guest_xml xml=<domain type="qemu">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <uuid>090d3888-c5fe-4b64-8caa-d93fc3f39bf3</uuid>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <name>instance-00000031</name>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestStampPattern-server-1249486223</nova:name>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:10:53</nova:creationTime>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:user uuid="4e16a5f4c7c34b3f9e725ac1fd8884cd">tempest-TestStampPattern-277675958-project-member</nova:user>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:project uuid="367ea52eb22f43adb2cd01467b3473ae">tempest-TestStampPattern-277675958</nova:project>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         <nova:port uuid="4b43a2e0-2651-4b1c-8a03-ace93250f6a3">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <system>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <entry name="serial">090d3888-c5fe-4b64-8caa-d93fc3f39bf3</entry>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <entry name="uuid">090d3888-c5fe-4b64-8caa-d93fc3f39bf3</entry>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </system>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <os>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   </os>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <features>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   </features>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   <devices>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk.config"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </disk>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ad:99:35"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <target dev="tap4b43a2e0-26"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </interface>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/console.log" append="off"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </serial>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <video>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </video>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </rng>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:   </devices>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]: </domain>
May 28 03:10:54.076269 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:10:54.082309 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Preparing to wait for external event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:10:54.082309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:54.082309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:54.082309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:54.082309 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1249486223',display_name='tempest-TestStampPattern-server-1249486223',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-teststamppattern-server-1249486223',id=49,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKEgysMdWopO6E3aAZPHlXvRqDZ+TYxL5JhnJTwlr4MspE/uoCewfhs6aHx4RT/K6l3FanqteTUkMjEY/GUBECAVHfwAYzhiHcP0zlwzDEZm0H6EvR9YWcZvaI8+O+Z7g==',key_name='tempest-TestStampPattern-70636981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367ea52eb22f43adb2cd01467b3473ae',ramdisk_id='',reservation_id='r-4cetocqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-277675958',owner_user_name='tempest-TestStampPattern-277675958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:51Z,user_data=None,user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',uuid=090d3888-c5fe-4b64-8caa-d93fc3f39bf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:10:54.082309 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converting VIF {"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:10:54.082309 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:35,bridge_name='br-int',has_traffic_filtering=True,id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b43a2e0-26') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:10:54.083414 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:35,bridge_name='br-int',has_traffic_filtering=True,id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b43a2e0-26') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:10:54.083961 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:54.084183 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:54.084413 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:10:54.085685 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:54.085848 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef3bdf10-6459-53b6-975b-ab65d6357f82', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:54.086585 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:54.087374 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:54.092910 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:54.094770 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:54.094890 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b43a2e0-26, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:54.095197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b43a2e0-26, col_values=(('qos', UUID('64d3955a-8fb2-4c12-8575-020ba9870712')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:54.095364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b43a2e0-26, col_values=(('external_ids', {'iface-id': '4b43a2e0-2651-4b1c-8a03-ace93250f6a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:99:35', 'vm-uuid': '090d3888-c5fe-4b64-8caa-d93fc3f39bf3'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:10:54.096007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:54.096981 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:10:54.106358 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:54.107838 np0000001589 nova-compute[98297]: INFO os_vif [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:99:35,bridge_name='br-int',has_traffic_filtering=True,id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b43a2e0-26')
May 28 03:10:54.330480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:54.330831 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:54.584481 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:54.726392 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ef71f7aa-7fc4-4f1d-93d0-fc7a2d05d68c req-f81b0d8a-bfb7-476c-aa97-6a591d27a575 service nova] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Received event network-vif-deleted-9d8c2700-ba1d-4ce7-aa7b-4e99a00cc24c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:54.930156 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:54.932063 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:54.932318 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:55.013563 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:55.013799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:55.015543 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:55.015543 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No VIF found with MAC fa:16:3e:7e:fa:65, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:55.015543 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Using config drive
May 28 03:10:55.067644 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:10:55.434884 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:55.518878 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'ec2_ids' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:55.569361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:10:55.569526 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'migration_context' on Instance uuid b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:55.623261 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:55.623261 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:10:55.623261 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No VIF found with MAC fa:16:3e:ad:99:35, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:10:55.623261 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Using config drive
May 28 03:10:55.941525 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.611s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:55.996730 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Deleted allocations for instance 8e34a9f9-f4aa-493a-8ca2-6998667e2580
May 28 03:10:56.020881 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<4811783e-66bd-4c41-8a99-e73bc6c22369> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:56.020881 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'keypairs' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:10:56.071368 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Object Instance<b00002ac-1bf2-43ff-9836-3aa0f11fdabb> lazy-loaded attributes: info_cache,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:56.077589 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:56.077776 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:56.128959 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:56.280944 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Creating config drive at /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk.config
May 28 03:10:56.284948 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4vtetzfc {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:56.339034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4vtetzfc" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:56.524430 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<4811783e-66bd-4c41-8a99-e73bc6c22369> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:10:56.532486 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:10:56.692715 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Creating config drive at /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config.rescue
May 28 03:10:56.696509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkrw8igaa {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:10:56.760191 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkrw8igaa" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:10:56.766277 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:56.798558 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:56.801698 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:56.905762 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.010510 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-435eab48-c09a-4120-b1cc-9eb327212c75 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "8e34a9f9-f4aa-493a-8ca2-6998667e2580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.626s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:57.016917 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-47c5e1ff-5e2d-45b0-96ca-c47e495fbfce req-84e1d480-cbf0-4c15-9aec-c1d79313753f service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:57.018540 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-47c5e1ff-5e2d-45b0-96ca-c47e495fbfce req-84e1d480-cbf0-4c15-9aec-c1d79313753f service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:57.018540 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-47c5e1ff-5e2d-45b0-96ca-c47e495fbfce req-84e1d480-cbf0-4c15-9aec-c1d79313753f service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:57.018540 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-47c5e1ff-5e2d-45b0-96ca-c47e495fbfce req-84e1d480-cbf0-4c15-9aec-c1d79313753f service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:57.018540 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-47c5e1ff-5e2d-45b0-96ca-c47e495fbfce req-84e1d480-cbf0-4c15-9aec-c1d79313753f service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Processing event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:10:57.147541 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.177529 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.193458 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.317340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:10:57.317603 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:10:57.416894 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.445931 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.452052 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.563256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.623142 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.626059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:57.632321 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8eb2150d-af73-410f-8f7d-949d383ca87c req-9dca459e-431e-49db-9d8a-42cf07e498b9 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:57.632816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8eb2150d-af73-410f-8f7d-949d383ca87c req-9dca459e-431e-49db-9d8a-42cf07e498b9 service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:57.632902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8eb2150d-af73-410f-8f7d-949d383ca87c req-9dca459e-431e-49db-9d8a-42cf07e498b9 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:57.633027 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8eb2150d-af73-410f-8f7d-949d383ca87c req-9dca459e-431e-49db-9d8a-42cf07e498b9 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:57.633195 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8eb2150d-af73-410f-8f7d-949d383ca87c req-9dca459e-431e-49db-9d8a-42cf07e498b9 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] No waiting events found dispatching network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:57.633375 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8eb2150d-af73-410f-8f7d-949d383ca87c req-9dca459e-431e-49db-9d8a-42cf07e498b9 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received unexpected event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 for instance with vm_state active and task_state rescuing.
May 28 03:10:57.821678 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:10:57.946859 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937857.9465024, 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:57.946993 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] VM Started (Lifecycle Event)
May 28 03:10:57.948550 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:10:57.951867 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:10:57.954831 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Instance spawned successfully.
May 28 03:10:57.956292 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:10:58.002282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:58.307239 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-925e7cd7-93ec-4cd5-b2d7-89c478bc8bc8 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:58.449378 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:58.451174 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:58.466250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:58.466250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:58.466250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:58.466250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:58.466250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:58.466250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:10:58.833618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.756s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:58.953534 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:10:58.954004 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937858.9537268, 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:58.954330 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] VM Paused (Lifecycle Event)
May 28 03:10:58.975914 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Took 7.27 seconds to spawn the instance on the hypervisor.
May 28 03:10:58.975914 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:59.074259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-91775e64-5606-47c1-aaeb-5af71b4465f9 req-a32d6a75-6cd3-45b9-b4fd-1028aa57e06b service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:59.074259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91775e64-5606-47c1-aaeb-5af71b4465f9 req-a32d6a75-6cd3-45b9-b4fd-1028aa57e06b service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:59.074259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91775e64-5606-47c1-aaeb-5af71b4465f9 req-a32d6a75-6cd3-45b9-b4fd-1028aa57e06b service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:59.074259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91775e64-5606-47c1-aaeb-5af71b4465f9 req-a32d6a75-6cd3-45b9-b4fd-1028aa57e06b service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:59.076736 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-91775e64-5606-47c1-aaeb-5af71b4465f9 req-a32d6a75-6cd3-45b9-b4fd-1028aa57e06b service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] No waiting events found dispatching network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:59.078269 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-91775e64-5606-47c1-aaeb-5af71b4465f9 req-a32d6a75-6cd3-45b9-b4fd-1028aa57e06b service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received unexpected event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 for instance with vm_state active and task_state None.
May 28 03:10:59.106654 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:10:59.456832 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:59.458933 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937859.458694, 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:10:59.459114 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] VM Resumed (Lifecycle Event)
May 28 03:10:59.484852 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Took 12.97 seconds to build instance.
May 28 03:10:59.493407 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocation for migration 9a2eb8ee-20f3-499a-a365-f015a60b970a
May 28 03:10:59.690161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:59.690343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:59.701680 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4132ef5e-8dc0-44ba-a9c1-82223385cdbd req-4fae8a58-a451-44d5-b0c8-9edbb9336a5b service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:10:59.701861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4132ef5e-8dc0-44ba-a9c1-82223385cdbd req-4fae8a58-a451-44d5-b0c8-9edbb9336a5b service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:10:59.702008 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4132ef5e-8dc0-44ba-a9c1-82223385cdbd req-4fae8a58-a451-44d5-b0c8-9edbb9336a5b service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:10:59.702122 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4132ef5e-8dc0-44ba-a9c1-82223385cdbd req-4fae8a58-a451-44d5-b0c8-9edbb9336a5b service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:10:59.702235 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4132ef5e-8dc0-44ba-a9c1-82223385cdbd req-4fae8a58-a451-44d5-b0c8-9edbb9336a5b service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] No waiting events found dispatching network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:10:59.702358 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-4132ef5e-8dc0-44ba-a9c1-82223385cdbd req-4fae8a58-a451-44d5-b0c8-9edbb9336a5b service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received unexpected event network-vif-plugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 for instance with vm_state rescued and task_state None.
May 28 03:10:59.962785 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:10:59.964725 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:10:59.986152 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-70e8bb11-07b7-4624-8956-176b1b4f33b9 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.480s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:00.001537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-506827fb-81e1-410a-b928-469ca40637dc tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.078s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:00.091375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:00.091647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:00.196299 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'flavor' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:00.468570 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 4811783e-66bd-4c41-8a99-e73bc6c22369 due to new event <LifecycleEvent: 1779937860.468253, 4811783e-66bd-4c41-8a99-e73bc6c22369 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:11:00.468737 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937860.468253, 4811783e-66bd-4c41-8a99-e73bc6c22369 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:00.468850 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] VM Resumed (Lifecycle Event)
May 28 03:11:00.594403 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:11:00.971146 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:00.977332 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:01.103710 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:01.146735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:01.146927 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:01.150977 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:11:01.151144 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Claim successful on node np0000001589
May 28 03:11:01.204961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:01.481036 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937861.4806602, 4811783e-66bd-4c41-8a99-e73bc6c22369 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:01.481306 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] VM Started (Lifecycle Event)
May 28 03:11:01.770490 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Rescuing
May 28 03:11:01.770949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:01.771115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:01.771307 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:01.812436 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:01.812436 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing instance network info cache due to event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:01.812436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:01.812436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:01.812436 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing network info cache for port c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:01.894191 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-changed-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:01.894611 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Refreshing instance network info cache due to event network-changed-4b43a2e0-2651-4b1c-8a03-ace93250f6a3. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:01.894753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] Acquiring lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:01.894846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] Acquired lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:01.894948 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Refreshing network info cache for port 4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:01.983986 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:01.985641 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:02.273994 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:02.285750 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:02.285891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:02.286038 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attaching volume 8fa563cb-7b74-4f01-af37-81c88b95e3f8 to /dev/vdb
May 28 03:11:02.315489 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:02.358467 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:02.376694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:11:02.396887 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:02.408621 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:02.462574 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:11:02.464035 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:11:02.473946 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:11:02.475971 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fef3:86cf', 'fe80::5022:feff:fe2f:5264', 'fe80::fc16:3eff:feb6:35cc', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65'] 
May 28 03:11:02.476155 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:11:02.476321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:11:02.476624 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:02.477247 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Updating existing volume attachment record: 705eba3f-e84f-4fc5-bfdd-0f79e25c8c04 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:11:02.648823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:02.649000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:02.816131 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:02.848839 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:03.004964 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:03.008553 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:03.041818 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:03.042521 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:03.045676 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:11:03.046035 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:03.046273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:03.046690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:03.046982 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:11:03.059816 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Updating instance_info_cache with network_info: [{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:03.064609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:03.065325 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:03.066113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:03.066377 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:03.066806 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:03.067132 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:03.080375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:03.080375 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:03.092237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:03.092237 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:03.095863 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updated VIF entry in instance network info cache for port c80fcc18-0110-4f7b-97b1-60565e8719a9. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:03.096437 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:03.103234 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8] added
May 28 03:11:03.103234 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:03.103234 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:03.103234 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:03.103234 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:03.103234 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:03.103234 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:03.103557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:03.104428 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:03.104528 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:03.106763 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8] added
May 28 03:11:03.106763 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:03.106763 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:03.106763 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:03.106763 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:03.106763 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:03.106763 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:03.107046 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:03.107046 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:03.107172 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:03.154594 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid d5d49eed-1046-4ba3-840f-25b755d33eaf {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:03.179853 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updated VIF entry in instance network info cache for port 4b43a2e0-2651-4b1c-8a03-ace93250f6a3. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:03.180151 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updating instance_info_cache with network_info: [{"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:03.546077 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:03.561753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:03.604212 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:03.604476 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:03.604636 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing instance network info cache due to event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:03.604814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:03.604931 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:03.605071 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:03.682324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1af87916-b735-4af2-a534-c75a39dcdf34 req-3543208f-d5dd-4aec-8c14-fd49da4944e8 service nova] Releasing lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:04.051957 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.905s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:04.052439 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:11:04.105151 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:04.108155 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:04.108996 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:04.109600 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:04.117642 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:04.117642 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:04.128788 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:04.128788 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.137314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.144579 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.152265 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:04.161588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:04.161878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.161878 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.161878 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.161878 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.161878 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:04.162033 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.162033 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.162033 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.162033 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.162033 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:04.185214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.50.100,3260]
May 28 03:11:04.185214 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.50.100,3260] successful.
May 28 03:11:04.185214 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.201630 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.208686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.40.100,3260]
May 28 03:11:04.208686 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.40.100,3260] successful.
May 28 03:11:04.208686 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.219188 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] HCTL ('7', '-', '-', 0) found on session 122 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:04.219188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:04.225427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:04.237576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Searching for a device in session 122 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:04.238044 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:04.250247 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.250247 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.250247 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.250247 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.250247 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.250247 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.250247 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:04.250502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.250502 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:04.250502 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.250502 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:04.250502 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.250502 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:04.250502 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:04.250672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:04.250766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:04.251704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] HCTL ('8', '-', '-', 0) found on session 123 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:04.251704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:04.266363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Searching for a device in session 123 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:04.266616 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:04.477300 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:04.558291 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:11:04.561247 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:11:04.561247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:04.561247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:04.620303 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updated VIF entry in instance network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:04.620721 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:04.648316 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba297a0d43248c883c9b6100d92cae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094dc3cb80814083a18dc5026b895ec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:11:05.062021 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:11:05.066556 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:11:05.129247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-91a9eb2a-f91a-45cb-9868-c217e4987d89 req-34fec8d2-ace3-4903-8db3-c272eb805739 service nova] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:05.190220 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:05.194636 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:05.222387 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:05.228159 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0015322260001084942 future=<Future at 0x7e4b407f6a50 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:05.228353 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:05.228527 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.0059746339998128 future=<Future at 0x7e4b407c3cb0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:05.228527 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.00586968899961 future=<Future at 0x7e4b407c3cb0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:05.240068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:05.240184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:05.241208 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Attaching volume 44ea3fc1-2002-4bde-bd4e-00d38a40c219 to /dev/vdb
May 28 03:11:05.254943 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Successfully created port: 67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:11:05.293558 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:05.307555 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:11:05.339384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:05.391999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:11:05.393157 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:11:05.405389 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:05.409236 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-246839cb-db8d-4d69-b8e2-4b12279777f8 req-e2469217-4f42-4c4b-be3d-d02cf1586361 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:05.410147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-246839cb-db8d-4d69-b8e2-4b12279777f8 req-e2469217-4f42-4c4b-be3d-d02cf1586361 service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:05.412148 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-246839cb-db8d-4d69-b8e2-4b12279777f8 req-e2469217-4f42-4c4b-be3d-d02cf1586361 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:05.413085 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:05.413242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-246839cb-db8d-4d69-b8e2-4b12279777f8 req-e2469217-4f42-4c4b-be3d-d02cf1586361 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:05.413505 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-246839cb-db8d-4d69-b8e2-4b12279777f8 req-e2469217-4f42-4c4b-be3d-d02cf1586361 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:05.414301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:11:05.415872 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-246839cb-db8d-4d69-b8e2-4b12279777f8 req-e2469217-4f42-4c4b-be3d-d02cf1586361 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state active and task_state rescuing.
May 28 03:11:05.416137 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fef3:86cf', 'fe80::5022:feff:fe2f:5264', 'fe80::fc16:3eff:feb6:35cc', 'fe80::24e0:96ff:fee5:ac82', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65'] 
May 28 03:11:05.416297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:11:05.416423 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:11:05.416660 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:05.416857 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Updating existing volume attachment record: 02c4ba72-d32e-47ff-8b41-229090c6bf38 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:11:05.499931 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999720891999914 future=<Future at 0x7e4b406d9490 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:05.503168 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance destroyed successfully.
May 28 03:11:05.503582 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'numa_topology' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:05.564863 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:11:05.907173 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Successfully updated port: 67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:11:05.986182 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd5d49eed-1046-4ba3-840f-25b755d33eaf', 'attached_at': '', 'detached_at': '', 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'serial': '44ea3fc1-2002-4bde-bd4e-00d38a40c219'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:11:05.987497 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:11:05.987912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:05.988221 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:06.008109 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Attempting rescue
May 28 03:11:06.009008 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98297) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 03:11:06.013292 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:11:06.013446 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Creating image(s)
May 28 03:11:06.014025 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:06.014168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:06.014640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:06.014820 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:06.082502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Found WWN 3300000006aeca73c for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:11:06.082965 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:06.082999 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000006aeca73c', 'path': '/dev/dm-0', 'multipath_id': '3300000006aeca73c'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:06.083184 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006aeca73c', 'path': '/dev/dm-0', 'multipath_id': '3300000006aeca73c'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:11:06.083644 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.096s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:06.083988 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:11:06.086239 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'flavor' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:06.097406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:06.098523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:06.098936 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:06.099866 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:06.100291 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:06.100710 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:06.111974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:06.111974 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:06.115968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:06.115968 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:06.125480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219] added
May 28 03:11:06.125480 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:06.125480 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:06.125480 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:06.125480 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:06.125480 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:06.125480 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:06.125813 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:06.125866 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:06.126073 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:06.128049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219] added
May 28 03:11:06.128049 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:06.128049 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:06.128049 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:06.128049 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:06.128049 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:06.128049 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:06.128286 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:06.128477 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:06.128551 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:06.234777 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003143940002701129 future=<Future at 0x7e4b407c3cb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:06.234894 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:06.234929 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.264674922000268 future=<Future at 0x7e4b406d9490 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:06.235024 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.26460859000008 future=<Future at 0x7e4b406d9490 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:06.235731 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Emitting event <LifecycleEvent: 1779937851.2343786, 8e34a9f9-f4aa-493a-8ca2-6998667e2580 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:06.235731 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] VM Stopped (Lifecycle Event)
May 28 03:11:06.409374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:06.409374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquired lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:06.409533 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:06.516763 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:06.517356 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.524598 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.526712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:06.527030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:06.529181 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.535991 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.536340 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:06.579511 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:11:06.581274 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:11:06.581784 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Creating image(s)
May 28 03:11:06.582468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:06.582769 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:06.583441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:06.584147 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.587432 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.588912 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attempting to attach volume 8fa563cb-7b74-4f01-af37-81c88b95e3f8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:11:06.590611 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:06.608327 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:11:06.608327 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:06.608327 np0000001589 nova-compute[98297]:   <alias name="ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8"/>
May 28 03:11:06.608327 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:11:06.608327 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:06.608327 np0000001589 nova-compute[98297]:   <serial>8fa563cb-7b74-4f01-af37-81c88b95e3f8</serial>
May 28 03:11:06.608327 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:06.608327 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:11:06.633140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:06.633804 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.rescue {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:06.695261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:06.695261 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:06.699145 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.rescue" returned: 0 in 0.065s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:06.699647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:06.700173 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'migration_context' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:06.701842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:06.702517 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.706020 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:06.706020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:06.739576 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 8e34a9f9-f4aa-493a-8ca2-6998667e2580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:06.792423 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:06.792920 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:06.852103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk 1073741824" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:06.852534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:06.852867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:06.950027 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:06.950557 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:11:06.950829 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:06.980184 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:11:07.054465 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:07.054763 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Cannot resize image /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:11:07.055120 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:11:07.055325 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Ensure instance console log exists: /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:11:07.055596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:07.055826 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:07.055964 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:07.125613 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:07.127203 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:07.128997 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:07.138991 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:07.138991 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:07.149119 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:07.149119 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.155876 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.167342 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.176817 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.176817 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.176817 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.176817 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.176817 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.176817 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.176817 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:07.177146 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.177146 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.177146 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.177146 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.177146 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.177146 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.177146 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.186294 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:07.206605 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:07.206860 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:11:07.207493 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Start _get_guest_xml network_info=[{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:8e:4b:79"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:11:07.207655 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'resources' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:07.232474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.40.100,3260]
May 28 03:11:07.232474 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.40.100,3260] successful.
May 28 03:11:07.232474 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.245303 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.254899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.50.100,3260]
May 28 03:11:07.254899 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.50.100,3260] successful.
May 28 03:11:07.254899 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.265128 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Updating instance_info_cache with network_info: [{"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.267660 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.267984 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:07.268790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:07.269315 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:07.269573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:07.273726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('9', '-', '-', 0) found on session 124 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:07.273845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.294015 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:07.294297 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:07.294549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:07.294701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:07.295485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 124 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:07.295807 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:07.296728 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('10', '-', '-', 0) found on session 125 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:07.296843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:07.313787 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 125 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:07.313926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:07.493717 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:07.493901 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:07.494066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:07.494184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:07.494324 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:07.494438 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state active and task_state rescuing.
May 28 03:11:07.494533 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-changed-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:07.494624 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Refreshing instance network info cache due to event network-changed-67288e8e-d874-4086-b637-5971669893e2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:07.494735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] Acquiring lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:07.712037 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:07.715291 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:11:07.716655 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-631836882', uuid='5683aa74-b79d-4dbf-9a99-796cbff0c04d'), owner=OwnerMeta(userid='f21fb57a7c104603aa9c06ad57a1ebc8', username='tempest-ServerRescueNegativeTestJSON-1294831380-project-member', projectid='9594031941474707b7b4dbe1e8124dde', projectname='tempest-ServerRescueNegativeTestJSON-1294831380'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:8e:4b:79"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937867.7162166) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:11:07.717704 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:11:07.718089 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:11:07.719381 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:11:07.719616 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:11:07.720971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:11:07.721517 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:11:07.721731 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:11:07.721867 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:11:07.722030 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:11:07.722169 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:11:07.722343 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:11:07.724248 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:11:07.724248 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:11:07.724248 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:11:07.724248 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:11:07.724248 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:11:07.724248 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:07.767640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Releasing lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:07.768020 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Instance network_info: |[{"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:11:07.768629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] Acquired lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:07.770296 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Start _get_guest_xml network_info=[{"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:11:07.770631 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Refreshing network info cache for port 67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:07.773657 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:11:07.774877 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1184985123', uuid='ea253493-a3b6-47bf-808c-9bbf92db52f7'), owner=OwnerMeta(userid='fba297a0d43248c883c9b6100d92cae8', username='tempest-AttachVolumeNegativeTest-414697469-project-member', projectid='094dc3cb80814083a18dc5026b895ec5', projectname='tempest-AttachVolumeNegativeTest-414697469'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937867.7744913) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:11:07.776173 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:11:07.776592 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:11:07.777662 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:11:07.777803 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:11:07.778559 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:11:07.778868 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:11:07.779028 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:11:07.779152 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:11:07.779308 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:11:07.779411 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:11:07.779547 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:11:07.779730 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:11:07.779878 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:11:07.780024 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:11:07.780173 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:11:07.780339 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:11:07.793445 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1184985123',display_name='tempest-AttachVolumeNegativeTest-server-1184985123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-1184985123',id=50,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnICvf8dHweB4v0kZM1HKwqK7+xT7Zz6BG7B2HlnBQbOGUmKQkuqxtAM2TjeU3D5QZOFUKh/p/zBNAwMmTRLLlRmt2Nx5M9V6FCQmBbt2QlYftWCdToampm+EAYId2QMg==',key_name='tempest-keypair-636854390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-i8lfzl3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=ea253493-a3b6-47bf-808c-9bbf92db52f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:11:07.793749 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:07.794284 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ca:aa,bridge_name='br-int',has_traffic_filtering=True,id=67288e8e-d874-4086-b637-5971669893e2,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67288e8e-d8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:07.798440 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'pci_devices' on Instance uuid ea253493-a3b6-47bf-808c-9bbf92db52f7 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:08.007367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.099418 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:11:08.225626 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:08.236894 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-631836882',display_name='tempest-ServerRescueNegativeTestJSON-server-631836882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-631836882',id=47,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:10:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-0jlzqija',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:10:41Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=5683aa74-b79d-4dbf-9a99-796cbff0c04d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:8e:4b:79"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:11:08.237192 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:8e:4b:79"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:08.237645 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:08.238049 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'pci_devices' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:08.275892 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:08.300563 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] End _get_guest_xml xml=<domain type="qemu">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <uuid>ea253493-a3b6-47bf-808c-9bbf92db52f7</uuid>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <name>instance-00000032</name>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1184985123</nova:name>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:11:07</nova:creationTime>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:user uuid="fba297a0d43248c883c9b6100d92cae8">tempest-AttachVolumeNegativeTest-414697469-project-member</nova:user>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:project uuid="094dc3cb80814083a18dc5026b895ec5">tempest-AttachVolumeNegativeTest-414697469</nova:project>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         <nova:port uuid="67288e8e-d874-4086-b637-5971669893e2">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <system>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <entry name="serial">ea253493-a3b6-47bf-808c-9bbf92db52f7</entry>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <entry name="uuid">ea253493-a3b6-47bf-808c-9bbf92db52f7</entry>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </system>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <os>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   </os>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <features>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   </features>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   <devices>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk.config"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:21:ca:aa"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <target dev="tap67288e8e-d8"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </interface>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/console.log" append="off"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </serial>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <video>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </video>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </rng>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:   </devices>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]: </domain>
May 28 03:11:08.300563 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Preparing to wait for external event network-vif-plugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1184985123',display_name='tempest-AttachVolumeNegativeTest-server-1184985123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-1184985123',id=50,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnICvf8dHweB4v0kZM1HKwqK7+xT7Zz6BG7B2HlnBQbOGUmKQkuqxtAM2TjeU3D5QZOFUKh/p/zBNAwMmTRLLlRmt2Nx5M9V6FCQmBbt2QlYftWCdToampm+EAYId2QMg==',key_name='tempest-keypair-636854390',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-i8lfzl3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=ea253493-a3b6-47bf-808c-9bbf92db52f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:ca:aa,bridge_name='br-int',has_traffic_filtering=True,id=67288e8e-d874-4086-b637-5971669893e2,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67288e8e-d8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ca:aa,bridge_name='br-int',has_traffic_filtering=True,id=67288e8e-d874-4086-b637-5971669893e2,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67288e8e-d8') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.304030 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:08.304742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:11:08.305152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.305432 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edd22a59-0117-593c-8d25-595943d06ff8', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:08.306381 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.307173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:08.308538 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:08.308646 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:08.308735 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:08.308831 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No VIF found with MAC fa:16:3e:f3:86:cf, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:08.312142 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.317978 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.318256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67288e8e-d8, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:08.318535 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67288e8e-d8, col_values=(('qos', UUID('7882d850-d957-4846-97d7-20abc524a7ed')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:08.318697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67288e8e-d8, col_values=(('external_ids', {'iface-id': '67288e8e-d874-4086-b637-5971669893e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:ca:aa', 'vm-uuid': 'ea253493-a3b6-47bf-808c-9bbf92db52f7'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:08.319608 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.320659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:08.331860 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:08.333045 np0000001589 nova-compute[98297]: INFO os_vif [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:ca:aa,bridge_name='br-int',has_traffic_filtering=True,id=67288e8e-d874-4086-b637-5971669893e2,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67288e8e-d8')
May 28 03:11:08.563256 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:08.717341 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Updated VIF entry in instance network info cache for port 67288e8e-d874-4086-b637-5971669893e2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:08.717686 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Updating instance_info_cache with network_info: [{"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:08.739620 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:08.740453 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] End _get_guest_xml xml=<domain type="qemu">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <uuid>5683aa74-b79d-4dbf-9a99-796cbff0c04d</uuid>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <name>instance-0000002f</name>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-631836882</nova:name>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:11:07</nova:creationTime>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:user uuid="f21fb57a7c104603aa9c06ad57a1ebc8">tempest-ServerRescueNegativeTestJSON-1294831380-project-member</nova:user>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:project uuid="9594031941474707b7b4dbe1e8124dde">tempest-ServerRescueNegativeTestJSON-1294831380</nova:project>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         <nova:port uuid="e848b1f6-2106-4918-8d83-ef483c8c12f9">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <system>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <entry name="serial">5683aa74-b79d-4dbf-9a99-796cbff0c04d</entry>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <entry name="uuid">5683aa74-b79d-4dbf-9a99-796cbff0c04d</entry>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </system>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <os>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   </os>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <features>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   </features>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   <devices>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.rescue"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config.rescue"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:8e:4b:79"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <target dev="tape848b1f6-21"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </interface>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/console.log" append="off"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </serial>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <video>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </video>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </rng>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:   </devices>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]: </domain>
May 28 03:11:08.740453 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:11:08.744515 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance destroyed successfully.
May 28 03:11:09.114295 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found WWN 330000000b979aaf1 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:11:09.114527 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:09.115498 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== connect_volume: return (3127ms) {'type': 'block', 'scsi_wwn': '330000000b979aaf1', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000b979aaf1'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:09.115708 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b979aaf1', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000b979aaf1'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:11:09.117398 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:11:09.117623 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:11:09.117787 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:11:09.118356 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7e4b406c88c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'd5d49eed-1046-4ba3-840f-25b755d33eaf', 'attached_at': '', 'detached_at': '', 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'serial': '44ea3fc1-2002-4bde-bd4e-00d38a40c219'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:11:09.118503 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98297) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 03:11:09.118623 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] opening encrypted volume /dev/dm-1 {{(pid=98297) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 03:11:09.151011 np0000001589 nova-compute[98297]: WARNING os_brick.encryptors.luks [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 03:11:09.151161 np0000001589 nova-compute[98297]: INFO os_brick.encryptors.luks [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] /dev/dm-1 is not a valid LUKS device; formatting device for first use
May 28 03:11:09.151294 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98297) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 03:11:09.219729 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9eef4ff4-0137-4e8a-a1a6-ac2e06397d1c req-86c78447-9fd0-4c04-bbfe-e0cbe5e349d0 service nova] Releasing lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:09.851286 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:09.851699 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:09.851699 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No VIF found with MAC fa:16:3e:21:ca:aa, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:09.852102 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Using config drive
May 28 03:11:09.871867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f99fd94a-860e-489d-918f-0762074bad15 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.586s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:10.258752 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:10.258939 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:10.259054 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:10.259214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No VIF found with MAC fa:16:3e:8e:4b:79, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:10.259764 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Using config drive
May 28 03:11:10.361935 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:10.515718 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Creating config drive at /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk.config
May 28 03:11:10.521059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppwnxnpg0 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:10.586477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppwnxnpg0" returned: 0 in 0.065s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:10.762894 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'ec2_ids' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:11.138758 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.180582 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.185958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.272217 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.274273 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:11.274428 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'keypairs' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:11.412279 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ebe13e42-b1ce-4fd1-b3c5-97512af54c72 req-ae446f73-5206-4003-b0ce-722991c0ccb8 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-vif-plugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:11.412736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ebe13e42-b1ce-4fd1-b3c5-97512af54c72 req-ae446f73-5206-4003-b0ce-722991c0ccb8 service nova] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:11.412918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ebe13e42-b1ce-4fd1-b3c5-97512af54c72 req-ae446f73-5206-4003-b0ce-722991c0ccb8 service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:11.413090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ebe13e42-b1ce-4fd1-b3c5-97512af54c72 req-ae446f73-5206-4003-b0ce-722991c0ccb8 service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:11.414250 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ebe13e42-b1ce-4fd1-b3c5-97512af54c72 req-ae446f73-5206-4003-b0ce-722991c0ccb8 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Processing event network-vif-plugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:11:11.530313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:11.530426 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:11.618452 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.636583 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.653970 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.655557 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:11.786343 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:11.786343 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:11.930614 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Creating config drive at /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config.rescue
May 28 03:11:11.934398 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7dwzuiyd {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:11.992442 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7dwzuiyd" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:12.048741 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'flavor' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:12.054811 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:11:12.055675 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937872.0550563, ea253493-a3b6-47bf-808c-9bbf92db52f7 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:12.055912 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] VM Started (Lifecycle Event)
May 28 03:11:12.075688 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:11:12.082794 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Instance spawned successfully.
May 28 03:11:12.086613 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:11:12.576139 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:12.589978 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:12.603390 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:12.605509 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:12.627620 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:12.628584 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:12.629638 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:12.629638 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:12.631001 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:12.631544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:12.710567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:12.850753 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:12.920252 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-78c1f720-1bae-4623-ab44-0a3447a29811 req-68dba122-ece3-491b-a693-9e9693626e13 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:12.920503 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78c1f720-1bae-4623-ab44-0a3447a29811 req-68dba122-ece3-491b-a693-9e9693626e13 service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:12.920691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78c1f720-1bae-4623-ab44-0a3447a29811 req-68dba122-ece3-491b-a693-9e9693626e13 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:12.920807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78c1f720-1bae-4623-ab44-0a3447a29811 req-68dba122-ece3-491b-a693-9e9693626e13 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:12.921013 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-78c1f720-1bae-4623-ab44-0a3447a29811 req-68dba122-ece3-491b-a693-9e9693626e13 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:12.921107 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-78c1f720-1bae-4623-ab44-0a3447a29811 req-68dba122-ece3-491b-a693-9e9693626e13 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state active and task_state rescuing.
May 28 03:11:13.010936 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:13.088638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.558s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:13.112789 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:11:13.113040 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937873.1127954, ea253493-a3b6-47bf-808c-9bbf92db52f7 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:13.113040 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] VM Paused (Lifecycle Event)
May 28 03:11:13.150689 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Took 6.57 seconds to spawn the instance on the hypervisor.
May 28 03:11:13.150839 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:13.320263 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:13.436779 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-828049f4-61dd-4046-bbce-9e73e2be860a tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:13.494623 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c90cbf9a-253b-4c73-a8a0-b9dc4ac2ba9d req-e5918203-f160-4091-a5f9-c4e83c05b75d service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-vif-plugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:13.496337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c90cbf9a-253b-4c73-a8a0-b9dc4ac2ba9d req-e5918203-f160-4091-a5f9-c4e83c05b75d service nova] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:13.499494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c90cbf9a-253b-4c73-a8a0-b9dc4ac2ba9d req-e5918203-f160-4091-a5f9-c4e83c05b75d service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:13.499494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c90cbf9a-253b-4c73-a8a0-b9dc4ac2ba9d req-e5918203-f160-4091-a5f9-c4e83c05b75d service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:13.499494 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c90cbf9a-253b-4c73-a8a0-b9dc4ac2ba9d req-e5918203-f160-4091-a5f9-c4e83c05b75d service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] No waiting events found dispatching network-vif-plugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:13.499494 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c90cbf9a-253b-4c73-a8a0-b9dc4ac2ba9d req-e5918203-f160-4091-a5f9-c4e83c05b75d service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received unexpected event network-vif-plugged-67288e8e-d874-4086-b637-5971669893e2 for instance with vm_state active and task_state None.
May 28 03:11:13.616597 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:13.627418 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937873.6270828, ea253493-a3b6-47bf-808c-9bbf92db52f7 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:13.627618 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] VM Resumed (Lifecycle Event)
May 28 03:11:13.661338 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Took 12.56 seconds to build instance.
May 28 03:11:14.137841 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:14.143293 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:14.147940 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:14.147940 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:14.147940 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attaching volume 7c751b9e-e1bc-44d2-a38d-dde7228fa550 to /dev/vdc
May 28 03:11:14.168460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-548f5217-138a-4652-ae02-d48c86397b55 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.072s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:14.219907 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:14.248171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:11:14.305004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:14.371170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:11:14.372651 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:11:14.386747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:11:14.386747 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fef3:86cf', 'fe80::5022:feff:fe2f:5264', 'fe80::fc16:3eff:feb6:35cc', 'fe80::24e0:96ff:fee5:ac82', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe21:caaa', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe8e:4b79'] 
May 28 03:11:14.386747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:11:14.386747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:11:14.386747 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:14.386747 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Updating existing volume attachment record: e14e4020-fa59-42e1-beb4-d8cf4c199242 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:11:14.652678 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 5683aa74-b79d-4dbf-9a99-796cbff0c04d due to new event <LifecycleEvent: 1779937874.6521568, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:11:14.655697 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937874.6521568, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:14.655697 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Resumed (Lifecycle Event)
May 28 03:11:14.825678 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Unrescuing
May 28 03:11:14.825994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:14.826095 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:14.826405 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:15.001911 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:11:15.002408 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:15.002892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:15.003253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:15.003527 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:11:15.019791 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:15.020745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:15.021869 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:15.022088 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:15.022966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:15.023720 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:15.041251 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:15.041251 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:15.050980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:15.050980 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550] added
May 28 03:11:15.065405 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:15.065405 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0431(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:15.065405 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:15.071916 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-905a9a8e-7044-42e4-b8d6-b3716fe8bed0 req-4f96ffba-8fd0-4410-884b-072b72224717 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:15.081210 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-905a9a8e-7044-42e4-b8d6-b3716fe8bed0 req-4f96ffba-8fd0-4410-884b-072b72224717 service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:15.081760 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550] added
May 28 03:11:15.081760 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:15.081760 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:15.081760 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:15.081760 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:15.081760 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:15.081760 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:15.082126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:15.082696 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-905a9a8e-7044-42e4-b8d6-b3716fe8bed0 req-4f96ffba-8fd0-4410-884b-072b72224717 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:15.082964 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0589(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:15.083310 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-905a9a8e-7044-42e4-b8d6-b3716fe8bed0 req-4f96ffba-8fd0-4410-884b-072b72224717 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:15.083693 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:15.084093 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-905a9a8e-7044-42e4-b8d6-b3716fe8bed0 req-4f96ffba-8fd0-4410-884b-072b72224717 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:15.084093 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-905a9a8e-7044-42e4-b8d6-b3716fe8bed0 req-4f96ffba-8fd0-4410-884b-072b72224717 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state rescued and task_state unrescuing.
May 28 03:11:15.162246 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:15.165040 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:15.229108 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-changed-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:15.230675 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Refreshing instance network info cache due to event network-changed-67288e8e-d874-4086-b637-5971669893e2. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:15.231141 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] Acquiring lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:15.231720 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] Acquired lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:15.232688 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Refreshing network info cache for port 67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:15.332935 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:15.668941 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 03:11:15.669481 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937875.6690488, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:15.669546 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Started (Lifecycle Event)
May 28 03:11:15.735743 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:15.768793 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:15.942024 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Updating instance_info_cache with network_info: [{"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:16.065826 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:16.088249 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:16.088249 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.090914 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:16.110253 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:16.110253 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.119244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.125837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.140581 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.149680 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.150050 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:16.161252 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:16.174598 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:16.181655 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:16.197374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.40.100,3260]
May 28 03:11:16.197374 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.40.100,3260] successful.
May 28 03:11:16.197374 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.206266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.50.100,3260]
May 28 03:11:16.206266 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.50.100,3260] successful.
May 28 03:11:16.206266 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.212944 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.223772 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.246047 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.246440 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:16.246714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:16.246786 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:16.248379 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] HCTL ('11', '-', '-', 0) found on session 126 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:16.248379 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.253724 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:16.254125 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:16.254463 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.231s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:16.254463 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:16.255634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] HCTL ('14', '-', '-', 0) found on session 127 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:16.255777 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:16.269799 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Searching for a device in session 126 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:16.270028 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:16.283731 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Searching for a device in session 127 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:16.283731 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:16.330455 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Updated VIF entry in instance network info cache for port 67288e8e-d874-4086-b637-5971669893e2. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:16.331310 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Updating instance_info_cache with network_info: [{"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:16.448780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-5683aa74-b79d-4dbf-9a99-796cbff0c04d" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:16.449422 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'flavor' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:16.685146 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 03:11:16.833413 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-47f3118b-79f6-41f6-a405-8e95359ee4da req-6c1bd609-9b9b-4b94-bd83-60afa1b42de8 service nova] Releasing lock "refresh_cache-ea253493-a3b6-47bf-808c-9bbf92db52f7" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:16.996565 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:17.001378 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:17.022383 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:17.024014 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:11:17.175167 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8f1ac9f2-338c-4ebf-a754-5536d4224121 req-389d8ea2-d3fd-46c1-89c7-8e2d19bbd48b service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:17.175705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8f1ac9f2-338c-4ebf-a754-5536d4224121 req-389d8ea2-d3fd-46c1-89c7-8e2d19bbd48b service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:17.175705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8f1ac9f2-338c-4ebf-a754-5536d4224121 req-389d8ea2-d3fd-46c1-89c7-8e2d19bbd48b service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:17.175878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8f1ac9f2-338c-4ebf-a754-5536d4224121 req-389d8ea2-d3fd-46c1-89c7-8e2d19bbd48b service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:17.175929 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8f1ac9f2-338c-4ebf-a754-5536d4224121 req-389d8ea2-d3fd-46c1-89c7-8e2d19bbd48b service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:17.176103 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8f1ac9f2-338c-4ebf-a754-5536d4224121 req-389d8ea2-d3fd-46c1-89c7-8e2d19bbd48b service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state rescued and task_state unrescuing.
May 28 03:11:17.179299 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:17.185576 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:17.237353 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] opening encrypted volume /dev/dm-1 {{(pid=98297) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 03:11:17.295462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:17.302619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:17.335656 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999356212999828 future=<Future at 0x7e4b40637a10 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:17.337452 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance destroyed successfully.
May 28 03:11:17.337830 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'numa_topology' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:17.843504 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<5683aa74-b79d-4dbf-9a99-796cbff0c04d> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:18.022867 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:18.042090 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Found WWN 330000000ff0ac5e9 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:11:18.042434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:18.042677 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '330000000ff0ac5e9', 'path': '/dev/dm-2', 'multipath_id': '330000000ff0ac5e9'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:18.042864 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ff0ac5e9', 'path': '/dev/dm-2', 'multipath_id': '330000000ff0ac5e9'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:11:18.053937 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'flavor' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:18.316039 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:18.320836 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:18.334979 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:18.411889 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:18.503913 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:18.505127 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:18.559138 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attempting to attach volume 7c751b9e-e1bc-44d2-a38d-dde7228fa550 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:11:18.560774 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:11:18.560774 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:18.560774 np0000001589 nova-compute[98297]:   <alias name="ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550"/>
May 28 03:11:18.560774 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:11:18.560774 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:11:18.560774 np0000001589 nova-compute[98297]:   <serial>7c751b9e-e1bc-44d2-a38d-dde7228fa550</serial>
May 28 03:11:18.560774 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:18.560774 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:11:19.031256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 5683aa74-b79d-4dbf-9a99-796cbff0c04d due to new event <LifecycleEvent: 1779937879.030764, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:11:19.031846 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937879.030764, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:19.031846 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Resumed (Lifecycle Event)
May 28 03:11:19.034415 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-96457140-8b74-43aa-9b98-b1d9809de99e tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:19.242242 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:19.242439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:19.242630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:19.243110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:19.243110 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:19.243264 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state active and task_state None.
May 28 03:11:19.243449 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:19.243598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:19.244262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:19.244262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:19.244262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:19.244262 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state active and task_state None.
May 28 03:11:19.244262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:19.244478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:19.244539 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:19.244665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:19.244793 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:19.244951 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f2ec4715-558c-45e4-bc6d-23a88aa8c70e req-84afe333-3054-412c-82da-05d909d6a0ef service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received unexpected event network-vif-plugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with vm_state active and task_state None.
May 28 03:11:19.330614 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid d5d49eed-1046-4ba3-840f-25b755d33eaf {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:19.536117 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:19.538707 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:19.833878 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Attempting to attach volume 44ea3fc1-2002-4bde-bd4e-00d38a40c219 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:11:19.835993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:11:19.835993 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:19.835993 np0000001589 nova-compute[98297]:   <alias name="ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219"/>
May 28 03:11:19.835993 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:11:19.835993 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:19.835993 np0000001589 nova-compute[98297]:   <serial>44ea3fc1-2002-4bde-bd4e-00d38a40c219</serial>
May 28 03:11:19.835993 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:19.835993 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:11:20.041714 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937880.0403717, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:20.041714 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Started (Lifecycle Event)
May 28 03:11:20.229113 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:20.229294 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:20.229388 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:20.229501 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:20.229597 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] No VIF found with MAC fa:16:3e:f3:86:cf, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:20.500101 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00037097799986440805 future=<Future at 0x7e4b406d9490 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:20.500210 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:20.500332 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.834637821999877 future=<Future at 0x7e4b40637a10 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:20.500413 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.834555449000163 future=<Future at 0x7e4b40637a10 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:20.500479 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:20.543418 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:20.544974 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:21.494582 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:21.495046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:21.495046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:21.495046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:b6:35:cc, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:21.791894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-431744d2-3e75-465d-856b-ac7a555cfe9d tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.644s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:22.105696 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:22.105854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:22.283134 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Stashing vm_state: active {{(pid=98297) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 03:11:22.607964 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Detaching volume 7c751b9e-e1bc-44d2-a38d-dde7228fa550
May 28 03:11:22.662579 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attempting to driver detach volume 7c751b9e-e1bc-44d2-a38d-dde7228fa550 from mountpoint /dev/vdc
May 28 03:11:22.665870 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Found disk vdc by alias ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:22.666962 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Found disk vdc by alias ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:22.667078 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Attempting to detach device vdc from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:11:22.667380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:22.667380 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:22.667380 np0000001589 nova-compute[98297]:   <alias name="ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550"/>
May 28 03:11:22.667380 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:11:22.667380 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:11:22.667380 np0000001589 nova-compute[98297]:   <serial>7c751b9e-e1bc-44d2-a38d-dde7228fa550</serial>
May 28 03:11:22.667380 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:11:22.667380 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:22.667380 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:22.676023 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Successfully detached device vdc from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the persistent domain config.
May 28 03:11:22.676272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] (1/8): Attempting to detach device vdc with device alias ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550 from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:11:22.676974 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:22.676974 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:22.676974 np0000001589 nova-compute[98297]:   <alias name="ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550"/>
May 28 03:11:22.676974 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:11:22.676974 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:11:22.676974 np0000001589 nova-compute[98297]:   <serial>7c751b9e-e1bc-44d2-a38d-dde7228fa550</serial>
May 28 03:11:22.676974 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:11:22.676974 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:22.676974 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:22.826594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:22.826777 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:23.024659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:23.057112 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f849e5dd-9da2-4c0c-8303-65ab06b1aead tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.817s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:23.155640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:23.155640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:23.176244 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937883.1757753, 7fb36d37-75ef-49e7-82c0-28fecba99383 => ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:11:23.177618 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-7c751b9e-e1bc-44d2-a38d-dde7228fa550 for instance 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:11:23.180462 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Successfully detached device vdc from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the live domain config.
May 28 03:11:23.181456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:11:23.181793 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:23.181961 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:23.182399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:23.182764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c751b9e-e1bc-44d2-a38d-dde7228fa550', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:11:23.182931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:23.212078 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [126] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [127] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550 (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:23.212388 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:23.212388 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', '127'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:11:23.212704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', '126')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:23.213601 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550', '127')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:23.214622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64450f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550'): ({'sdi'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:11:23.214871 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Removing multipathed devices sdf, sdi {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:11:23.215113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Flush multipath device 330000000ff0ac5e9 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:11:23.248544 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:23.297789 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:23.329554 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:23.333131 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:11:23.333357 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Claim successful on node np0000001589
May 28 03:11:23.347947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Checking to see if SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:11:23.347947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:11:23.348328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Checking to see if device paths {'sdf', 'sdi'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:11:23.359327 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Device paths {'sdf', 'sdi'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:11:23.359543 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:11:23.370195 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:23.403817 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.40.100,3260]
May 28 03:11:23.403817 np0000001589 nova-compute[98297]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.40.100,3260] successful.
May 28 03:11:23.403817 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:23.423038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:23.434118 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:23.479779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.50.100,3260]
May 28 03:11:23.479779 np0000001589 nova-compute[98297]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-7c751b9e-e1bc-44d2-a38d-dde7228fa550, portal: 192.168.50.100,3260] successful.
May 28 03:11:23.479779 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:23.498209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:23.498423 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:23.498551 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] <== disconnect_volume: return (316ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:23.498663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:11:23.610303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:23.610692 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:23.657571 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:11:23.838389 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating resource usage from migration 637d5310-3f77-4942-92b5-bf61ab93dc3a
May 28 03:11:24.057332 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'flavor' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:24.112541 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Detaching volume 44ea3fc1-2002-4bde-bd4e-00d38a40c219
May 28 03:11:24.153487 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Attempting to driver detach volume 44ea3fc1-2002-4bde-bd4e-00d38a40c219 from mountpoint /dev/vdb
May 28 03:11:24.198664 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'd5d49eed-1046-4ba3-840f-25b755d33eaf', 'attached_at': '', 'detached_at': '', 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'serial': '44ea3fc1-2002-4bde-bd4e-00d38a40c219'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:11:24.202447 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:24.203447 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:24.203602 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Attempting to detach device vdb from instance d5d49eed-1046-4ba3-840f-25b755d33eaf from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:11:24.203892 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:24.203892 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:24.203892 np0000001589 nova-compute[98297]:   <alias name="ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219"/>
May 28 03:11:24.203892 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:11:24.203892 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:24.203892 np0000001589 nova-compute[98297]:   <serial>44ea3fc1-2002-4bde-bd4e-00d38a40c219</serial>
May 28 03:11:24.203892 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:11:24.203892 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:24.203892 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:24.210934 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance d5d49eed-1046-4ba3-840f-25b755d33eaf from the persistent domain config.
May 28 03:11:24.211127 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] (1/8): Attempting to detach device vdb with device alias ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219 from instance d5d49eed-1046-4ba3-840f-25b755d33eaf from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:11:24.211419 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:24.211419 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:24.211419 np0000001589 nova-compute[98297]:   <alias name="ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219"/>
May 28 03:11:24.211419 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:11:24.211419 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:24.211419 np0000001589 nova-compute[98297]:   <serial>44ea3fc1-2002-4bde-bd4e-00d38a40c219</serial>
May 28 03:11:24.211419 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:11:24.211419 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:24.211419 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:24.234703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:24.435001 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:24.435199 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:24.710177 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937884.7095976, d5d49eed-1046-4ba3-840f-25b755d33eaf => ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:11:24.714603 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-44ea3fc1-2002-4bde-bd4e-00d38a40c219 for instance d5d49eed-1046-4ba3-840f-25b755d33eaf {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:11:24.732689 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance d5d49eed-1046-4ba3-840f-25b755d33eaf from the live domain config.
May 28 03:11:24.733951 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:11:24.734163 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:11:24.734411 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:11:24.734919 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7e4b407f71a0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': 'd5d49eed-1046-4ba3-840f-25b755d33eaf', 'attached_at': '', 'detached_at': '', 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'serial': '44ea3fc1-2002-4bde-bd4e-00d38a40c219'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:11:24.735082 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] closing encrypted volume /dev/dm-3 {{(pid=98297) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 03:11:24.758725 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:11:24.759730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:24.759730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:24.759730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:24.760129 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '44ea3fc1-2002-4bde-bd4e-00d38a40c219', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:11:24.760314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:24.787539 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: tcp: [124] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: tcp: [125] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219 (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:24.787964 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:24.788269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', '124'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', '125'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:11:24.788477 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', '124')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:24.789343 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219', '125')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:24.790118 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40547420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:11:24.790409 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:11:24.790654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flush multipath device 330000000b979aaf1 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:11:24.819094 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:24.867122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:24.920392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:11:24.920571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:11:24.921589 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:11:24.936097 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:11:24.936304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:11:24.938439 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:24.952617 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:24.990745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 124, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.40.100,3260]
May 28 03:11:24.990745 np0000001589 nova-compute[98297]: Logout of [sid: 124, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.40.100,3260] successful.
May 28 03:11:24.990745 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:25.012194 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:25.026550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:25.063500 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b3d72976-6ed4-4b0a-b8b1-035838277112 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.957s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:25.066003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.50.100,3260]
May 28 03:11:25.066003 np0000001589 nova-compute[98297]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-44ea3fc1-2002-4bde-bd4e-00d38a40c219, portal: 192.168.50.100,3260] successful.
May 28 03:11:25.066003 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:25.083047 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:25.083673 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:25.083796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== disconnect_volume: return (324ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:25.083905 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:11:25.444486 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.617s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:25.444619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.210s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:25.448368 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Migrating
May 28 03:11:25.448368 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:11:25.453334 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:11:25.453500 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Claim successful on node np0000001589
May 28 03:11:25.519398 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:25.519577 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:25.627492 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid d5d49eed-1046-4ba3-840f-25b755d33eaf {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:25.970707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:25.971065 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:25.971065 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:26.022058 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Detaching volume 8fa563cb-7b74-4f01-af37-81c88b95e3f8
May 28 03:11:26.066993 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Attempting to driver detach volume 8fa563cb-7b74-4f01-af37-81c88b95e3f8 from mountpoint /dev/vdb
May 28 03:11:26.070387 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Found disk vdb by alias ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:26.071387 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Found disk vdb by alias ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:26.071387 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Attempting to detach device vdb from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:11:26.071656 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:26.071656 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:26.071656 np0000001589 nova-compute[98297]:   <alias name="ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8"/>
May 28 03:11:26.071656 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:11:26.071656 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:26.071656 np0000001589 nova-compute[98297]:   <serial>8fa563cb-7b74-4f01-af37-81c88b95e3f8</serial>
May 28 03:11:26.071656 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:11:26.071656 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:26.071656 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:26.077610 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Successfully detached device vdb from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the persistent domain config.
May 28 03:11:26.077851 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] (1/8): Attempting to detach device vdb with device alias ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8 from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:11:26.078168 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:26.078168 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:26.078168 np0000001589 nova-compute[98297]:   <alias name="ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8"/>
May 28 03:11:26.078168 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:11:26.078168 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:26.078168 np0000001589 nova-compute[98297]:   <serial>8fa563cb-7b74-4f01-af37-81c88b95e3f8</serial>
May 28 03:11:26.078168 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:11:26.078168 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:26.078168 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:26.478252 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:26.537303 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8 for instance 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:11:26.537461 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937886.5372183, 7fb36d37-75ef-49e7-82c0-28fecba99383 => ua-8fa563cb-7b74-4f01-af37-81c88b95e3f8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:11:26.540931 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Successfully detached device vdb from instance 7fb36d37-75ef-49e7-82c0-28fecba99383 from the live domain config.
May 28 03:11:26.540931 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:11:26.541322 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:26.541537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:26.541950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:26.542430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8fa563cb-7b74-4f01-af37-81c88b95e3f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:11:26.543450 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:11:26.571073 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:26.571073 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:26.571073 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:26.571073 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:26.571073 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:26.571073 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:26.571073 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:26.571658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:26.571658 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:26.571658 np0000001589 nova-compute[98297]: tcp: [122] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:26.571658 np0000001589 nova-compute[98297]: tcp: [123] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8 (non-flash)
May 28 03:11:26.571658 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:26.571658 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:26.571658 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:26.571658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '122'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '123'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:11:26.572059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '123')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:26.576767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8', '122')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:26.578432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b644a62a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:11:26.578432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:11:26.578432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Flush multipath device 3300000006aeca73c {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:11:26.613764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:26.637371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ad81601c-a54c-4a5d-8282-4d7f54adfe2b tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.023s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:26.677910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:26.722879 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:11:26.723106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:11:26.723937 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:11:26.743152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:11:26.743423 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:11:26.755599 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:26.791847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 123, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.40.100,3260]
May 28 03:11:26.791847 np0000001589 nova-compute[98297]: Logout of [sid: 123, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.40.100,3260] successful.
May 28 03:11:26.791847 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:26.805064 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:26.817792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:26.847924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 122, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.50.100,3260]
May 28 03:11:26.847924 np0000001589 nova-compute[98297]: Logout of [sid: 122, target: iqn.2023-03.storpool.com:os--volume-8fa563cb-7b74-4f01-af37-81c88b95e3f8, portal: 192.168.50.100,3260] successful.
May 28 03:11:26.847924 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:26.867327 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:26.867529 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:26.867620 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] <== disconnect_volume: return (326ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:26.867744 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:11:26.872620 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:27.042959 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:27.204106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:27.204280 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:27.204416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:27.204529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:27.204630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:27.208172 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Terminating instance
May 28 03:11:27.258517 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:27.258719 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:27.416679 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'flavor' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:27.545781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:27.713999 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:11:27.741782 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:27.761421 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:27.769828 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:27.782965 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:27.787734 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:27.914170 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-50be70d3-448d-450e-a2e6-dcf99224cb2b req-c616cc4e-cb6f-45f7-9608-49e4350a7479 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-vif-unplugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:27.914318 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-50be70d3-448d-450e-a2e6-dcf99224cb2b req-c616cc4e-cb6f-45f7-9608-49e4350a7479 service nova] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:27.914479 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-50be70d3-448d-450e-a2e6-dcf99224cb2b req-c616cc4e-cb6f-45f7-9608-49e4350a7479 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:27.914645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-50be70d3-448d-450e-a2e6-dcf99224cb2b req-c616cc4e-cb6f-45f7-9608-49e4350a7479 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:27.914697 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-50be70d3-448d-450e-a2e6-dcf99224cb2b req-c616cc4e-cb6f-45f7-9608-49e4350a7479 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] No waiting events found dispatching network-vif-unplugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:27.914802 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-50be70d3-448d-450e-a2e6-dcf99224cb2b req-c616cc4e-cb6f-45f7-9608-49e4350a7479 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-vif-unplugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:11:28.028245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:28.059620 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999699201000112 future=<Future at 0x7e4b6445fa10 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:28.060144 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999175838000156 future=<Future at 0x7e4b6445fa10 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:28.060336 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998950710000372 future=<Future at 0x7e4b6445fa10 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:28.062299 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Instance destroyed successfully.
May 28 03:11:28.062954 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'resources' on Instance uuid d5d49eed-1046-4ba3-840f-25b755d33eaf {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:28.272751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.828s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:28.273315 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:11:28.347878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:28.428243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d74a91af-1022-4145-aa0a-582b74df610b tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.908s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:28.568463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-434285491',display_name='tempest-TestEncryptedCinderVolumes-server-434285491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-434285491',id=46,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuRsZaPp+IkaD/xB/fVI4ZjnQx3ehOgyY3IGkFpRBHvqUpk5jFw25Qtm6KyjCkSgI1RB90SPy29GYgmOv9sPA7iu6bm6VoMe/cuEWGOGXD55VlPJbaY3dhdv4BsSZYnbw==',key_name='tempest-keypair-179206037',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:10:24Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-mfixxw99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:10:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=d5d49eed-1046-4ba3-840f-25b755d33eaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:11:28.568463 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "address": "fa:16:3e:b6:35:cc", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b0e475b-4b", "ovs_interfaceid": "1b0e475b-4b81-4aa4-a87e-6c86df950129", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:28.569506 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:35:cc,bridge_name='br-int',has_traffic_filtering=True,id=1b0e475b-4b81-4aa4-a87e-6c86df950129,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0e475b-4b') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:28.569921 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:35:cc,bridge_name='br-int',has_traffic_filtering=True,id=1b0e475b-4b81-4aa4-a87e-6c86df950129,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0e475b-4b') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:11:28.574531 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:28.574782 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b0e475b-4b, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:28.577489 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:28.577489 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:28.581128 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:28.584075 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:28.584313 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9eeb1b85-0aa1-4a6e-944d-f3fa90a5caa0) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:28.585241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:28.588703 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:28.590478 np0000001589 nova-compute[98297]: INFO os_vif [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:35:cc,bridge_name='br-int',has_traffic_filtering=True,id=1b0e475b-4b81-4aa4-a87e-6c86df950129,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b0e475b-4b')
May 28 03:11:28.590835 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Deleting instance files /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf_del
May 28 03:11:28.594873 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Deletion of /opt/stack/data/nova/instances/d5d49eed-1046-4ba3-840f-25b755d33eaf_del complete
May 28 03:11:28.636752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:28.637356 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:28.779358 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:11:28.779649 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:11:28.780336 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:28.782566 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:28.850010 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f21fb57a7c104603aa9c06ad57a1ebc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9594031941474707b7b4dbe1e8124dde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:11:28.864333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:28.864565 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:28.864802 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:28.864981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:28.865137 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:28.867325 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Terminating instance
May 28 03:11:29.060719 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Starting migrate_disk_and_power_off {{(pid=98297) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 03:11:29.089877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.117091 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.118062 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Took 1.40 seconds to destroy the instance on the hypervisor.
May 28 03:11:29.118584 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:11:29.118832 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:11:29.118928 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:11:29.119167 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:29.143460 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'flavor' on Instance uuid 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:29.239608 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:29.263517 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.272043 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.283936 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:11:29.371050 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:11:29.410310 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.410310 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.426506 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999195173999851 future=<Future at 0x7e4b64636120 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:29.433436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.435799 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance destroyed successfully.
May 28 03:11:29.438479 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=44,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:58Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-p6bko20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3b73e16-989c-483c-866f-4e179edfbeef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:11:29.440851 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:29.443201 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:29.443771 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.444662 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:11:29.453267 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.453267 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc80fcc18-01, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:29.453267 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.453267 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:29.474579 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.476133 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.481172 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.485998 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.486723 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4420c06f-0e0b-4121-9cb5-dd6a9c182beb) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:29.487559 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.488684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:29.497049 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.498497 np0000001589 nova-compute[98297]: INFO os_vif [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01')
May 28 03:11:29.706916 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.717076 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:29.721433 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Successfully created port: 6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:11:29.736646 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999760344000151 future=<Future at 0x7e4b6457d550 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:29.738623 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Instance destroyed successfully.
May 28 03:11:29.739270 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lazy-loading 'resources' on Instance uuid 7fb36d37-75ef-49e7-82c0-28fecba99383 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:29.790302 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:11:29.820856 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2d5109c2-4f85-4cfd-870b-f2bee4020a0d req-ea0fafe8-7265-48c5-a1c5-0904970b740e service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-vif-unplugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:29.821749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d5109c2-4f85-4cfd-870b-f2bee4020a0d req-ea0fafe8-7265-48c5-a1c5-0904970b740e service nova] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:29.822299 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d5109c2-4f85-4cfd-870b-f2bee4020a0d req-ea0fafe8-7265-48c5-a1c5-0904970b740e service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:29.822472 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d5109c2-4f85-4cfd-870b-f2bee4020a0d req-ea0fafe8-7265-48c5-a1c5-0904970b740e service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:29.822640 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2d5109c2-4f85-4cfd-870b-f2bee4020a0d req-ea0fafe8-7265-48c5-a1c5-0904970b740e service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] No waiting events found dispatching network-vif-unplugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:29.822984 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2d5109c2-4f85-4cfd-870b-f2bee4020a0d req-ea0fafe8-7265-48c5-a1c5-0904970b740e service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-vif-unplugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:11:29.845180 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81b1a60d-44ab-4876-94f5-f793270b2475 req-c7432b65-c3d0-42bd-be80-ffbea31602c0 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-vif-deleted-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:29.845310 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-81b1a60d-44ab-4876-94f5-f793270b2475 req-c7432b65-c3d0-42bd-be80-ffbea31602c0 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Neutron deleted interface 1b0e475b-4b81-4aa4-a87e-6c86df950129; detaching it from the instance and deleting it from the info cache
May 28 03:11:29.846622 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-81b1a60d-44ab-4876-94f5-f793270b2475 req-c7432b65-c3d0-42bd-be80-ffbea31602c0 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Detach interface failed, port_id=1b0e475b-4b81-4aa4-a87e-6c86df950129, reason: Instance d5d49eed-1046-4ba3-840f-25b755d33eaf could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:11:29.993450 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-vif-unplugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:29.993628 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Acquiring lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:29.994110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:29.994356 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:29.994578 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] No waiting events found dispatching network-vif-unplugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:29.994820 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Received event network-vif-unplugged-1b0e475b-4b81-4aa4-a87e-6c86df950129 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:11:29.995044 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:29.995321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:29.995548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:29.996066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:29.996066 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] No waiting events found dispatching network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:29.996066 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received unexpected event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 for instance with vm_state active and task_state resize_migrating.
May 28 03:11:29.996066 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:29.996173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:29.996236 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:29.996343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:29.996440 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] No waiting events found dispatching network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:29.996777 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f84918c1-f033-4aa1-8ddd-ed67e0b8e2ab req-2e67b222-cf26-41ab-92fa-13427d9680c8 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received unexpected event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 for instance with vm_state active and task_state resize_migrating.
May 28 03:11:30.061621 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Detected multiple connections on this host for volume: 0efa3c41-7988-4a44-805e-8d6483085f9b, skipping target disconnect.
May 28 03:11:30.064177 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:30.149734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:30.152385 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:30.152828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:30.198433 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Successfully updated port: 6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:11:30.240852 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:30.241266 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:11:30.242571 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1836637591',display_name='tempest-TestServerVolumeAttachmentScenario-server-1836637591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testservervolumeattachmentscenario-server-1836637591',id=45,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMI04xpegRK3OmUIzLS06ZzdSUmIlnOWWyZ/CFmdiTHsuEv2jkYlEI8pjFZm6PrfTYAssrD1MmAUuGzYccz/WNGvW3QQiA2MyUtwPQNGEhV/Qwg1xfDjCs680rwl6yB33Q==',key_name='tempest-keypair-103191297',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:10:22Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be0375d757ca43e3aa5d0d4435fafd3f',ramdisk_id='',reservation_id='r-ujl94g16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1569926520',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1569926520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:10:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='950fe02a802540548a5bea56d69f41e1',uuid=7fb36d37-75ef-49e7-82c0-28fecba99383,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:11:30.242760 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Converting VIF {"id": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "address": "fa:16:3e:f3:86:cf", "network": {"id": "6d21853d-c6c1-4964-a02f-db4282de40c1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-555702871-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "be0375d757ca43e3aa5d0d4435fafd3f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fc4fde1-f4", "ovs_interfaceid": "6fc4fde1-f427-427b-a178-76de4efe0bb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:30.243443 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=6fc4fde1-f427-427b-a178-76de4efe0bb5,network=Network(6d21853d-c6c1-4964-a02f-db4282de40c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc4fde1-f4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:30.243694 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=6fc4fde1-f427-427b-a178-76de4efe0bb5,network=Network(6d21853d-c6c1-4964-a02f-db4282de40c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc4fde1-f4') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:11:30.245199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_resize/disk /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:30.245686 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:30.256515 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fc4fde1-f4, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:30.262292 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:30.263666 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:30.263818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ce621c8-b3c9-492d-a202-75f26360430f) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:30.265003 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:30.267239 np0000001589 nova-compute[98297]: INFO os_vif [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:86:cf,bridge_name='br-int',has_traffic_filtering=True,id=6fc4fde1-f427-427b-a178-76de4efe0bb5,network=Network(6d21853d-c6c1-4964-a02f-db4282de40c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fc4fde1-f4')
May 28 03:11:30.267695 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Deleting instance files /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383_del
May 28 03:11:30.268430 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Deletion of /opt/stack/data/nova/instances/7fb36d37-75ef-49e7-82c0-28fecba99383_del complete
May 28 03:11:30.289674 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:30.336564 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "cp -r /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_resize/disk /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:30.336889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_resize/disk.config /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:30.381727 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "cp -r /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_resize/disk.config /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config" returned: 0 in 0.044s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:30.382359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_resize/disk.info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:30.426154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "cp -r /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_resize/disk.info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info" returned: 0 in 0.043s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:30.701425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:30.701553 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:30.701729 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:30.776294 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 03:11:30.777241 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:11:30.777563 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:11:30.777641 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:11:30.777892 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:30.791724 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Took 1.67 seconds to deallocate network for instance.
May 28 03:11:30.799527 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:11:30.800589 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:11:30.800842 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Creating image(s)
May 28 03:11:30.801553 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:30.801732 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:30.802167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:30.802801 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:30.805582 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:30.807808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:30.866377 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:30.912011 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:30.912675 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:30.913457 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:30.914116 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:30.921046 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:30.922035 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:31.014685 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:31.015123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:31.079583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk 1073741824" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:31.080132 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:31.080537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:31.138305 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:31.138897 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:11:31.169683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:31.170106 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:11:31.170352 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:31.253803 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:31.254838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:31.254838 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Attaching volume e7a79ca1-0b47-40a9-b245-68a078f67012 to /dev/vdb
May 28 03:11:31.269766 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:31.270368 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Cannot resize image /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:11:31.273340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:11:31.275765 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Ensure instance console log exists: /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:11:31.276030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:31.276201 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:31.278016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:31.292252 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:11:31.296974 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:31.297459 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:31.306043 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:31.323897 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:11:31.346419 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:31.390204 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:11:31.390510 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:11:31.403857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:11:31.405114 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe21:caaa', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe8e:4b79'] 
May 28 03:11:31.405306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:11:31.405481 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:11:31.405895 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:31.406185 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updating existing volume attachment record: 8a2aed16-fd1e-409a-ad8d-c1114efb4298 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:11:31.514401 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:31.554638 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:31.554962 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:31.637199 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Port c80fcc18-0110-4f7b-97b1-60565e8719a9 binding to destination host np0000001589 is already ACTIVE {{(pid=98297) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 03:11:31.697661 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:31.774573 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:31.876201 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e87f8294-28d1-4bff-be8b-5bbc2b30b88f req-019b121d-7f71-41af-9c34-28cd661711b5 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-vif-unplugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:31.877092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e87f8294-28d1-4bff-be8b-5bbc2b30b88f req-019b121d-7f71-41af-9c34-28cd661711b5 service nova] Acquiring lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:31.877326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e87f8294-28d1-4bff-be8b-5bbc2b30b88f req-019b121d-7f71-41af-9c34-28cd661711b5 service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:31.878018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e87f8294-28d1-4bff-be8b-5bbc2b30b88f req-019b121d-7f71-41af-9c34-28cd661711b5 service nova] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:31.878018 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e87f8294-28d1-4bff-be8b-5bbc2b30b88f req-019b121d-7f71-41af-9c34-28cd661711b5 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] No waiting events found dispatching network-vif-unplugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:31.878018 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e87f8294-28d1-4bff-be8b-5bbc2b30b88f req-019b121d-7f71-41af-9c34-28cd661711b5 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-vif-unplugged-6fc4fde1-f427-427b-a178-76de4efe0bb5 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:11:31.953507 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:11:31.953873 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7a79ca1-0b47-40a9-b245-68a078f67012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:31.954056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:31.955854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:31.956101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7a79ca1-0b47-40a9-b245-68a078f67012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:11:31.960635 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:31.960876 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:31.967909 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:31.968693 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:31.969096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:31.969313 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:31.969870 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:31.970254 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:31.982450 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:31.982450 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:31.983642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:31.983642 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:31.995850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012] added
May 28 03:11:31.995850 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:31.995850 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:31.995850 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:31.995850 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:31.995850 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:31.995850 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:31.996075 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:31.996294 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:31.996440 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:32.000695 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012] added
May 28 03:11:32.000695 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:32.000695 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:32.000695 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:32.000695 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:32.000695 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:32.000695 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:32.000841 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:32.001032 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0317(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:32.001185 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:32.056892 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:32.057080 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing instance network info cache due to event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:32.057234 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] Acquiring lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:32.199747 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:32.200348 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance network_info: |[{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:11:32.200748 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] Acquired lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:32.202445 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:32.205857 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Start _get_guest_xml network_info=[{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:11:32.210871 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:11:32.219256 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-156457100', uuid='1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e'), owner=OwnerMeta(userid='f21fb57a7c104603aa9c06ad57a1ebc8', username='tempest-ServerRescueNegativeTestJSON-1294831380-project-member', projectid='9594031941474707b7b4dbe1e8124dde', projectname='tempest-ServerRescueNegativeTestJSON-1294831380'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937892.2121186) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:11:32.220459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:11:32.220773 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:11:32.222030 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:11:32.222208 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:11:32.223213 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:11:32.223540 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:11:32.223665 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:11:32.223734 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:11:32.223862 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:11:32.223937 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:11:32.224019 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:11:32.224150 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:11:32.224262 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:11:32.224459 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:11:32.224556 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:11:32.224648 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:11:32.248270 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-156457100',display_name='tempest-ServerRescueNegativeTestJSON-server-156457100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-156457100',id=51,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7kD3Q6EZH1F3MDGbGnUsuJRQXycZa80tL/VAcvBthSvvTQiPayA8ZY28K9PY3iV9SgCvY9KtM/k4ckMzkbsBelKLIJccfDKEYc+R8y3bDCNehMq6+tEXjg+MkpvBMLUw==',key_name='tempest-keypair-191609345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-02rf1ufk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:11:32.248270 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:32.248270 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:32.248883 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:32.276801 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Took 1.50 seconds to deallocate network for instance.
May 28 03:11:32.463510 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:32.645396 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:11:32.653069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:32.653850 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:32.657903 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:32.707032 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] End _get_guest_xml xml=<domain type="qemu">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <uuid>1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e</uuid>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <name>instance-00000033</name>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-156457100</nova:name>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:11:32</nova:creationTime>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:user uuid="f21fb57a7c104603aa9c06ad57a1ebc8">tempest-ServerRescueNegativeTestJSON-1294831380-project-member</nova:user>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:project uuid="9594031941474707b7b4dbe1e8124dde">tempest-ServerRescueNegativeTestJSON-1294831380</nova:project>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         <nova:port uuid="6e42b07b-f56c-496d-ab17-b2beb99ff194">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <system>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <entry name="serial">1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e</entry>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <entry name="uuid">1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e</entry>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </system>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <os>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   </os>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <features>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   </features>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   <devices>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:e0:12:b8"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <target dev="tap6e42b07b-f5"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </interface>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/console.log" append="off"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </serial>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <video>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </video>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </rng>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:   </devices>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: </domain>
May 28 03:11:32.753250 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Preparing to wait for external event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-156457100',display_name='tempest-ServerRescueNegativeTestJSON-server-156457100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-156457100',id=51,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7kD3Q6EZH1F3MDGbGnUsuJRQXycZa80tL/VAcvBthSvvTQiPayA8ZY28K9PY3iV9SgCvY9KtM/k4ckMzkbsBelKLIJccfDKEYc+R8y3bDCNehMq6+tEXjg+MkpvBMLUw==',key_name='tempest-keypair-191609345',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-02rf1ufk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:11:32.753250 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:32.756871 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:32.756871 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:11:32.757168 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:32.757528 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:32.757923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:11:32.758792 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:32.758941 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c35e86ce-39e6-50ec-abca-c3b9168955df', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:32.759917 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:32.760985 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:32.762516 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:32.762659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e42b07b-f5, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:32.762966 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e42b07b-f5, col_values=(('qos', UUID('9d9fe97f-6fd4-416a-a8cc-2a9c0b503c23')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:32.763124 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e42b07b-f5, col_values=(('external_ids', {'iface-id': '6e42b07b-f56c-496d-ab17-b2beb99ff194', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:12:b8', 'vm-uuid': '1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:32.764909 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:32.768978 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:32.770332 np0000001589 nova-compute[98297]: INFO os_vif [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5')
May 28 03:11:32.783888 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:32.969294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.672s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:32.971057 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.187s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:32.996839 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:32.999960 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:33.003148 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:33.012508 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:33.012508 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:33.018084 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:33.018084 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.027015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.033780 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.040934 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:33.046317 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.046317 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.046317 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.046317 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.046317 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:33.046850 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deleted allocations for instance d5d49eed-1046-4ba3-840f-25b755d33eaf
May 28 03:11:33.049665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.049665 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.049665 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.049665 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.049665 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:33.050890 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.050890 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.050890 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.050890 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.050890 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:33.055244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.055244 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.055244 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.055244 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.055244 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:33.095081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.50.100,3260]
May 28 03:11:33.095081 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.50.100,3260] successful.
May 28 03:11:33.095081 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.095648 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.40.100,3260]
May 28 03:11:33.095648 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.40.100,3260] successful.
May 28 03:11:33.095648 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.105873 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.112584 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:33.123526 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.123526 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.123526 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.123526 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.123526 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.123526 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.123526 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:33.123782 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.123782 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.123782 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.123782 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.123782 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.123782 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.123782 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:33.123947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:33.124070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:33.124773 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] HCTL ('7', '-', '-', 0) found on session 128 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:33.124872 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:33.133856 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] HCTL ('8', '-', '-', 0) found on session 129 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:33.133856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:33.146771 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching for a device in session 128 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:33.153346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e7a79ca1-0b47-40a9-b245-68a078f67012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:33.155583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching for a device in session 129 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:33.155583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7a79ca1-0b47-40a9-b245-68a078f67012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:33.184176 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updated VIF entry in instance network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:33.184490 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:33.609805 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:33.610256 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:33.666876 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:33.686994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] Releasing lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:33.687111 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ba67204-39a5-4c31-818f-3e56c0086db8 req-bcda0f13-426c-4ad9-aabd-d55018207e51 service nova] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Received event network-vif-deleted-6fc4fde1-f427-427b-a178-76de4efe0bb5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:33.724967 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:33.725091 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:33.725283 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:33.971759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:11:34.056137 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71479a33-1f40-4566-aedd-925b90929320 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d5d49eed-1046-4ba3-840f-25b755d33eaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.852s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:34.112361 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:34.227247 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:34.286643 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:34.286942 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:34.287107 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No VIF found with MAC fa:16:3e:e0:12:b8, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:34.287792 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Using config drive
May 28 03:11:34.490568 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:34.618093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.647s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:34.624078 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:34.664028 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Deleted allocations for instance 7fb36d37-75ef-49e7-82c0-28fecba99383
May 28 03:11:34.794198 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:34.899086 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Creating config drive at /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config
May 28 03:11:34.904711 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn52y_71e {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:34.961490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpn52y_71e" returned: 0 in 0.056s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:34.986392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Found WWN 330000000d399ad7c for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:11:34.986907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:34.987130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000d399ad7c', 'path': '/dev/dm-0', 'multipath_id': '330000000d399ad7c'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:34.987322 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d399ad7c', 'path': '/dev/dm-0', 'multipath_id': '330000000d399ad7c'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:11:34.990463 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'flavor' on Instance uuid 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:35.126321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:35.353560 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:35.384004 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:35.385430 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:35.473210 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:35.494189 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Attempting to attach volume e7a79ca1-0b47-40a9-b245-68a078f67012 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:11:35.496195 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:11:35.496195 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:35.496195 np0000001589 nova-compute[98297]:   <alias name="ua-e7a79ca1-0b47-40a9-b245-68a078f67012"/>
May 28 03:11:35.496195 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:11:35.496195 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:35.496195 np0000001589 nova-compute[98297]:   <serial>e7a79ca1-0b47-40a9-b245-68a078f67012</serial>
May 28 03:11:35.496195 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:35.496195 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:11:35.526735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:35.527906 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:35.570741 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2a3d3ebd-331b-4de1-b584-8c6d646bbf0e req-c3bbc1fa-4202-427b-ad8f-8444efc994a4 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:35.571338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2a3d3ebd-331b-4de1-b584-8c6d646bbf0e req-c3bbc1fa-4202-427b-ad8f-8444efc994a4 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:35.571525 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2a3d3ebd-331b-4de1-b584-8c6d646bbf0e req-c3bbc1fa-4202-427b-ad8f-8444efc994a4 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:35.571640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2a3d3ebd-331b-4de1-b584-8c6d646bbf0e req-c3bbc1fa-4202-427b-ad8f-8444efc994a4 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:35.571759 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2a3d3ebd-331b-4de1-b584-8c6d646bbf0e req-c3bbc1fa-4202-427b-ad8f-8444efc994a4 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Processing event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:11:35.636368 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:35.649521 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:11:35.676760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0dcf286a-7b6b-4c57-b7d4-fdcc1c23d3f9 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Lock "7fb36d37-75ef-49e7-82c0-28fecba99383" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.812s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:35.678764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:35.725915 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:11:35.725915 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:11:35.734662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:11:35.736670 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe21:caaa', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fee0:12b8'] 
May 28 03:11:35.736792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:11:35.736996 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:11:35.737172 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:36.137851 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:36.138077 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:11:36.138321 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:36.266711 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937896.2663307, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:36.267083 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Started (Lifecycle Event)
May 28 03:11:36.268418 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:11:36.270786 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:11:36.272849 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance spawned successfully.
May 28 03:11:36.273046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:11:36.644512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:36.645052 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:36.645052 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:36.645205 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:11:36.769968 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:36.771617 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:36.779353 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:36.779505 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:36.779871 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:36.780176 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:36.780531 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:36.780877 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:36.895170 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Starting finish_migration {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 03:11:36.896141 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:11:36.896352 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Creating image(s)
May 28 03:11:36.897064 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:36.987250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:36.987664 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:11:36.988205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:37.087101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:37.088789 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Cannot resize image /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:11:37.188585 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:37.189135 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:37.189910 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:37.190155 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No VIF found with MAC fa:16:3e:ad:99:35, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:37.274724 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:11:37.275065 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937897.2748554, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:37.275180 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Paused (Lifecycle Event)
May 28 03:11:37.286786 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Took 6.49 seconds to spawn the instance on the hypervisor.
May 28 03:11:37.287074 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:37.592539 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:11:37.592680 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Ensure instance console log exists: /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:11:37.593014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:37.593213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:37.593371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:37.595685 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Start _get_guest_xml network_info=[{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'c3cb5ab3-967e-4aa2-9a52-5ca2186c44a8', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'b3b73e16-989c-483c-866f-4e179edfbeef', 'attached_at': '2026-05-28T03:11:36.000000', 'detached_at': '', 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'multiattach': True, 'serial': '0efa3c41-7988-4a44-805e-8d6483085f9b'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:11:37.601168 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:11:37.601168 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='b3b73e16-989c-483c-866f-4e179edfbeef'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937897.6007047) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:11:37.602277 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:11:37.602613 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:11:37.604931 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:11:37.604931 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:11:37.605748 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:11:37.606222 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:11:37.606430 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:11:37.606663 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:11:37.606848 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:11:37.606998 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:11:37.607145 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:11:37.607386 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:11:37.607535 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:11:37.607695 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:11:37.607834 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:11:37.608008 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:11:37.623154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:37.645590 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e124dc8c-8f4a-450f-a3f0-526ac095d966 req-b84f6003-aa29-490d-bdb6-47e65795a960 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:37.646090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e124dc8c-8f4a-450f-a3f0-526ac095d966 req-b84f6003-aa29-490d-bdb6-47e65795a960 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:37.646245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e124dc8c-8f4a-450f-a3f0-526ac095d966 req-b84f6003-aa29-490d-bdb6-47e65795a960 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:37.646861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e124dc8c-8f4a-450f-a3f0-526ac095d966 req-b84f6003-aa29-490d-bdb6-47e65795a960 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:37.646861 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e124dc8c-8f4a-450f-a3f0-526ac095d966 req-b84f6003-aa29-490d-bdb6-47e65795a960 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:37.646984 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e124dc8c-8f4a-450f-a3f0-526ac095d966 req-b84f6003-aa29-490d-bdb6-47e65795a960 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state active and task_state None.
May 28 03:11:37.686789 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:37.716077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:37.717511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:37.717849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:37.718501 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:37.718926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:11:37.719510 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:37.719738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:37.720242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:37.720605 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:11:37.733471 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:37.734108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:37.734571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:37.734800 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:37.735385 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:37.735699 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:37.746524 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:37.746524 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:37.754178 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:37.754178 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:37.760002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:37.764730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:37.768403 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:37.777698 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.780058 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.044s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('16', '0', '0', 0) found on session 121 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:37.780058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:37.786703 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937897.7845314, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:37.786703 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Resumed (Lifecycle Event)
May 28 03:11:37.788720 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.788720 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.788720 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.788720 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.788720 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.788720 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.788720 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:37.789070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.789070 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:37.789070 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.789070 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:37.789070 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.789070 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:37.789070 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:37.789320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:37.789423 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:37.789809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 121 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:37.790006 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:37.796007 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('15', '0', '0', 0) found on session 120 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:37.796142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:37.797158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:37.797551 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:37.815774 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Took 13.65 seconds to build instance.
May 28 03:11:37.821344 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 120 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:37.821615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:37.896698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:37.900879 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:37.999262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.001042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.040557 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:38.057182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:38.057505 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:38.096626 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.100521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.188902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.189476 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.278573 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.282958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.295550 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:38.301904 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:38.321452 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.166s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:38.375317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.376712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.475153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.475650 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:11:38.480653 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.563727 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:11:38.580381 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.581693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.627449 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:38.628056 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing instance network info cache due to event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:38.628490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] Acquiring lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:38.628987 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] Acquired lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:38.629169 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:38.690366 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.690774 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:11:38.693924 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:11:38.695488 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.735650 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:11:38.760208 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-59bd0c90-7d1f-44af-a92f-85aa5c94ccb3 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.506s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:38.783786 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.784210 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.881313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.881891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:38.982303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:38.982926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.081714 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.087409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.135049 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:39.139431 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:39.139710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:39.146438 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:11:39.146572 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Claim successful on node np0000001589
May 28 03:11:39.174134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.174665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.289309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.297846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.421350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.421886 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.556865 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.557358 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:11:39.561311 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.587901 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:39.685103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.687350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.755125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 330000000bb4f5b77 for multipath device dm-10 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:11:39.755125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.034s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:39.755125 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (2035ms) {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:39.755125 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bb4f5b77', 'path': '/dev/dm-10', 'multipath_id': '330000000bb4f5b77'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:11:39.791999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.795410 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:11:39.797442 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:39.814783 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:39.854493 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updated VIF entry in instance network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:39.854799 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:39.856823 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:39.857728 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=11182MB free_disk=73.63529586791992GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:11:39.858315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:40.266783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=44,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:58Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-p6bko20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3b73e16-989c-483c-866f-4e179edfbeef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:11:40.267081 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:40.267856 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:40.270179 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] End _get_guest_xml xml=<domain type="qemu">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <uuid>b3b73e16-989c-483c-866f-4e179edfbeef</uuid>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <name>instance-0000002c</name>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <memory>262144</memory>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:name>multiattach-server-1</nova:name>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:11:37</nova:creationTime>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.micro" id="84">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:memory>256</nova:memory>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         <nova:port uuid="c80fcc18-0110-4f7b-97b1-60565e8719a9">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <system>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <entry name="serial">b3b73e16-989c-483c-866f-4e179edfbeef</entry>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <entry name="uuid">b3b73e16-989c-483c-866f-4e179edfbeef</entry>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </system>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <os>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   </os>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <features>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   </features>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   <devices>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk.config"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-10"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <shareable/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:24:3d:ed"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <target dev="tapc80fcc18-01"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </interface>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/console.log" append="off"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </serial>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <video>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </video>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </rng>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:   </devices>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]: </domain>
May 28 03:11:40.270179 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=44,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:09:58Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-p6bko20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3b73e16-989c-483c-866f-4e179edfbeef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "vif_mac": "fa:16:3e:24:3d:ed"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:40.276251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32ea6024-2629-5d3a-ba58-c7542aec791d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:40.277095 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:40.278163 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:40.279102 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:40.281562 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:40.281779 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc80fcc18-01, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:40.282559 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc80fcc18-01, col_values=(('qos', UUID('64137333-9527-45ee-b960-137ca8d3f3c3')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:40.282637 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc80fcc18-01, col_values=(('external_ids', {'iface-id': 'c80fcc18-0110-4f7b-97b1-60565e8719a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:3d:ed', 'vm-uuid': 'b3b73e16-989c-483c-866f-4e179edfbeef'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:40.283988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:40.285659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:40.290542 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:40.291822 np0000001589 nova-compute[98297]: INFO os_vif [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01')
May 28 03:11:40.357608 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4452bead-f3f1-486d-ac00-b58f93dd7078 req-109c2df0-a1d7-40c9-97a1-4a9a21cd9289 service nova] Releasing lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:40.764125 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:40.764535 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:41.267408 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:41.693133 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:41.776365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.637s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:41.776751 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:11:41.779554 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.921s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:41.810473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:41.810596 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:41.810707 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:41.810805 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:24:3d:ed, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:41.811238 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Using config drive
May 28 03:11:42.264991 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:42.283494 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:11:42.284930 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:11:42.284930 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:42.284930 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:42.298876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:42.389049 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d927d6b89cf4f0c96580968ea9c3791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0eee8d500ee84b5f86e297c2660e183b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:11:42.410798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:42.448667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:42.451533 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:42.523556 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-268a207f-0209-4c11-82d9-04d52899d6de req-6802f148-881e-404e-9922-9c01a4f91943 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:42.524696 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-268a207f-0209-4c11-82d9-04d52899d6de req-6802f148-881e-404e-9922-9c01a4f91943 service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:42.524950 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-268a207f-0209-4c11-82d9-04d52899d6de req-6802f148-881e-404e-9922-9c01a4f91943 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:42.525119 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-268a207f-0209-4c11-82d9-04d52899d6de req-6802f148-881e-404e-9922-9c01a4f91943 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:42.525264 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-268a207f-0209-4c11-82d9-04d52899d6de req-6802f148-881e-404e-9922-9c01a4f91943 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] No waiting events found dispatching network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:42.525464 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-268a207f-0209-4c11-82d9-04d52899d6de req-6802f148-881e-404e-9922-9c01a4f91943 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received unexpected event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 for instance with vm_state active and task_state resize_finish.
May 28 03:11:42.682280 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:42.682443 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:42.807823 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Applying migration context for instance b3b73e16-989c-483c-866f-4e179edfbeef as it has an incoming, in-progress migration 637d5310-3f77-4942-92b5-bf61ab93dc3a. Migration status is post-migrating {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 03:11:42.810556 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:11:42.813420 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating resource usage from migration 637d5310-3f77-4942-92b5-bf61ab93dc3a
May 28 03:11:42.869108 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869247 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869360 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869480 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869563 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 5683aa74-b79d-4dbf-9a99-796cbff0c04d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869644 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 4811783e-66bd-4c41-8a99-e73bc6c22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869749 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869823 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance ea253493-a3b6-47bf-808c-9bbf92db52f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.869901 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Migration 637d5310-3f77-4942-92b5-bf61ab93dc3a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 03:11:42.869982 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3b73e16-989c-483c-866f-4e179edfbeef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.870062 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.870138 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 04163091-a678-44e3-9e68-2572090c60c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:11:42.870976 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:11:42.871255 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=2944MB phys_disk=95GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:11:39 up 39 min,  2 users,  load average: 7.67, 7.06, 4.62\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '10', 'num_os_type_None': '11', 'num_proj_52ac8d769a2d4b49807632858d7e6423': '5', 'io_workload': '1', 'num_task_resize_finish': '1', 'num_proj_9594031941474707b7b4dbe1e8124dde': '3', 'num_vm_rescued': '1', 'num_proj_367ea52eb22f43adb2cd01467b3473ae': '1', 'num_proj_094dc3cb80814083a18dc5026b895ec5': '1', 'num_vm_building': '1', 'num_proj_0eee8d500ee84b5f86e297c2660e183b': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:11:42.903570 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Successfully created port: 84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:11:43.043200 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:43.060181 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0008496049999848765 future=<Future at 0x7e4b6445fa10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:43.060411 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:43.060469 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.3646649819997947 future=<Future at 0x7e4b64636120 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:43.060545 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.3645591439999407 future=<Future at 0x7e4b64636120 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:43.062194 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Emitting event <LifecycleEvent: 1779937888.0592124, d5d49eed-1046-4ba3-840f-25b755d33eaf => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:43.062394 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] VM Stopped (Lifecycle Event)
May 28 03:11:43.144189 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for b3b73e16-989c-483c-866f-4e179edfbeef due to new event <LifecycleEvent: 1779937903.143593, b3b73e16-989c-483c-866f-4e179edfbeef => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:11:43.144189 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937903.143593, b3b73e16-989c-483c-866f-4e179edfbeef => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:43.144387 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] VM Resumed (Lifecycle Event)
May 28 03:11:43.145311 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:11:43.155655 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance running successfully.
May 28 03:11:43.161741 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Failed to set time: agent not configured {{(pid=98297) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 03:11:43.162265 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcc9e296-3d58-4bbb-ac81-c87237bdb889 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] finish_migration finished successfully. {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 03:11:43.185354 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Detaching volume e7a79ca1-0b47-40a9-b245-68a078f67012
May 28 03:11:43.250576 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Attempting to driver detach volume e7a79ca1-0b47-40a9-b245-68a078f67012 from mountpoint /dev/vdb
May 28 03:11:43.257587 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Found disk vdb by alias ua-e7a79ca1-0b47-40a9-b245-68a078f67012 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:43.258535 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Found disk vdb by alias ua-e7a79ca1-0b47-40a9-b245-68a078f67012 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:11:43.258642 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Attempting to detach device vdb from instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:11:43.260092 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:43.260092 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:43.260092 np0000001589 nova-compute[98297]:   <alias name="ua-e7a79ca1-0b47-40a9-b245-68a078f67012"/>
May 28 03:11:43.260092 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:11:43.260092 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:43.260092 np0000001589 nova-compute[98297]:   <serial>e7a79ca1-0b47-40a9-b245-68a078f67012</serial>
May 28 03:11:43.260092 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:11:43.260092 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:43.260092 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:43.269269 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully detached device vdb from instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 from the persistent domain config.
May 28 03:11:43.269269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] (1/8): Attempting to detach device vdb with device alias ua-e7a79ca1-0b47-40a9-b245-68a078f67012 from instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:11:43.269468 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:11:43.269468 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:11:43.269468 np0000001589 nova-compute[98297]:   <alias name="ua-e7a79ca1-0b47-40a9-b245-68a078f67012"/>
May 28 03:11:43.269468 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:11:43.269468 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:11:43.269468 np0000001589 nova-compute[98297]:   <serial>e7a79ca1-0b47-40a9-b245-68a078f67012</serial>
May 28 03:11:43.269468 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:11:43.269468 np0000001589 nova-compute[98297]: </disk>
May 28 03:11:43.269468 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:11:43.317861 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:11:43.528609 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:43.528807 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:43.547898 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Successfully updated port: 84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:11:43.566522 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-7b7aabc6-afb5-4c40-a6cd-f7dafb28965d tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: d5d49eed-1046-4ba3-840f-25b755d33eaf] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:43.599692 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-changed-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:43.600712 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Refreshing instance network info cache due to event network-changed-84be116e-1e2a-45c8-aec8-8b6a1aac2998. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:43.600712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] Acquiring lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:43.600712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] Acquired lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:43.600712 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Refreshing network info cache for port 84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:43.652641 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:43.655030 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:43.856697 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-e7a79ca1-0b47-40a9-b245-68a078f67012 for instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:11:44.035527 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:44.052063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:44.102901 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:44.156926 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 03:11:44.157251 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937904.1570663, b3b73e16-989c-483c-866f-4e179edfbeef => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:44.157421 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] VM Started (Lifecycle Event)
May 28 03:11:44.184535 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:11:44.323422 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:44.366435 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:11:44.370415 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:11:44.371026 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Creating image(s)
May 28 03:11:44.373687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:44.373687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:44.375854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:44.375854 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:44.381643 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:44.383956 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:44.427101 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0018748819998108956 future=<Future at 0x7e4b64636120 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:44.427487 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:44.427487 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.3088878390003629 future=<Future at 0x7e4b6457d550 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:44.427620 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=0.30878203200018106 future=<Future at 0x7e4b6457d550 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:44.481796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:44.481796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:44.481796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:44.481796 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:44.483147 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:44.483863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:44.545684 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:11:44.546130 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.767s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:44.546541 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:11:44.579753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:44.580286 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:44.626374 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e3acf599-9433-41ce-ad9d-b202ca5bc05e req-099ce62e-8358-4574-bc18-1be852e9b08f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:44.626869 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e3acf599-9433-41ce-ad9d-b202ca5bc05e req-099ce62e-8358-4574-bc18-1be852e9b08f service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:44.628220 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e3acf599-9433-41ce-ad9d-b202ca5bc05e req-099ce62e-8358-4574-bc18-1be852e9b08f service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:44.628448 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e3acf599-9433-41ce-ad9d-b202ca5bc05e req-099ce62e-8358-4574-bc18-1be852e9b08f service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:44.628667 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e3acf599-9433-41ce-ad9d-b202ca5bc05e req-099ce62e-8358-4574-bc18-1be852e9b08f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] No waiting events found dispatching network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:44.628842 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e3acf599-9433-41ce-ad9d-b202ca5bc05e req-099ce62e-8358-4574-bc18-1be852e9b08f service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received unexpected event network-vif-plugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 for instance with vm_state resized and task_state None.
May 28 03:11:44.638345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk 1073741824" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:44.638684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:44.638958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:44.662144 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:44.667348 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:44.729581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:44.730021 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:11:44.730337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:44.741681 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.005144326999925397 future=<Future at 0x7e4b6457d550 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:44.742313 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:11:44.743880 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Emitting event <LifecycleEvent: 1779937889.736333, 7fb36d37-75ef-49e7-82c0-28fecba99383 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:44.744190 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] VM Stopped (Lifecycle Event)
May 28 03:11:44.816252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:44.816617 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Cannot resize image /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:11:44.816998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:11:44.817205 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Ensure instance console log exists: /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:11:44.817531 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:44.817794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:44.817988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:44.825953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3eaff565-ef3d-4929-b86b-7d792a73d4d7 req-048a73b4-bc5c-4e72-bdb3-20973917c0f7 service nova] Releasing lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:44.827512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:44.827512 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:45.107935 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:45.108317 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:45.108317 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Going to confirm migration 4 {{(pid=98297) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 28 03:11:45.170586 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937905.1702752, 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 => ua-e7a79ca1-0b47-40a9-b245-68a078f67012> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:11:45.174324 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully detached device vdb from instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 from the live domain config.
May 28 03:11:45.175687 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:11:45.176069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7a79ca1-0b47-40a9-b245-68a078f67012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:45.176316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:45.176715 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:45.177063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e7a79ca1-0b47-40a9-b245-68a078f67012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:11:45.177308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [129] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012 (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:45.205636 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', '128'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', '129'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', '129')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012', '128')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4069a520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:11:45.205636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Flush multipath device 330000000d399ad7c {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:11:45.249241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:45.250202 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 7fb36d37-75ef-49e7-82c0-28fecba99383] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:45.286256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:45.310054 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:11:45.361654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:11:45.362928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:11:45.362928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:11:45.374107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:11:45.374107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:11:45.385415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:45.409814 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:11:45.417735 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 129, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.40.100,3260]
May 28 03:11:45.417735 np0000001589 nova-compute[98297]: Logout of [sid: 129, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.40.100,3260] successful.
May 28 03:11:45.417735 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:45.431891 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:45.445569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:45.478791 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.50.100,3260]
May 28 03:11:45.478791 np0000001589 nova-compute[98297]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-e7a79ca1-0b47-40a9-b245-68a078f67012, portal: 192.168.50.100,3260] successful.
May 28 03:11:45.478791 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:45.500412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:45.500412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:45.500412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] <== disconnect_volume: return (320ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:45.500412 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:11:45.546836 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:45.547240 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:45.547543 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:45.547777 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:45.548153 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:45.548419 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:11:45.548822 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.59 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:11:45.604146 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:45.616261 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:45.710305 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:45.710305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:45.710305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:45.710305 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:11:45.710305 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'info_cache' on Instance uuid b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:45.752522 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:46.043631 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'flavor' on Instance uuid 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:46.254305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:46.254675 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance network_info: |[{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:11:46.257031 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Start _get_guest_xml network_info=[{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:11:46.260196 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:11:46.261870 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-872502143', uuid='04163091-a678-44e3-9e68-2572090c60c2'), owner=OwnerMeta(userid='2d927d6b89cf4f0c96580968ea9c3791', username='tempest-TestEncryptedCinderVolumes-781621704-project-member', projectid='0eee8d500ee84b5f86e297c2660e183b', projectname='tempest-TestEncryptedCinderVolumes-781621704'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937906.2613769) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:11:46.263054 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:11:46.263469 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:11:46.264501 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:11:46.264780 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:11:46.265967 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:11:46.266425 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:11:46.266636 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:11:46.266782 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:11:46.266988 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:11:46.267127 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:11:46.267301 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:11:46.267574 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:11:46.267736 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:11:46.267915 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:11:46.268085 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:11:46.268295 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:11:46.283715 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:11:46.284038 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:46.284806 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:46.285896 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'pci_devices' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:46.446075 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.717422 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:46.788854 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] End _get_guest_xml xml=<domain type="qemu">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <uuid>04163091-a678-44e3-9e68-2572090c60c2</uuid>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <name>instance-00000034</name>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-872502143</nova:name>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:11:46</nova:creationTime>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:user uuid="2d927d6b89cf4f0c96580968ea9c3791">tempest-TestEncryptedCinderVolumes-781621704-project-member</nova:user>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:project uuid="0eee8d500ee84b5f86e297c2660e183b">tempest-TestEncryptedCinderVolumes-781621704</nova:project>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         <nova:port uuid="84be116e-1e2a-45c8-aec8-8b6a1aac2998">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <system>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <entry name="serial">04163091-a678-44e3-9e68-2572090c60c2</entry>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <entry name="uuid">04163091-a678-44e3-9e68-2572090c60c2</entry>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </system>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <os>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   </os>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <features>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   </features>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   <devices>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </disk>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:c7:48:ab"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <target dev="tap84be116e-1e"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </interface>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/console.log" append="off"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </serial>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <video>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </video>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </rng>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:   </devices>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]: </domain>
May 28 03:11:46.788854 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:11:46.788854 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Preparing to wait for external event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:11:46.788854 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:46.790819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:46.790819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:46.790819 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:11:46.790819 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:11:46.790819 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:11:46.790819 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:11:46.793374 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.793374 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:46.793374 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:11:46.793631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.793779 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a47b2b28-a0c8-5a63-9b62-1753952c8978', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:46.794412 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.794973 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:46.796929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.799139 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.799327 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84be116e-1e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:46.799585 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84be116e-1e, col_values=(('qos', UUID('82f2f5f8-1e16-4c9e-b748-cbd3ceb223c3')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:46.799733 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84be116e-1e, col_values=(('external_ids', {'iface-id': '84be116e-1e2a-45c8-aec8-8b6a1aac2998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:48:ab', 'vm-uuid': '04163091-a678-44e3-9e68-2572090c60c2'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:11:46.800886 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.802674 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:11:46.807869 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:46.808591 np0000001589 nova-compute[98297]: INFO os_vif [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e')
May 28 03:11:47.048717 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4e81095c-dfe4-4e81-ad9e-64f280438b7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.366s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:47.112989 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:47.269154 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:47.771767 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:47.772001 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'migration_context' on Instance uuid b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:48.041661 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:48.045039 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:48.274466 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Object Instance<b3b73e16-989c-483c-866f-4e179edfbeef> lazy-loaded attributes: info_cache,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:11:48.280878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:48.280878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:48.331533 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:48.331533 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:11:48.331644 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:c7:48:ab, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:11:48.332030 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Using config drive
May 28 03:11:48.838105 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:49.027163 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Creating config drive at /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config
May 28 03:11:49.033429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwsokep8t {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:49.103673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwsokep8t" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:49.443215 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:11:49.443606 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:11:49.574392 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:49.599000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:49.599351 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:49.691304 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:49.932314 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:49.938369 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:49.950243 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:11:49.958383 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:50.303576 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:50.328341 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937910.327834, 04163091-a678-44e3-9e68-2572090c60c2 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:50.328727 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Started (Lifecycle Event)
May 28 03:11:50.794202 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:50.820033 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] instance snapshotting
May 28 03:11:50.834956 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:50.839533 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937910.8379552, 04163091-a678-44e3-9e68-2572090c60c2 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:50.839533 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Paused (Lifecycle Event)
May 28 03:11:50.909335 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Beginning live snapshot process
May 28 03:11:50.960606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.680s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:51.341977 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:51.345398 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:51.605934 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocation for migration 637d5310-3f77-4942-92b5-bf61ab93dc3a
May 28 03:11:51.767833 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:11:51.804030 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:51.852624 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:11:52.110576 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dde880b7-206f-4e9b-a646-eda4f1a74ed8 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:52.426034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:52.495702 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:52.538456 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json -f qcow2" returned: 0 in 0.112s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:52.543059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json -f qcow2 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:52.650023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json -f qcow2" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:52.651279 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:52.653984 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:11:52.654380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:52.778403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.123s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:52.778403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi2yrohq4/981b7b2800f54dd38d878d8697133c8d.delta 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:52.826785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:52.826785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:52.839469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi2yrohq4/981b7b2800f54dd38d878d8697133c8d.delta 1073741824" returned: 0 in 0.061s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:52.839910 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Quiescing instance not available: QEMU guest agent is not enabled.
May 28 03:11:52.929382 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9d3dcbf0-563f-45f8-b2c5-685c0a4f8b58 req-babe7bda-338a-458c-8c6c-481103436658 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:52.929914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9d3dcbf0-563f-45f8-b2c5-685c0a4f8b58 req-babe7bda-338a-458c-8c6c-481103436658 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:52.929914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9d3dcbf0-563f-45f8-b2c5-685c0a4f8b58 req-babe7bda-338a-458c-8c6c-481103436658 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:52.929914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9d3dcbf0-563f-45f8-b2c5-685c0a4f8b58 req-babe7bda-338a-458c-8c6c-481103436658 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:52.930203 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9d3dcbf0-563f-45f8-b2c5-685c0a4f8b58 req-babe7bda-338a-458c-8c6c-481103436658 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Processing event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:11:52.930931 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:11:52.935810 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937912.935472, 04163091-a678-44e3-9e68-2572090c60c2 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:11:52.935944 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Resumed (Lifecycle Event)
May 28 03:11:52.937379 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:11:52.941493 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance spawned successfully.
May 28 03:11:52.943113 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:11:53.051255 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:53.120356 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] COPY block job progress, current cursor: 0 final cursor: 76742656 {{(pid=98297) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 03:11:53.329815 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid ea253493-a3b6-47bf-808c-9bbf92db52f7 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:11:53.438634 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:53.440087 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:11:53.449363 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:53.449545 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:53.449937 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:53.450287 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:53.450626 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:53.451005 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:11:53.623077 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] COPY block job progress, current cursor: 76742656 final cursor: 76742656 {{(pid=98297) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 28 03:11:53.624528 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Skipping quiescing instance: QEMU guest agent is not enabled.
May 28 03:11:53.660129 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:11:53.660446 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi2yrohq4/981b7b2800f54dd38d878d8697133c8d.delta /opt/stack/data/nova/instances/snapshots/tmpi2yrohq4/981b7b2800f54dd38d878d8697133c8d {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:53.862432 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi2yrohq4/981b7b2800f54dd38d878d8697133c8d.delta /opt/stack/data/nova/instances/snapshots/tmpi2yrohq4/981b7b2800f54dd38d878d8697133c8d" returned: 0 in 0.202s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:11:53.866917 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Snapshot extracted, beginning image upload
May 28 03:11:53.899802 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:53.899926 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing instance network info cache due to event network-changed-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:53.900046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] Acquiring lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:53.900136 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] Acquired lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:53.900280 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Refreshing network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:53.942004 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:11:53.956800 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Took 9.59 seconds to spawn the instance on the hypervisor.
May 28 03:11:53.956958 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:11:54.336406 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:54.403262 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:54.468589 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Took 15.39 seconds to build instance.
May 28 03:11:54.772264 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:54.926335 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updated VIF entry in instance network info cache for port bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:54.926847 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [{"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:54.973460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.916s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:55.000624 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09bb23c6-0407-4e77-9534-bad25b0fd564 req-a804017e-fa7d-4d3d-98af-21469c5479d0 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:55.000830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09bb23c6-0407-4e77-9534-bad25b0fd564 req-a804017e-fa7d-4d3d-98af-21469c5479d0 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:55.001524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09bb23c6-0407-4e77-9534-bad25b0fd564 req-a804017e-fa7d-4d3d-98af-21469c5479d0 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:55.001681 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09bb23c6-0407-4e77-9534-bad25b0fd564 req-a804017e-fa7d-4d3d-98af-21469c5479d0 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:11:55.001787 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09bb23c6-0407-4e77-9534-bad25b0fd564 req-a804017e-fa7d-4d3d-98af-21469c5479d0 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:11:55.001857 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-09bb23c6-0407-4e77-9534-bad25b0fd564 req-a804017e-fa7d-4d3d-98af-21469c5479d0 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state active and task_state None.
May 28 03:11:55.058176 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-changed-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:55.058521 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Refreshing instance network info cache due to event network-changed-84be116e-1e2a-45c8-aec8-8b6a1aac2998. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:55.058649 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] Acquiring lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:55.058742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] Acquired lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:55.058887 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Refreshing network info cache for port 84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:55.428549 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-08be7ddd-617b-4f68-a995-320095be28bc req-896870e0-3f05-4127-815c-c27ca9308605 service nova] Releasing lock "refresh_cache-b00002ac-1bf2-43ff-9836-3aa0f11fdabb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:55.517857 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:55.518026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:55.518240 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Attaching volume f66b078f-502a-43a6-9ce9-6ea4202ef06f to /dev/vdb
May 28 03:11:55.561552 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:55.566470 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:55.578467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:11:55.598213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:11:55.649611 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:11:55.649907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:11:55.664595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:11:55.666802 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe21:caaa', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fee0:12b8', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fec7:48ab', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:11:55.666893 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:11:55.667111 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:11:55.667295 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:11:55.667473 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Updating existing volume attachment record: 4dea3252-3c53-485f-ab98-9ea34cfe20f1 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:11:55.960408 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:55.974292 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:11:55.974292 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing instance network info cache due to event network-changed-c80fcc18-0110-4f7b-97b1-60565e8719a9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:11:55.974292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] Acquiring lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:11:55.974292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] Acquired lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:11:55.974292 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Refreshing network info cache for port c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:11:56.161270 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updated VIF entry in instance network info cache for port 84be116e-1e2a-45c8-aec8-8b6a1aac2998. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:56.162370 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:56.217450 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:11:56.217721 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:11:56.217856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:56.476528 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:56.578462 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Snapshot image upload complete
May 28 03:11:56.579086 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e56df24a-d319-431d-918d-c9b89d751d83 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Took 5.76 seconds to snapshot the instance on the hypervisor.
May 28 03:11:56.664103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c4d92fd1-f018-45c2-882f-bfc4cfd106bd req-52dc8e1d-1361-4e28-9eac-32f992b46a0c service nova] Releasing lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:56.806369 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:56.820265 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:11:56.944053 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updated VIF entry in instance network info cache for port c80fcc18-0110-4f7b-97b1-60565e8719a9. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:11:56.944382 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [{"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:11:57.446258 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8adbc41e-facb-441a-83e5-ebd8d359f313 req-241c0499-8201-4e7a-8f74-bdd35298db60 service nova] Releasing lock "refresh_cache-b3b73e16-989c-483c-866f-4e179edfbeef" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:11:57.773562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.555s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:57.773562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:11:57.788543 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:57.789214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:11:57.789707 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:57.789995 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:57.790612 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:11:57.790774 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:57.801969 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:57.801969 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:57.808797 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:11:57.808797 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:57.816702 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f] added
May 28 03:11:57.816702 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:57.816702 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:57.816702 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:57.816702 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:57.816702 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:57.816702 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:57.816962 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:57.822638 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:57.822790 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:57.826116 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f] added
May 28 03:11:57.826116 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:11:57.826116 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:57.826116 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:57.826116 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:11:57.826116 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:11:57.826116 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:57.826369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:11:57.826436 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0356(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:11:57.826607 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:11:57.981706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:57.981877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:58.052046 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:11:58.483305 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:11:58.823322 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:11:58.826936 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:58.834440 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:58.834440 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:11:58.839793 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:11:58.839793 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.845513 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.856670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.860980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.860980 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.860980 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.860980 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.860980 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.860980 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.860980 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:58.861372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.861372 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.861372 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.861372 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.861372 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.861372 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.861372 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:58.874411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.874411 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.874411 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.874411 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.874411 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.874411 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.874411 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:58.874709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.874709 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.874709 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.874709 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.874709 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.874709 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.874709 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:58.894560 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.40.100,3260]
May 28 03:11:58.894560 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.40.100,3260] successful.
May 28 03:11:58.894560 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.905984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.916609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.50.100,3260]
May 28 03:11:58.916609 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.50.100,3260] successful.
May 28 03:11:58.916609 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.923319 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.923654 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:58.923654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:58.923857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:58.924603 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] HCTL ('9', '-', '-', 0) found on session 132 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:58.924724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:58.930819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:11:58.937892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching for a device in session 132 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:58.937892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.948878 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: tcp: [130] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: tcp: [131] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:11:58.949173 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:11:58.949384 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:11:58.949384 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:11:58.950067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] HCTL ('10', '-', '-', 0) found on session 133 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:11:58.950160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:11:58.964069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching for a device in session 133 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:11:58.964069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:11:59.033078 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:11:59.033251 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:11:59.035868 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:11:59.035995 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Claim successful on node np0000001589
May 28 03:11:59.790081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:12:00.568300 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:00.568428 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:00.805247 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found WWN 3300000009d764da0 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:12:00.805592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:00.805790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== connect_volume: return (4588ms) {'type': 'block', 'scsi_wwn': '3300000009d764da0', 'path': '/dev/dm-1', 'multipath_id': '3300000009d764da0'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:00.805963 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009d764da0', 'path': '/dev/dm-1', 'multipath_id': '3300000009d764da0'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:12:00.808345 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid ea253493-a3b6-47bf-808c-9bbf92db52f7 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:01.071061 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:01.311236 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Attempting to attach volume f66b078f-502a-43a6-9ce9-6ea4202ef06f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:12:01.312455 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:12:01.312455 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:01.312455 np0000001589 nova-compute[98297]:   <alias name="ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f"/>
May 28 03:12:01.312455 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:12:01.312455 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:01.312455 np0000001589 nova-compute[98297]:   <serial>f66b078f-502a-43a6-9ce9-6ea4202ef06f</serial>
May 28 03:12:01.312455 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:01.312455 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:12:01.577272 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.544s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:01.577743 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:12:01.808040 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:02.082742 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:12:02.082907 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:12:02.083118 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:02.083393 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:02.143971 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e16a5f4c7c34b3f9e725ac1fd8884cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '367ea52eb22f43adb2cd01467b3473ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:12:02.430975 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:02.586631 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:12:02.611152 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Successfully created port: fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:12:02.942690 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:02.943069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:02.943069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:02.943069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No VIF found with MAC fa:16:3e:21:ca:aa, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:03.056319 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:03.063957 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Successfully updated port: fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:12:03.090172 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:12:03.113951 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-changed-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:03.114617 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Refreshing instance network info cache due to event network-changed-fe085d6e-ad52-449d-b91b-aee0791962c5. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:03.114798 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] Acquiring lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:03.114925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] Acquired lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:03.115097 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Refreshing network info cache for port fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:03.565777 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:03.618017 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:03.698075 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:03.844940 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:04.099242 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:12:04.100155 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:12:04.100477 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Creating image(s)
May 28 03:12:04.100902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:04.103877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "/opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:04.107412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "/opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:04.107412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "acf82c8ef92e8d7f04b0a25f04011580c9c031ea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:04.107412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "acf82c8ef92e8d7f04b0a25f04011580c9c031ea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:04.347572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87c8201b-e659-4062-97aa-d7c2f09c996e req-33580b22-5f5c-4a58-92db-f0c94b177707 service nova] Releasing lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:04.348007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquired lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:04.348176 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:04.503370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-56dbc2fc-ca54-4b3d-99ce-a71802b37a5f tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.985s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:04.940915 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:04.954849 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:04.957243 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:04.960410 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:05.071597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.part --force-share --output=json" returned: 0 in 0.111s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:05.072120 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] 6e0d4ea0-013d-4edd-939b-661eac5cbbf4 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:12:05.072794 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:12:05.073249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.part /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:05.137541 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:05.219066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.part /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.converted" returned: 0 in 0.146s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:05.230088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:05.319302 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea.converted --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:05.321005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "acf82c8ef92e8d7f04b0a25f04011580c9c031ea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.214s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:05.321652 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:05.325462 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:05.326845 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:05.420211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:05.420211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "acf82c8ef92e8d7f04b0a25f04011580c9c031ea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:05.420520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "acf82c8ef92e8d7f04b0a25f04011580c9c031ea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:05.421015 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:05.423668 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:05.424002 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:05.462415 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:05.462893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:05.534018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:05.534509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea,backing_fmt=raw /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:05.595304 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea,backing_fmt=raw /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk 1073741824" returned: 0 in 0.060s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:05.595782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "acf82c8ef92e8d7f04b0a25f04011580c9c031ea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:05.596127 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:05.686254 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/acf82c8ef92e8d7f04b0a25f04011580c9c031ea --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:05.687090 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:12:05.687291 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Ensure instance console log exists: /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:12:05.687659 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:05.688002 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:05.688204 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:05.763249 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updating instance_info_cache with network_info: [{"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:05.967094 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Detaching volume f66b078f-502a-43a6-9ce9-6ea4202ef06f
May 28 03:12:06.005877 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Attempting to driver detach volume f66b078f-502a-43a6-9ce9-6ea4202ef06f from mountpoint /dev/vdb
May 28 03:12:06.014487 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found disk vdb by alias ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:12:06.015872 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found disk vdb by alias ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:12:06.015872 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Attempting to detach device vdb from instance ea253493-a3b6-47bf-808c-9bbf92db52f7 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:12:06.015872 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:12:06.015872 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:06.015872 np0000001589 nova-compute[98297]:   <alias name="ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f"/>
May 28 03:12:06.015872 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:12:06.015872 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:06.015872 np0000001589 nova-compute[98297]:   <serial>f66b078f-502a-43a6-9ce9-6ea4202ef06f</serial>
May 28 03:12:06.015872 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:12:06.015872 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:06.015872 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:12:06.021294 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully detached device vdb from instance ea253493-a3b6-47bf-808c-9bbf92db52f7 from the persistent domain config.
May 28 03:12:06.021294 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] (1/8): Attempting to detach device vdb with device alias ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f from instance ea253493-a3b6-47bf-808c-9bbf92db52f7 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:12:06.021481 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:12:06.021481 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:06.021481 np0000001589 nova-compute[98297]:   <alias name="ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f"/>
May 28 03:12:06.021481 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:12:06.021481 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:06.021481 np0000001589 nova-compute[98297]:   <serial>f66b078f-502a-43a6-9ce9-6ea4202ef06f</serial>
May 28 03:12:06.021481 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:12:06.021481 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:06.021481 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:12:06.191683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:06.192091 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:06.264800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Releasing lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:06.265053 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Instance network_info: |[{"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:12:06.266762 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Start _get_guest_xml network_info=[{"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='f1f5e864988c8475c42dced2752ba854',container_format='bare',created_at=2026-05-28T03:11:49Z,direct_url=<?>,disk_format='qcow2',id=6e0d4ea0-013d-4edd-939b-661eac5cbbf4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1864244221',owner='367ea52eb22f43adb2cd01467b3473ae',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T03:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': '6e0d4ea0-013d-4edd-939b-661eac5cbbf4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:12:06.269278 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:12:06.270414 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-906912063', uuid='4fabe539-c171-4d50-a5b4-64ee77668e8a'), owner=OwnerMeta(userid='4e16a5f4c7c34b3f9e725ac1fd8884cd', username='tempest-TestStampPattern-277675958-project-member', projectid='367ea52eb22f43adb2cd01467b3473ae', projectname='tempest-TestStampPattern-277675958'), image=ImageMeta(id='6e0d4ea0-013d-4edd-939b-661eac5cbbf4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': '367ea52eb22f43adb2cd01467b3473ae'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937926.2700882) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:12:06.272143 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:12:06.272143 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:12:06.273076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:12:06.273272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:12:06.274123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:12:06.274420 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f1f5e864988c8475c42dced2752ba854',container_format='bare',created_at=2026-05-28T03:11:49Z,direct_url=<?>,disk_format='qcow2',id=6e0d4ea0-013d-4edd-939b-661eac5cbbf4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1864244221',owner='367ea52eb22f43adb2cd01467b3473ae',properties=ImageMetaProps,protected=<?>,size=53673984,status='active',tags=<?>,updated_at=2026-05-28T03:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:12:06.274551 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:12:06.274638 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:12:06.274749 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:12:06.274837 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:12:06.274936 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:12:06.275077 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:12:06.275188 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:12:06.275327 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:12:06.275466 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:12:06.275580 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:12:06.286565 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-906912063',display_name='tempest-TestStampPattern-server-906912063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-teststamppattern-server-906912063',id=53,image_ref='6e0d4ea0-013d-4edd-939b-661eac5cbbf4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKEgysMdWopO6E3aAZPHlXvRqDZ+TYxL5JhnJTwlr4MspE/uoCewfhs6aHx4RT/K6l3FanqteTUkMjEY/GUBECAVHfwAYzhiHcP0zlwzDEZm0H6EvR9YWcZvaI8+O+Z7g==',key_name='tempest-TestStampPattern-70636981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367ea52eb22f43adb2cd01467b3473ae',ramdisk_id='',reservation_id='r-3yau7mxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='090d3888-c5fe-4b64-8caa-d93fc3f39bf3',image_min_disk='1',image_min_ram='0',image_owner_id='367ea52eb22f43adb2cd01467b3473ae',image_owner_project_name='tempest-TestStampPattern-277675958',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-277675958-project-member',image_user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',network_allocated='True',owner_project_name='tempest-TestStampPattern-277675958',owner_user_name='tempest-TestStampPattern-277675958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:03Z,user_data=None,user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',uuid=4fabe539-c171-4d50-a5b4-64ee77668e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:12:06.286706 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converting VIF {"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:06.287345 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d7:71,bridge_name='br-int',has_traffic_filtering=True,id=fe085d6e-ad52-449d-b91b-aee0791962c5,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe085d6e-ad') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:06.287852 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fabe539-c171-4d50-a5b4-64ee77668e8a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:06.535156 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937926.5347643, ea253493-a3b6-47bf-808c-9bbf92db52f7 => ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:12:06.537119 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f66b078f-502a-43a6-9ce9-6ea4202ef06f for instance ea253493-a3b6-47bf-808c-9bbf92db52f7 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:12:06.540216 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully detached device vdb from instance ea253493-a3b6-47bf-808c-9bbf92db52f7 from the live domain config.
May 28 03:12:06.541197 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:12:06.541738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:06.541941 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:06.542362 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:06.542697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f66b078f-502a-43a6-9ce9-6ea4202ef06f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:12:06.542892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:12:06.576984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:06.576984 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:06.576984 np0000001589 nova-compute[98297]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:12:06.576984 np0000001589 nova-compute[98297]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:12:06.576984 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:06.576984 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:06.576984 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:06.577210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:06.577210 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:06.577210 np0000001589 nova-compute[98297]: tcp: [132] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:12:06.577210 np0000001589 nova-compute[98297]: tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f (non-flash)
May 28 03:12:06.577210 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:06.577210 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:06.577210 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:06.577210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:12:06.577417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', '132')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:06.578114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f', '133')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:06.578993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646cbf60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:12:06.579239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:12:06.579506 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flush multipath device 3300000009d764da0 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:12:06.608507 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:06.666894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:06.694196 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:12:06.713300 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:12:06.713387 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:12:06.714373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:12:06.727063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:12:06.727302 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:12:06.739851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:06.772766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.40.100,3260]
May 28 03:12:06.772766 np0000001589 nova-compute[98297]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.40.100,3260] successful.
May 28 03:12:06.772766 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:06.787682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:06.791407 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] End _get_guest_xml xml=<domain type="qemu">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <uuid>4fabe539-c171-4d50-a5b4-64ee77668e8a</uuid>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <name>instance-00000035</name>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestStampPattern-server-906912063</nova:name>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:12:06</nova:creationTime>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:property name="img_owner_id">367ea52eb22f43adb2cd01467b3473ae</nova:property>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:user uuid="4e16a5f4c7c34b3f9e725ac1fd8884cd">tempest-TestStampPattern-277675958-project-member</nova:user>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:project uuid="367ea52eb22f43adb2cd01467b3473ae">tempest-TestStampPattern-277675958</nova:project>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         <nova:port uuid="fe085d6e-ad52-449d-b91b-aee0791962c5">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <system>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <entry name="serial">4fabe539-c171-4d50-a5b4-64ee77668e8a</entry>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <entry name="uuid">4fabe539-c171-4d50-a5b4-64ee77668e8a</entry>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </system>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <os>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   </os>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <features>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   </features>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   <devices>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk.config"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d7:d7:71"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <target dev="tapfe085d6e-ad"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </interface>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/console.log" append="off"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </serial>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <video>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </video>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </rng>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:   </devices>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]: </domain>
May 28 03:12:06.791407 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:12:06.794721 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Preparing to wait for external event network-vif-plugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:12:06.794721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:06.794721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:06.794721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:06.794721 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-906912063',display_name='tempest-TestStampPattern-server-906912063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-teststamppattern-server-906912063',id=53,image_ref='6e0d4ea0-013d-4edd-939b-661eac5cbbf4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKEgysMdWopO6E3aAZPHlXvRqDZ+TYxL5JhnJTwlr4MspE/uoCewfhs6aHx4RT/K6l3FanqteTUkMjEY/GUBECAVHfwAYzhiHcP0zlwzDEZm0H6EvR9YWcZvaI8+O+Z7g==',key_name='tempest-TestStampPattern-70636981',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='367ea52eb22f43adb2cd01467b3473ae',ramdisk_id='',reservation_id='r-3yau7mxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='090d3888-c5fe-4b64-8caa-d93fc3f39bf3',image_min_disk='1',image_min_ram='0',image_owner_id='367ea52eb22f43adb2cd01467b3473ae',image_owner_project_name='tempest-TestStampPattern-277675958',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-277675958-project-member',image_user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',network_allocated='True',owner_project_name='tempest-TestStampPattern-277675958',owner_user_name='tempest-TestStampPattern-277675958-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:03Z,user_data=None,user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',uuid=4fabe539-c171-4d50-a5b4-64ee77668e8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:12:06.794721 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converting VIF {"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:06.795129 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d7:71,bridge_name='br-int',has_traffic_filtering=True,id=fe085d6e-ad52-449d-b91b-aee0791962c5,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe085d6e-ad') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:06.795517 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d7:71,bridge_name='br-int',has_traffic_filtering=True,id=fe085d6e-ad52-449d-b91b-aee0791962c5,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe085d6e-ad') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:12:06.795873 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:06.796241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:06.796600 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:12:06.801033 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:06.804250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:06.804250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1c9b753-8aa4-55d9-8f99-fe839331042b', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:06.804250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:06.804250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:06.804721 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:06.807146 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:06.807311 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe085d6e-ad, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:06.807650 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe085d6e-ad, col_values=(('qos', UUID('76cefce0-ae5e-4856-8c4e-586e00d69407')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:06.807861 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe085d6e-ad, col_values=(('external_ids', {'iface-id': 'fe085d6e-ad52-449d-b91b-aee0791962c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:d7:71', 'vm-uuid': '4fabe539-c171-4d50-a5b4-64ee77668e8a'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:06.808893 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:06.811029 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:06.815568 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:06.816530 np0000001589 nova-compute[98297]: INFO os_vif [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:d7:71,bridge_name='br-int',has_traffic_filtering=True,id=fe085d6e-ad52-449d-b91b-aee0791962c5,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe085d6e-ad')
May 28 03:12:06.835075 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.50.100,3260]
May 28 03:12:06.835075 np0000001589 nova-compute[98297]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-f66b078f-502a-43a6-9ce9-6ea4202ef06f, portal: 192.168.50.100,3260] successful.
May 28 03:12:06.835075 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:06.849194 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:06.849447 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:06.849597 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== disconnect_volume: return (307ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:06.849750 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:12:07.242679 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:07.243106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:07.246992 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:12:07.247148 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Claim successful on node np0000001589
May 28 03:12:07.404449 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid ea253493-a3b6-47bf-808c-9bbf92db52f7 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:08.055440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:08.339663 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:08.339954 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:08.339954 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No VIF found with MAC fa:16:3e:d7:d7:71, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:08.340374 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Using config drive
May 28 03:12:08.412604 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-303d4ab9-5a92-4792-8dcf-abdf6ced0338 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.950s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:08.705591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:08.705783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:08.705989 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:08.706523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:08.706665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:08.711649 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Terminating instance
May 28 03:12:08.815340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:08.815580 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:08.848276 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:08.961070 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Creating config drive at /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk.config
May 28 03:12:08.964900 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzxiesjj {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:09.021117 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqzxiesjj" returned: 0 in 0.056s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:09.217278 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:12:09.240355 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.242611 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.257092 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.262323 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.277690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.286894 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.318356 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:09.361789 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b945270b-6611-4b58-a5c9-afe736e4168a req-8cb2ce8a-ef15-4833-81bb-874b2ff88462 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-vif-unplugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:09.362162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b945270b-6611-4b58-a5c9-afe736e4168a req-8cb2ce8a-ef15-4833-81bb-874b2ff88462 service nova] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:09.362348 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b945270b-6611-4b58-a5c9-afe736e4168a req-8cb2ce8a-ef15-4833-81bb-874b2ff88462 service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:09.362568 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b945270b-6611-4b58-a5c9-afe736e4168a req-8cb2ce8a-ef15-4833-81bb-874b2ff88462 service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:09.362697 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b945270b-6611-4b58-a5c9-afe736e4168a req-8cb2ce8a-ef15-4833-81bb-874b2ff88462 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] No waiting events found dispatching network-vif-unplugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:09.362763 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b945270b-6611-4b58-a5c9-afe736e4168a req-8cb2ce8a-ef15-4833-81bb-874b2ff88462 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-vif-unplugged-67288e8e-d874-4086-b637-5971669893e2 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:12:09.399015 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.423699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.426143 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.520814 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.581766 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.588065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:09.595095 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-94c7a127-dd5e-4e5b-94e6-89847ca8ec98 req-100e5e16-8d28-4c5c-b8fd-92c500cbbf2a service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-vif-plugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:09.595447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94c7a127-dd5e-4e5b-94e6-89847ca8ec98 req-100e5e16-8d28-4c5c-b8fd-92c500cbbf2a service nova] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:09.595636 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94c7a127-dd5e-4e5b-94e6-89847ca8ec98 req-100e5e16-8d28-4c5c-b8fd-92c500cbbf2a service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:09.595771 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94c7a127-dd5e-4e5b-94e6-89847ca8ec98 req-100e5e16-8d28-4c5c-b8fd-92c500cbbf2a service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:09.595970 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-94c7a127-dd5e-4e5b-94e6-89847ca8ec98 req-100e5e16-8d28-4c5c-b8fd-92c500cbbf2a service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Processing event network-vif-plugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:12:09.643774 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99952769299989 future=<Future at 0x7e4b644ec6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:09.644121 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99913180700014 future=<Future at 0x7e4b644ec6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:09.644294 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998993619999965 future=<Future at 0x7e4b644ec6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:09.646012 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Instance destroyed successfully.
May 28 03:12:09.646751 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'resources' on Instance uuid ea253493-a3b6-47bf-808c-9bbf92db52f7 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:09.825519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.583s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:09.825944 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:12:10.149688 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1184985123',display_name='tempest-AttachVolumeNegativeTest-server-1184985123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-1184985123',id=50,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnICvf8dHweB4v0kZM1HKwqK7+xT7Zz6BG7B2HlnBQbOGUmKQkuqxtAM2TjeU3D5QZOFUKh/p/zBNAwMmTRLLlRmt2Nx5M9V6FCQmBbt2QlYftWCdToampm+EAYId2QMg==',key_name='tempest-keypair-636854390',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:11:13Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-i8lfzl3n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:11:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=ea253493-a3b6-47bf-808c-9bbf92db52f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:12:10.149935 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "67288e8e-d874-4086-b637-5971669893e2", "address": "fa:16:3e:21:ca:aa", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap67288e8e-d8", "ovs_interfaceid": "67288e8e-d874-4086-b637-5971669893e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:10.150816 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:ca:aa,bridge_name='br-int',has_traffic_filtering=True,id=67288e8e-d874-4086-b637-5971669893e2,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67288e8e-d8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:10.151184 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:ca:aa,bridge_name='br-int',has_traffic_filtering=True,id=67288e8e-d874-4086-b637-5971669893e2,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67288e8e-d8') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:12:10.152761 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:10.153041 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67288e8e-d8, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:10.154423 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:10.155157 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:10.156214 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:10.157236 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:10.157405 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7882d850-d957-4846-97d7-20abc524a7ed) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:10.158019 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:10.158698 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:10.160364 np0000001589 nova-compute[98297]: INFO os_vif [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:ca:aa,bridge_name='br-int',has_traffic_filtering=True,id=67288e8e-d874-4086-b637-5971669893e2,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67288e8e-d8')
May 28 03:12:10.160640 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Deleting instance files /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7_del
May 28 03:12:10.161463 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Deletion of /opt/stack/data/nova/instances/ea253493-a3b6-47bf-808c-9bbf92db52f7_del complete
May 28 03:12:10.168822 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:12:10.169135 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937930.168913, 4fabe539-c171-4d50-a5b4-64ee77668e8a => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:10.169308 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] VM Started (Lifecycle Event)
May 28 03:12:10.171358 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:12:10.173990 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Instance spawned successfully.
May 28 03:12:10.174556 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:12:10.176753 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:10.177011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:10.330927 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:12:10.331200 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:12:10.331506 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:10.331763 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:10.394237 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c083fd5d4f04c58b1c5ecc8cae5ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79d7d10d3654992aab71cc666e52080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:12:10.667479 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Took 1.45 seconds to destroy the instance on the hypervisor.
May 28 03:12:10.668159 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:12:10.668469 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:12:10.668572 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:12:10.668811 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:10.671770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:10.675670 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:10.681381 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Took 6.58 seconds to spawn the instance on the hypervisor.
May 28 03:12:10.681528 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:10.754995 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:10.834115 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:12:10.854261 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Successfully created port: 757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:12:11.177542 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:12:11.177734 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937931.1775947, 4fabe539-c171-4d50-a5b4-64ee77668e8a => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:11.177838 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] VM Paused (Lifecycle Event)
May 28 03:12:11.194682 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Took 12.21 seconds to build instance.
May 28 03:12:11.224972 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-da544918-e5d1-46d4-9196-902960f4741e req-d6ec9de1-8ab4-4c28-a9c2-45565237d2e0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-vif-deleted-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:11.225217 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-da544918-e5d1-46d4-9196-902960f4741e req-d6ec9de1-8ab4-4c28-a9c2-45565237d2e0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Neutron deleted interface 67288e8e-d874-4086-b637-5971669893e2; detaching it from the instance and deleting it from the info cache
May 28 03:12:11.227720 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-da544918-e5d1-46d4-9196-902960f4741e req-d6ec9de1-8ab4-4c28-a9c2-45565237d2e0 service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Detach interface failed, port_id=67288e8e-d874-4086-b637-5971669893e2, reason: Instance ea253493-a3b6-47bf-808c-9bbf92db52f7 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:12:11.329923 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Successfully updated port: 757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:12:11.337525 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:12:11.417447 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f0ac6e1a-a46f-4138-bb51-516364d75054 req-8242fd6f-7ee7-4c6e-a96a-ce8a56267a1f service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-vif-unplugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:11.417801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f0ac6e1a-a46f-4138-bb51-516364d75054 req-8242fd6f-7ee7-4c6e-a96a-ce8a56267a1f service nova] Acquiring lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:11.417801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f0ac6e1a-a46f-4138-bb51-516364d75054 req-8242fd6f-7ee7-4c6e-a96a-ce8a56267a1f service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:11.417917 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f0ac6e1a-a46f-4138-bb51-516364d75054 req-8242fd6f-7ee7-4c6e-a96a-ce8a56267a1f service nova] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:11.418028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f0ac6e1a-a46f-4138-bb51-516364d75054 req-8242fd6f-7ee7-4c6e-a96a-ce8a56267a1f service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] No waiting events found dispatching network-vif-unplugged-67288e8e-d874-4086-b637-5971669893e2 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:11.418152 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f0ac6e1a-a46f-4138-bb51-516364d75054 req-8242fd6f-7ee7-4c6e-a96a-ce8a56267a1f service nova] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Received event network-vif-unplugged-67288e8e-d874-4086-b637-5971669893e2 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:12:11.654750 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-vif-plugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:11.654918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:11.655063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:11.655170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:11.658155 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] No waiting events found dispatching network-vif-plugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:11.658155 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received unexpected event network-vif-plugged-fe085d6e-ad52-449d-b91b-aee0791962c5 for instance with vm_state active and task_state None.
May 28 03:12:11.658155 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-changed-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:11.658155 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Refreshing instance network info cache due to event network-changed-757b64c0-7f62-4838-87fd-50b2d42bc6f6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:11.658155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] Acquiring lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:11.658155 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] Acquired lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:11.658155 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Refreshing network info cache for port 757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:11.675440 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:11.682218 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:11.685382 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937931.6851492, 4fabe539-c171-4d50-a5b4-64ee77668e8a => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:11.685495 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] VM Resumed (Lifecycle Event)
May 28 03:12:11.696150 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-127ef7a4-9866-48f7-8855-65b8d4177cba tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.714s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:11.832189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:12.159974 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:12.177170 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Took 1.51 seconds to deallocate network for instance.
May 28 03:12:12.189110 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:12.191893 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:12.228010 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:12.347259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:12:12.348174 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:12:12.348411 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Creating image(s)
May 28 03:12:12.348888 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "/opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:12.349092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "/opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:12.350379 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "/opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:12.350985 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:12.354644 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:12.355725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:12.384050 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:12.461643 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:12.461643 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:12.462152 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:12.462590 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:12.465271 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:12.465597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:12.559138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:12.559575 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:12.623160 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk 1073741824" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:12.624075 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:12.625163 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:12.684570 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:12.685279 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:12.719778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.095s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:12.722970 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Checking if we can resize image /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:12:12.722970 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:12.825374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:12.825374 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Cannot resize image /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:12:12.825374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:12:12.825374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Ensure instance console log exists: /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:12:12.825374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:12.825374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:12.825374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:12.888297 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-78f2cbd0-be55-49c5-bfa4-6fdb79a0589c req-4d74df2f-2544-4dc7-b2df-359aab97f7c0 service nova] Releasing lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:12.888863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquired lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:12.889064 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:13.057446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:13.293491 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-changed-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:13.294026 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Refreshing instance network info cache due to event network-changed-fe085d6e-ad52-449d-b91b-aee0791962c5. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:13.294130 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] Acquiring lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:13.294238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] Acquired lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:13.294708 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Refreshing network info cache for port fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:13.301392 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:13.301591 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:13.483170 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:13.658156 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:13.783524 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Updating instance_info_cache with network_info: [{"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:13.796510 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:13.804513 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:14.112246 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:14.112518 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:14.140700 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:14.284750 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updated VIF entry in instance network info cache for port fe085d6e-ad52-449d-b91b-aee0791962c5. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:12:14.285599 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Releasing lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:14.286254 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updating instance_info_cache with network_info: [{"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:14.286692 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Instance network_info: |[{"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:12:14.290361 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Start _get_guest_xml network_info=[{"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:12:14.293284 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:12:14.294978 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-2134597055', uuid='254c1717-ee79-4b55-8cf6-c18a282bf9fb'), owner=OwnerMeta(userid='3c083fd5d4f04c58b1c5ecc8cae5ffce', username='tempest-TestEncryptedCinderVolumes-124411028-project-member', projectid='f79d7d10d3654992aab71cc666e52080', projectname='tempest-TestEncryptedCinderVolumes-124411028'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937934.2945707) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:12:14.296025 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:12:14.296424 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:12:14.298194 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:12:14.298439 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:12:14.299511 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:12:14.299882 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:12:14.300085 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:12:14.300255 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:12:14.300455 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:12:14.300615 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:12:14.300808 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:12:14.300989 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:12:14.301093 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:12:14.301196 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:12:14.301334 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:12:14.301474 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:12:14.310399 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.625s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:14.315485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2134597055',display_name='tempest-TestEncryptedCinderVolumes-server-2134597055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-2134597055',id=54,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGggu/dW0Ix35tNFNC9k0hJxy/M7yp9zaU+iBEDEz6w78FvOF1+etaLyxoQ4VJ9n5AZfwJZiSK2MYNwk1XBYsXoKSCWgbZnTfmbyHRovEJqWRi+BzpS0WnkxNV07GAt0ig==',key_name='tempest-keypair-1941161888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-p7ne2ygp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=254c1717-ee79-4b55-8cf6-c18a282bf9fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:12:14.315901 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:14.316449 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b4:bc,bridge_name='br-int',has_traffic_filtering=True,id=757b64c0-7f62-4838-87fd-50b2d42bc6f6,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757b64c0-7f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:14.316963 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'pci_devices' on Instance uuid 254c1717-ee79-4b55-8cf6-c18a282bf9fb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:14.367579 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Deleted allocations for instance ea253493-a3b6-47bf-808c-9bbf92db52f7
May 28 03:12:14.581263 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:14.581731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:14.618183 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Detaching volume 0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:12:14.654192 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Attempting to driver detach volume 0efa3c41-7988-4a44-805e-8d6483085f9b from mountpoint /dev/vdb
May 28 03:12:14.659585 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:12:14.660846 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:12:14.661010 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Attempting to detach device vdb from instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:12:14.661323 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:   <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-10"/>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:   <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:14.661323 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:12:14.666552 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb from the persistent domain config.
May 28 03:12:14.666718 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] (1/8): Attempting to detach device vdb with device alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b from instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:12:14.667018 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:   <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-10"/>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:   <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:14.667018 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:12:14.791475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6318a424-3d17-4704-99cc-fa396fdc273c req-6ac80748-eb44-4fef-b29b-5c87c1a40132 service nova] Releasing lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:14.819533 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] End _get_guest_xml xml=<domain type="qemu">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <uuid>254c1717-ee79-4b55-8cf6-c18a282bf9fb</uuid>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <name>instance-00000036</name>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-2134597055</nova:name>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:12:14</nova:creationTime>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:user uuid="3c083fd5d4f04c58b1c5ecc8cae5ffce">tempest-TestEncryptedCinderVolumes-124411028-project-member</nova:user>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:project uuid="f79d7d10d3654992aab71cc666e52080">tempest-TestEncryptedCinderVolumes-124411028</nova:project>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         <nova:port uuid="757b64c0-7f62-4838-87fd-50b2d42bc6f6">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <system>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <entry name="serial">254c1717-ee79-4b55-8cf6-c18a282bf9fb</entry>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <entry name="uuid">254c1717-ee79-4b55-8cf6-c18a282bf9fb</entry>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </system>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <os>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   </os>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <features>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   </features>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   <devices>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk.config"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:26:b4:bc"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <target dev="tap757b64c0-7f"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </interface>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/console.log" append="off"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </serial>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <video>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </video>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </rng>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:   </devices>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]: </domain>
May 28 03:12:14.819533 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:12:14.821482 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Preparing to wait for external event network-vif-plugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:12:14.821482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:14.821482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:14.821482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:14.825081 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2134597055',display_name='tempest-TestEncryptedCinderVolumes-server-2134597055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-2134597055',id=54,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGggu/dW0Ix35tNFNC9k0hJxy/M7yp9zaU+iBEDEz6w78FvOF1+etaLyxoQ4VJ9n5AZfwJZiSK2MYNwk1XBYsXoKSCWgbZnTfmbyHRovEJqWRi+BzpS0WnkxNV07GAt0ig==',key_name='tempest-keypair-1941161888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-p7ne2ygp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=254c1717-ee79-4b55-8cf6-c18a282bf9fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:12:14.825081 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:14.825660 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:b4:bc,bridge_name='br-int',has_traffic_filtering=True,id=757b64c0-7f62-4838-87fd-50b2d42bc6f6,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757b64c0-7f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:14.827953 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b4:bc,bridge_name='br-int',has_traffic_filtering=True,id=757b64c0-7f62-4838-87fd-50b2d42bc6f6,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757b64c0-7f') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:12:14.828281 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:14.828565 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:14.828864 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:12:14.829920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:14.830112 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c53d7251-5aa5-572b-8cac-e1d564758d1f', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:14.830942 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:14.833242 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:14.833242 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:14.836496 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:14.836722 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap757b64c0-7f, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:14.837107 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap757b64c0-7f, col_values=(('qos', UUID('347d1c09-2231-46ff-9e60-10164c9a39e3')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:14.837364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap757b64c0-7f, col_values=(('external_ids', {'iface-id': '757b64c0-7f62-4838-87fd-50b2d42bc6f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:b4:bc', 'vm-uuid': '254c1717-ee79-4b55-8cf6-c18a282bf9fb'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:14.840652 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:14.844671 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:14.844671 np0000001589 nova-compute[98297]: INFO os_vif [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:b4:bc,bridge_name='br-int',has_traffic_filtering=True,id=757b64c0-7f62-4838-87fd-50b2d42bc6f6,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757b64c0-7f')
May 28 03:12:15.085055 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'flavor' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:15.191436 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937935.1910028, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => ua-0efa3c41-7988-4a44-805e-8d6483085f9b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:12:15.192269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b for instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:12:15.194438 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb from the live domain config.
May 28 03:12:15.374910 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fba77b6-d330-49d5-8f3a-f777502a1f37 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "ea253493-a3b6-47bf-808c-9bbf92db52f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.669s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:15.729365 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Detected multiple connections on this host for volume: 0efa3c41-7988-4a44-805e-8d6483085f9b, skipping target disconnect.
May 28 03:12:16.089885 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:16.277030 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:16.363101 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:16.363176 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:16.363310 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No VIF found with MAC fa:16:3e:26:b4:bc, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:16.363717 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Using config drive
May 28 03:12:16.868889 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:17.000376 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Creating config drive at /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk.config
May 28 03:12:17.004178 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps6o_2pz1 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:17.062597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps6o_2pz1" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:17.154475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:17.154810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:17.155142 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Attaching volume 9f850e76-a644-43cb-a4b2-e204e14c727f to /dev/vdb
May 28 03:12:17.216699 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:17.229903 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:12:17.255697 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:17.285992 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b634722-3d64-4f3b-8a55-b3ef2c878794 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:17.300984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:12:17.301289 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:12:17.313391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:12:17.315957 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fee0:12b8', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fec7:48ab', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fed7:d771'] 
May 28 03:12:17.316116 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:12:17.316202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:12:17.319435 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:17.319797 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating existing volume attachment record: 4c8c53dc-36e9-464c-88ef-5151b13c9c9c {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:12:17.451004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:17.451221 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:17.469203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.491020 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.493209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.597126 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.665455 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bae0a248-83e5-441d-9d4c-76a72cccc4e2 req-90039de0-f290-4c1f-b470-0eea7c82d646 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-vif-plugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:17.665455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bae0a248-83e5-441d-9d4c-76a72cccc4e2 req-90039de0-f290-4c1f-b470-0eea7c82d646 service nova] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:17.665590 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bae0a248-83e5-441d-9d4c-76a72cccc4e2 req-90039de0-f290-4c1f-b470-0eea7c82d646 service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:17.665633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bae0a248-83e5-441d-9d4c-76a72cccc4e2 req-90039de0-f290-4c1f-b470-0eea7c82d646 service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:17.665727 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bae0a248-83e5-441d-9d4c-76a72cccc4e2 req-90039de0-f290-4c1f-b470-0eea7c82d646 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Processing event network-vif-plugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:12:17.861552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.865359 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.868665 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.886926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:12:17.887372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f850e76-a644-43cb-a4b2-e204e14c727f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:17.887372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:17.887712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:17.888010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f850e76-a644-43cb-a4b2-e204e14c727f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:12:17.895543 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:17.907962 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:17.909057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:17.909688 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:17.909950 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:17.910727 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:17.910967 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:17.922776 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:17.922776 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:17.928700 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:17.928700 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:17.939146 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f] added
May 28 03:12:17.939146 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:17.939146 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:17.939146 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:17.939146 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:17.939146 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:17.939146 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:17.939350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:17.939684 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:17.939876 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:17.945942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:17.946146 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:17.949905 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f] added
May 28 03:12:17.949905 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:17.949905 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:17.949905 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:17.949905 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:17.949905 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:17.949905 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:17.950155 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:17.950198 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0392(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:17.950324 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:17.954192 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Detaching volume 0efa3c41-7988-4a44-805e-8d6483085f9b
May 28 03:12:17.965244 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:17.966429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:17.993660 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Attempting to driver detach volume 0efa3c41-7988-4a44-805e-8d6483085f9b from mountpoint /dev/vdb
May 28 03:12:17.998420 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:12:17.999880 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found disk vdb by alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:12:18.000055 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Attempting to detach device vdb from instance b3b73e16-989c-483c-866f-4e179edfbeef from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:12:18.000369 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:   <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-10"/>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:   <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:18.000369 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:12:18.005943 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance b3b73e16-989c-483c-866f-4e179edfbeef from the persistent domain config.
May 28 03:12:18.006128 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] (1/8): Attempting to detach device vdb with device alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b from instance b3b73e16-989c-483c-866f-4e179edfbeef from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:12:18.006438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:   <alias name="ua-0efa3c41-7988-4a44-805e-8d6483085f9b"/>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-10"/>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:   <serial>0efa3c41-7988-4a44-805e-8d6483085f9b</serial>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:18.006438 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:12:18.059260 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:18.255596 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937938.2551348, 254c1717-ee79-4b55-8cf6-c18a282bf9fb => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:18.256769 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:12:18.257027 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] VM Started (Lifecycle Event)
May 28 03:12:18.260701 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:12:18.263238 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Instance spawned successfully.
May 28 03:12:18.263489 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:12:18.450968 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:12:18.472973 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:18.759599 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:18.762597 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:18.774245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:18.774453 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:18.774880 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:18.775209 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:18.775599 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:18.775981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:18.940320 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:18.950744 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:18.952893 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:18.952893 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:18.965255 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:18.965255 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:18.970195 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:18.981607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:18.991644 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.991644 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.991644 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.991644 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.991644 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:18.991943 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.991943 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.991943 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.991943 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.991943 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:18.997393 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.997393 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.997393 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.997393 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.997393 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:18.997574 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.997574 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:18.997574 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.997574 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:18.997574 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:19.019521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:19.021457 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:19.025011 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:12:19.025334 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Claim successful on node np0000001589
May 28 03:12:19.030926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.40.100,3260]
May 28 03:12:19.030926 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.40.100,3260] successful.
May 28 03:12:19.030926 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:19.040046 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.50.100,3260]
May 28 03:12:19.040046 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.50.100,3260] successful.
May 28 03:12:19.040046 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:19.046030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:19.061615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:19.062150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.062150 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.062150 np0000001589 nova-compute[98297]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.062150 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.062150 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.062150 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.062150 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:19.062375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.062375 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.062375 np0000001589 nova-compute[98297]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.062375 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.062375 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.062375 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.062375 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:19.062507 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:19.062601 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:19.063292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] HCTL ('7', '-', '-', 0) found on session 134 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:19.063399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:19.078758 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:19.078758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:19.080037 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] HCTL ('8', '-', '-', 0) found on session 135 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:19.080479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:19.081534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching for a device in session 134 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:19.081780 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f850e76-a644-43cb-a4b2-e204e14c727f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:19.093664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching for a device in session 135 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:19.093664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f850e76-a644-43cb-a4b2-e204e14c727f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:19.264827 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:12:19.265154 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937939.264931, 254c1717-ee79-4b55-8cf6-c18a282bf9fb => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:19.265313 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] VM Paused (Lifecycle Event)
May 28 03:12:19.282383 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Took 6.93 seconds to spawn the instance on the hypervisor.
May 28 03:12:19.282507 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:19.478578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:19.725626 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c5f8e151-2ce1-47b6-88a0-77e22ba5f75a req-05ea3e26-13e8-432f-ba06-a473a439c88c service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-vif-plugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:19.727348 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c5f8e151-2ce1-47b6-88a0-77e22ba5f75a req-05ea3e26-13e8-432f-ba06-a473a439c88c service nova] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:19.727559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c5f8e151-2ce1-47b6-88a0-77e22ba5f75a req-05ea3e26-13e8-432f-ba06-a473a439c88c service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:19.727683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c5f8e151-2ce1-47b6-88a0-77e22ba5f75a req-05ea3e26-13e8-432f-ba06-a473a439c88c service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:19.727818 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c5f8e151-2ce1-47b6-88a0-77e22ba5f75a req-05ea3e26-13e8-432f-ba06-a473a439c88c service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] No waiting events found dispatching network-vif-plugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:19.727931 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c5f8e151-2ce1-47b6-88a0-77e22ba5f75a req-05ea3e26-13e8-432f-ba06-a473a439c88c service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received unexpected event network-vif-plugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 for instance with vm_state active and task_state None.
May 28 03:12:19.767636 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:19.770200 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937939.7700117, 254c1717-ee79-4b55-8cf6-c18a282bf9fb => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:19.770328 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] VM Resumed (Lifecycle Event)
May 28 03:12:19.790777 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Took 12.59 seconds to build instance.
May 28 03:12:19.839024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:19.910934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:12:20.272570 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:20.274784 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:20.292256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.100s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:20.494702 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-changed-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:20.495156 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Refreshing instance network info cache due to event network-changed-757b64c0-7f62-4838-87fd-50b2d42bc6f6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:20.495528 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] Acquiring lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:20.496344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] Acquired lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:20.497960 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Refreshing network info cache for port 757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:20.549783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:20.549980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:20.550185 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Attaching volume 9ea570b2-c55c-41ba-8f2d-b4019fa567ff to /dev/vdb
May 28 03:12:20.606433 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:20.621329 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:12:20.643509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:20.696810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:12:20.697093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:12:20.707813 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:12:20.709346 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fee0:12b8', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fec7:48ab', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fed7:d771', 'fe80::fc16:3eff:fe26:b4bc', 'fe80::ac8c:9cff:fe07:8685'] 
May 28 03:12:20.709470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:12:20.709558 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:12:20.709761 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:20.710005 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating existing volume attachment record: eb6f7294-1c40-452f-b9cd-7a2590755ec9 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:12:20.786351 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:20.786615 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:20.928744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Found WWN 33000000081196cc6 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:12:20.928744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:20.928744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] <== connect_volume: return (3040ms) {'type': 'block', 'scsi_wwn': '33000000081196cc6', 'path': '/dev/dm-0', 'multipath_id': '33000000081196cc6'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:20.928744 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000081196cc6', 'path': '/dev/dm-0', 'multipath_id': '33000000081196cc6'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:12:20.932769 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'flavor' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:21.001479 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:21.065063 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937941.0646164, b3b73e16-989c-483c-866f-4e179edfbeef => ua-0efa3c41-7988-4a44-805e-8d6483085f9b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:12:21.067423 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0efa3c41-7988-4a44-805e-8d6483085f9b for instance b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:12:21.070240 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully detached device vdb from instance b3b73e16-989c-483c-866f-4e179edfbeef from the live domain config.
May 28 03:12:21.107452 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:12:21.107860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:21.107999 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:21.108436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:21.108817 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0efa3c41-7988-4a44-805e-8d6483085f9b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:12:21.108993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:12:21.138860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:21.138860 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:21.138860 np0000001589 nova-compute[98297]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:21.138860 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:21.138860 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:21.138860 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:21.138860 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:21.139124 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [120] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:21.139124 np0000001589 nova-compute[98297]: tcp: [121] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b (non-flash)
May 28 03:12:21.139124 np0000001589 nova-compute[98297]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:21.139124 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:21.139124 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:21.139124 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:21.139124 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:21.139354 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:12:21.139437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '121')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:21.141333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b', '120')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:21.141623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b644a7920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'): ({'sdj'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:12:21.141892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Removing multipathed devices sdk, sdj {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:12:21.142188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flush multipath device 330000000bb4f5b77 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:12:21.175908 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:21.217724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:21.280308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:12:21.280308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:12:21.281148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:12:21.291449 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:21.300529 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:12:21.300759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:12:21.308653 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '04163091-a678-44e3-9e68-2572090c60c2', 'attached_at': '', 'detached_at': '', 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'serial': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:12:21.311104 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.312131 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:12:21.312456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:21.312634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:21.343602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 121, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.40.100,3260]
May 28 03:12:21.343602 np0000001589 nova-compute[98297]: Logout of [sid: 121, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.40.100,3260] successful.
May 28 03:12:21.343602 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.361427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.372560 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.402455 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.50.100,3260]
May 28 03:12:21.402455 np0000001589 nova-compute[98297]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-0efa3c41-7988-4a44-805e-8d6483085f9b, portal: 192.168.50.100,3260] successful.
May 28 03:12:21.402455 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.415141 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:21.420425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.420654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:21.420784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== disconnect_volume: return (313ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:21.420905 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:12:21.422694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.110s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:21.422982 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:12:21.438252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:21.438252 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Attempting to attach volume 9f850e76-a644-43cb-a4b2-e204e14c727f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:12:21.438252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:21.438252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:21.438252 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:21.438928 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:12:21.438928 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:21.438928 np0000001589 nova-compute[98297]:   <alias name="ua-9f850e76-a644-43cb-a4b2-e204e14c727f"/>
May 28 03:12:21.438928 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:12:21.438928 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:21.438928 np0000001589 nova-compute[98297]:   <serial>9f850e76-a644-43cb-a4b2-e204e14c727f</serial>
May 28 03:12:21.438928 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:21.438928 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:12:21.439432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:21.439588 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:21.452601 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:21.452601 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.464104 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:21.464104 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.473074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff] added
May 28 03:12:21.473074 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:21.473074 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:21.473074 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:21.473074 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:21.473074 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:21.473074 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.473381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:21.473499 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0352(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:21.473706 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:21.480437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff] added
May 28 03:12:21.480437 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:21.480437 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:21.480437 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:21.480437 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:21.480437 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:21.480437 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:21.480878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:21.481002 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:21.481179 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:21.591876 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Updated VIF entry in instance network info cache for port 757b64c0-7f62-4838-87fd-50b2d42bc6f6. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:12:21.592158 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Updating instance_info_cache with network_info: [{"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:21.802284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.782s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:21.803852 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:12:21.972396 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'flavor' on Instance uuid b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:22.094762 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f741c583-7df1-4b2f-aa60-459ab59192d5 req-2aa6ab30-9b01-4e48-b312-653e011a2106 service nova] Releasing lock "refresh_cache-254c1717-ee79-4b55-8cf6-c18a282bf9fb" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:22.308291 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:12:22.308638 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:12:22.308671 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:22.308875 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:22.373423 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fba297a0d43248c883c9b6100d92cae8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '094dc3cb80814083a18dc5026b895ec5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:12:22.474145 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:22.481587 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:22.489316 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:22.489316 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:22.499000 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:22.499000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.505236 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.512010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.520640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.520640 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.520640 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.520640 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.520640 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:22.520955 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.520955 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.520955 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.520955 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.520955 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:22.528039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.528039 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.528039 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.528039 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.528039 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:22.528334 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.528334 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.528334 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.528334 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.528334 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:22.562443 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260]
May 28 03:12:22.562443 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260] successful.
May 28 03:12:22.562443 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.569153 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260]
May 28 03:12:22.569153 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260] successful.
May 28 03:12:22.569153 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.578553 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.584368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:22.599792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.599792 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.599792 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.599792 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.599792 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.599792 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.599792 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:22.600026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.600026 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.600026 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.600026 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.600026 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.600026 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.600026 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:22.600330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:22.600489 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:22.601427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('9', '-', '-', 0) found on session 136 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:22.601571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:22.606414 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.606414 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.606414 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.606414 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.606414 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.606414 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.606414 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:22.606622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.606622 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:22.606622 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.606622 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:22.606622 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.606622 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:22.606622 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:22.606794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:22.606890 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:22.607567 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('10', '-', '-', 0) found on session 137 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:22.607664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:22.623484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 136 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:22.623484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:22.631049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 137 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:22.631049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:22.811093 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:12:22.827958 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Successfully created port: 317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:12:22.983548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2417e545-c4f0-42d7-ae9d-23a87fb39bd2 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.532s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:23.061037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:23.119729 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:23.119871 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:23.119962 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:23.120038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No VIF found with MAC fa:16:3e:e0:12:b8, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:23.283505 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Successfully updated port: 317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:12:23.314259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:12:23.340191 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-changed-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:23.340191 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Refreshing instance network info cache due to event network-changed-317630c5-3c64-45a5-bf0c-fe46bdb55689. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:23.340191 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] Acquiring lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:23.340191 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] Acquired lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:23.340191 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Refreshing network info cache for port 317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:23.439344 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:12:23.786137 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:23.842131 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:23.930314 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:24.093714 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:24.325081 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:12:24.326369 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:12:24.326653 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Creating image(s)
May 28 03:12:24.327302 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "/opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:24.327493 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:24.328167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "/opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:24.328775 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:24.332967 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:24.333945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:24.431025 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:24.431568 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:24.432321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:24.433085 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:24.437063 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:24.437567 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:24.467924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found WWN 33000000037ba25cf for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:12:24.468783 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:24.470574 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== connect_volume: return (3157ms) {'type': 'block', 'scsi_wwn': '33000000037ba25cf', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000037ba25cf'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:24.470889 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000037ba25cf', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000037ba25cf'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:12:24.483244 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:12:24.483975 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:12:24.485541 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:12:24.506551 np0000001589 nova-compute[98297]: WARNING os_brick.encryptors.luks [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 03:12:24.506962 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:12:24.507137 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:12:24.507315 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:12:24.507929 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7e4b405c1df0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '04163091-a678-44e3-9e68-2572090c60c2', 'attached_at': '', 'detached_at': '', 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'serial': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:12:24.508414 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98297) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 03:12:24.544874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.107s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:24.545422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:24.596409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-162ecd63-eb95-45ff-9883-b6499fe921bd req-e9f13ee6-b869-4d8e-baf7-e099601c838d service nova] Releasing lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:24.597245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquired lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:24.597635 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:24.617295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk 1073741824" returned: 0 in 0.072s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:24.617892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:24.618322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:24.645378 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0019592459998420964 future=<Future at 0x7e4b644ec6e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:24.647479 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779937929.6431541, ea253493-a3b6-47bf-808c-9bbf92db52f7 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:24.648467 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:24.648708 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] VM Stopped (Lifecycle Event)
May 28 03:12:24.669567 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c67c05b3-202f-47ca-8f53-cc6d90d29f25 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.515s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:24.736021 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:24.736021 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:12:24.736021 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:24.824483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:24.825577 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Cannot resize image /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:12:24.826697 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:12:24.827005 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Ensure instance console log exists: /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:12:24.827323 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:24.827543 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:24.830219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:24.840058 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:25.085023 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Rescuing
May 28 03:12:25.085187 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:25.085350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:25.085492 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:25.154682 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: ea253493-a3b6-47bf-808c-9bbf92db52f7] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:25.165707 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:25.330380 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:25.474707 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Updating instance_info_cache with network_info: [{"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:25.588054 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:25.891096 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:25.967263 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:25.967524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:25.980665 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Releasing lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:25.980952 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Instance network_info: |[{"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:12:25.982970 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Start _get_guest_xml network_info=[{"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:12:25.986787 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:12:25.988516 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-2065603755', uuid='5536af08-bb5c-4170-9b07-61fac08818b2'), owner=OwnerMeta(userid='fba297a0d43248c883c9b6100d92cae8', username='tempest-AttachVolumeNegativeTest-414697469-project-member', projectid='094dc3cb80814083a18dc5026b895ec5', projectname='tempest-AttachVolumeNegativeTest-414697469'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937945.9877985) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:12:25.989755 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:12:25.990495 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:12:25.991123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:12:25.991356 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:12:25.992668 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:12:25.993033 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:12:25.993208 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:12:25.993349 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:12:25.993502 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:12:25.993625 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:12:25.993769 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:12:25.993983 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:12:25.994218 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:12:25.994387 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:12:25.994489 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:12:25.994605 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:12:26.007759 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2065603755',display_name='tempest-AttachVolumeNegativeTest-server-2065603755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-2065603755',id=55,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcOsOEyXBorfz6k6uq/UvFyOugSXnZE2vI/BaIaJ6o7XtcBqccXWGVKyqaL59fcUz6VLZXrWnx3NX+sPMidAvpOYC7Izy6dcBwHuNQZtHMJAeBx7Sjv5qH6iS8xiFv3Fg==',key_name='tempest-keypair-1437738668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-vyq6bv5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=5536af08-bb5c-4170-9b07-61fac08818b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:12:26.007957 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:26.008529 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:ae:0f,bridge_name='br-int',has_traffic_filtering=True,id=317630c5-3c64-45a5-bf0c-fe46bdb55689,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317630c5-3c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:26.009431 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'pci_devices' on Instance uuid 5536af08-bb5c-4170-9b07-61fac08818b2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:26.040159 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:26.469624 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:12:26.512463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] End _get_guest_xml xml=<domain type="qemu">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <uuid>5536af08-bb5c-4170-9b07-61fac08818b2</uuid>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <name>instance-00000037</name>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2065603755</nova:name>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:12:25</nova:creationTime>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:user uuid="fba297a0d43248c883c9b6100d92cae8">tempest-AttachVolumeNegativeTest-414697469-project-member</nova:user>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:project uuid="094dc3cb80814083a18dc5026b895ec5">tempest-AttachVolumeNegativeTest-414697469</nova:project>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         <nova:port uuid="317630c5-3c64-45a5-bf0c-fe46bdb55689">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <system>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <entry name="serial">5536af08-bb5c-4170-9b07-61fac08818b2</entry>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <entry name="uuid">5536af08-bb5c-4170-9b07-61fac08818b2</entry>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </system>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <os>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   </os>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <features>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   </features>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   <devices>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk.config"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:00:ae:0f"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <target dev="tap317630c5-3c"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </interface>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/console.log" append="off"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </serial>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <video>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </video>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </rng>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:   </devices>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]: </domain>
May 28 03:12:26.512463 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Preparing to wait for external event network-vif-plugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2065603755',display_name='tempest-AttachVolumeNegativeTest-server-2065603755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-2065603755',id=55,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcOsOEyXBorfz6k6uq/UvFyOugSXnZE2vI/BaIaJ6o7XtcBqccXWGVKyqaL59fcUz6VLZXrWnx3NX+sPMidAvpOYC7Izy6dcBwHuNQZtHMJAeBx7Sjv5qH6iS8xiFv3Fg==',key_name='tempest-keypair-1437738668',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-vyq6bv5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=5536af08-bb5c-4170-9b07-61fac08818b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:ae:0f,bridge_name='br-int',has_traffic_filtering=True,id=317630c5-3c64-45a5-bf0c-fe46bdb55689,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317630c5-3c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:26.516079 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:ae:0f,bridge_name='br-int',has_traffic_filtering=True,id=317630c5-3c64-45a5-bf0c-fe46bdb55689,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317630c5-3c') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:12:26.516674 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:26.516674 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:26.517012 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:12:26.520291 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:26.520291 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '590eab5e-0c02-5823-9567-b9cec31d9036', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:26.520291 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:26.522331 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:26.523063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:26.525676 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:26.525948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap317630c5-3c, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:26.526573 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap317630c5-3c, col_values=(('qos', UUID('51006332-1d0f-4554-b896-1345ac474012')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:26.526818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap317630c5-3c, col_values=(('external_ids', {'iface-id': '317630c5-3c64-45a5-bf0c-fe46bdb55689', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:ae:0f', 'vm-uuid': '5536af08-bb5c-4170-9b07-61fac08818b2'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:26.528372 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:26.529722 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:26.533723 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:26.534571 np0000001589 nova-compute[98297]: INFO os_vif [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:ae:0f,bridge_name='br-int',has_traffic_filtering=True,id=317630c5-3c64-45a5-bf0c-fe46bdb55689,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317630c5-3c')
May 28 03:12:26.542030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:27.014331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:27.014555 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:27.018466 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:12:27.018630 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Claim successful on node np0000001589
May 28 03:12:28.058495 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:28.058799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:28.058799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No VIF found with MAC fa:16:3e:00:ae:0f, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:28.059160 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Using config drive
May 28 03:12:28.063812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:28.187057 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:28.201634 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:28.360519 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-73fb4793-2e04-43ed-b256-26d5d3d9a0c8 req-852b6236-5c32-478c-b6e5-0c078ab913c7 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:28.360519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-73fb4793-2e04-43ed-b256-26d5d3d9a0c8 req-852b6236-5c32-478c-b6e5-0c078ab913c7 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:28.360662 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-73fb4793-2e04-43ed-b256-26d5d3d9a0c8 req-852b6236-5c32-478c-b6e5-0c078ab913c7 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:28.362728 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-73fb4793-2e04-43ed-b256-26d5d3d9a0c8 req-852b6236-5c32-478c-b6e5-0c078ab913c7 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:28.362728 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-73fb4793-2e04-43ed-b256-26d5d3d9a0c8 req-852b6236-5c32-478c-b6e5-0c078ab913c7 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:28.362728 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-73fb4793-2e04-43ed-b256-26d5d3d9a0c8 req-852b6236-5c32-478c-b6e5-0c078ab913c7 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state active and task_state rescuing.
May 28 03:12:28.363692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:28.394856 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:28.411843 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:12:28.411843 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:12:28.411843 np0000001589 nova-compute[98297]:     <volume>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</volume>
May 28 03:12:28.411843 np0000001589 nova-compute[98297]:   </usage>
May 28 03:12:28.411843 np0000001589 nova-compute[98297]: </secret>
May 28 03:12:28.411843 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:12:28.430246 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:28.505999 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999635162000232 future=<Future at 0x7e4b406c97c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:28.506731 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998837099999946 future=<Future at 0x7e4b406c97c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:28.507026 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998495455000011 future=<Future at 0x7e4b406c97c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:28.509954 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance destroyed successfully.
May 28 03:12:28.510332 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:28.563986 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:28.698253 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Creating config drive at /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk.config
May 28 03:12:28.700699 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi5lquzf4 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:28.755548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpi5lquzf4" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:28.769832 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:28.770036 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:28.935300 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Attempting to attach volume 9ea570b2-c55c-41ba-8f2d-b4019fa567ff with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:12:28.939364 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:   <alias name="ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff"/>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:   <serial>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</serial>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="3ca6b303-239c-4b4b-a8c9-600c5df2b14f"/>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:28.939364 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:12:29.018428 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Attempting rescue
May 28 03:12:29.019098 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98297) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 28 03:12:29.030781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:12:29.031042 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Creating image(s)
May 28 03:12:29.031945 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:29.032116 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:29.032862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:29.033092 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:29.270000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:29.275908 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:29.305095 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:29.310840 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:29.392363 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:29.534949 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:29.535551 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:29.538180 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:29.539822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:29.540146 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:29.540347 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:29.542749 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:12:29.543013 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:29.637171 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:29.637991 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.rescue {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:29.654029 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:29.674707 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:29.702172 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.rescue" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:29.702913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:29.703206 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'migration_context' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:29.792946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.778s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:29.793413 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:12:30.010561 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937950.010167, 5536af08-bb5c-4170-9b07-61fac08818b2 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:30.010821 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] VM Started (Lifecycle Event)
May 28 03:12:30.206305 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:30.206844 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:12:30.207502 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Start _get_guest_xml network_info=[{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:e0:12:b8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:12:30.207717 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'resources' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:30.299274 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:12:30.300518 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:12:30.301054 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:30.301400 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:30.380139 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ada2cf15d86b4419ab73c67773ff8785', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52ac8d769a2d4b49807632858d7e6423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:12:30.426771 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:30.426939 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:30.427529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:30.427663 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:30.427802 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:30.427937 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state active and task_state rescuing.
May 28 03:12:30.428062 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-vif-plugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:30.428198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:30.428756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:30.428902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:30.429034 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Processing event network-vif-plugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:12:30.429181 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-vif-plugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:30.429352 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:30.429492 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:30.430354 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:12:30.430569 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:30.430687 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] No waiting events found dispatching network-vif-plugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:30.430803 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d20646aa-9df2-464d-b1d5-caa901b4d367 req-77e8fc01-e743-4436-9aa9-5d6632a4f5e9 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received unexpected event network-vif-plugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 for instance with vm_state building and task_state spawning.
May 28 03:12:30.435939 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:12:30.438802 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Instance spawned successfully.
May 28 03:12:30.440565 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:12:30.513257 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:30.515244 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:30.710519 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:30.713648 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:12:30.715527 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-156457100', uuid='1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e'), owner=OwnerMeta(userid='f21fb57a7c104603aa9c06ad57a1ebc8', username='tempest-ServerRescueNegativeTestJSON-1294831380-project-member', projectid='9594031941474707b7b4dbe1e8124dde', projectname='tempest-ServerRescueNegativeTestJSON-1294831380'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:e0:12:b8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937950.7150369) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:12:30.716660 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:12:30.717002 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:12:30.717939 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:12:30.718121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:12:30.719117 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:12:30.719432 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:12:30.719569 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:12:30.719664 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:12:30.719756 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:12:30.719846 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:12:30.720151 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:12:30.720151 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:12:30.720151 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:12:30.720307 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:12:30.720353 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:12:30.720492 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:12:30.720564 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:30.791948 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Successfully created port: d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:12:30.802619 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:12:30.948350 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:30.950214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:30.950214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:30.950214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:30.950214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:30.950214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:31.017581 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:12:31.017826 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937951.0176585, 5536af08-bb5c-4170-9b07-61fac08818b2 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:31.017939 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] VM Paused (Lifecycle Event)
May 28 03:12:31.222255 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:31.233782 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-156457100',display_name='tempest-ServerRescueNegativeTestJSON-server-156457100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-156457100',id=51,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7kD3Q6EZH1F3MDGbGnUsuJRQXycZa80tL/VAcvBthSvvTQiPayA8ZY28K9PY3iV9SgCvY9KtM/k4ckMzkbsBelKLIJccfDKEYc+R8y3bDCNehMq6+tEXjg+MkpvBMLUw==',key_name='tempest-keypair-191609345',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:11:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-02rf1ufk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:11:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:e0:12:b8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:12:31.234306 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "vif_mac": "fa:16:3e:e0:12:b8"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:31.234821 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:31.235534 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:31.309265 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:12:31.351185 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Successfully updated port: d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:12:31.393682 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-changed-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:31.393916 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Refreshing instance network info cache due to event network-changed-d9c84c71-d8ee-4a04-8599-47d4cdf9117e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:31.394135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] Acquiring lock "refresh_cache-fccadcf9-8b40-445a-b36c-3bb3025d3829" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:31.394764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] Acquired lock "refresh_cache-fccadcf9-8b40-445a-b36c-3bb3025d3829" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:31.394938 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Refreshing network info cache for port d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:31.459616 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Took 7.13 seconds to spawn the instance on the hypervisor.
May 28 03:12:31.459929 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:31.520601 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:31.522576 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937951.5223632, 5536af08-bb5c-4170-9b07-61fac08818b2 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:31.522730 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] VM Resumed (Lifecycle Event)
May 28 03:12:31.530345 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:31.688508 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:31.688674 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:31.688798 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:31.688910 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:c7:48:ab, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:31.737139 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:31.738090 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] End _get_guest_xml xml=<domain type="qemu">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <uuid>1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e</uuid>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <name>instance-00000033</name>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-156457100</nova:name>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:12:30</nova:creationTime>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:user uuid="f21fb57a7c104603aa9c06ad57a1ebc8">tempest-ServerRescueNegativeTestJSON-1294831380-project-member</nova:user>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:project uuid="9594031941474707b7b4dbe1e8124dde">tempest-ServerRescueNegativeTestJSON-1294831380</nova:project>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         <nova:port uuid="6e42b07b-f56c-496d-ab17-b2beb99ff194">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <system>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <entry name="serial">1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e</entry>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <entry name="uuid">1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e</entry>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </system>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <os>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   </os>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <features>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   </features>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   <devices>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.rescue"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config.rescue"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:e0:12:b8"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <target dev="tap6e42b07b-f5"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </interface>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/console.log" append="off"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </serial>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <video>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </video>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </rng>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:   </devices>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]: </domain>
May 28 03:12:31.738090 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:12:31.744731 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance destroyed successfully.
May 28 03:12:31.813351 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Booting with volume b3940b9f-d89a-432d-8162-34706f983b2e at /dev/vda
May 28 03:12:31.849935 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:31.853165 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "refresh_cache-fccadcf9-8b40-445a-b36c-3bb3025d3829" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:31.860497 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:12:31.879959 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:31.899777 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:31.930177 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:12:31.930534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:12:31.940876 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:12:31.942578 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fec7:48ab', 'fe80::24e0:96ff:fee5:ac82', 'fe80::fc16:3eff:fed7:d771', 'fe80::fc16:3eff:fe26:b4bc', 'fe80::ac8c:9cff:fe07:8685', 'fe80::fc16:3eff:fe00:ae0f', 'fe80::10ec:c3ff:fe53:b9ec'] 
May 28 03:12:31.942745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:12:31.944375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:12:31.944375 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:31.944375 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Updating existing volume attachment record: 5d445d01-3c06-4654-9bf3-45b9d06283d9 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:12:31.969962 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:31.976256 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Took 13.02 seconds to build instance.
May 28 03:12:32.025753 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:32.029294 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:32.120145 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:32.479393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2030f200-7b12-48f9-b023-bdb343084600 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.531s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:32.623190 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b146a26-35b9-48ce-abc0-cf34966c75ca req-1f429875-2472-446c-a09d-7684932af807 service nova] Releasing lock "refresh_cache-fccadcf9-8b40-445a-b36c-3bb3025d3829" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:32.623799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquired lock "refresh_cache-fccadcf9-8b40-445a-b36c-3bb3025d3829" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:32.623989 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:33.064749 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:33.137968 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:33.138352 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:12:33.192612 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:12:33.249450 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f0fb29f-f76f-4d4d-947f-d95180c17a98 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.699s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:33.263290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:33.263473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:33.263605 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:33.263751 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] No VIF found with MAC fa:16:3e:e0:12:b8, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:33.264335 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Using config drive
May 28 03:12:33.366856 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-changed-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:33.367389 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Refreshing instance network info cache due to event network-changed-317630c5-3c64-45a5-bf0c-fe46bdb55689. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:33.368060 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] Acquiring lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:33.368181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] Acquired lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:33.368307 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Refreshing network info cache for port 317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:33.371033 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:33.533116 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Updating instance_info_cache with network_info: [{"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:33.768282 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'ec2_ids' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:33.877718 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:34.035005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Releasing lock "refresh_cache-fccadcf9-8b40-445a-b36c-3bb3025d3829" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:34.035327 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Instance network_info: |[{"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:12:34.049244 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:12:34.050324 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:12:34.050815 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Creating image(s)
May 28 03:12:34.051105 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:12:34.051221 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Ensure instance console log exists: /opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:12:34.051490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:34.051637 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:34.051783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:34.052201 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Start _get_guest_xml network_info=[{"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '5d445d01-3c06-4654-9bf3-45b9d06283d9', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'fccadcf9-8b40-445a-b36c-3bb3025d3829', 'attached_at': '', 'detached_at': '', 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'serial': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'multiattach': True}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:12:34.056480 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:12:34.057450 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-742430739', uuid='fccadcf9-8b40-445a-b36c-3bb3025d3829'), owner=OwnerMeta(userid='ada2cf15d86b4419ab73c67773ff8785', username='tempest-AttachVolumeMultiAttachTest-1379082653-project-member', projectid='52ac8d769a2d4b49807632858d7e6423', projectname='tempest-AttachVolumeMultiAttachTest-1379082653'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937954.0571256) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:12:34.058474 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:12:34.058812 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:12:34.059776 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:12:34.059917 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:12:34.060867 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:12:34.061120 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:12:34.061248 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:12:34.061349 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:12:34.061452 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:12:34.061532 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:12:34.061680 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:12:34.061764 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:12:34.061850 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:12:34.061947 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:12:34.062040 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:12:34.062155 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:12:34.072014 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:12:34.072348 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:34.072551 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:34.072891 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:34.073064 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:12:34.088468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:34.089013 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:34.089599 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:34.089866 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:34.090185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:34.090387 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:34.103673 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:34.103673 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:34.108787 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:34.108787 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:34.115671 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e] added
May 28 03:12:34.115671 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:34.115671 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:34.115671 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:34.115671 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:34.115671 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:34.115671 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:34.115967 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:34.116120 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:34.116330 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:34.122165 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e] added
May 28 03:12:34.122165 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:34.122165 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:34.122165 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:34.122165 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:34.122165 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:34.122165 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:34.122451 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:34.122551 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:34.122721 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:34.186646 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:34.271534 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:34.271646 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'keypairs' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:34.302011 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Updated VIF entry in instance network info cache for port 317630c5-3c64-45a5-bf0c-fe46bdb55689. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:12:34.302238 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Updating instance_info_cache with network_info: [{"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:34.774486 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:34.778395 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:34.803999 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa43f1ec-fe3b-4a2d-9e6d-d169c795e5fe req-e330a034-a6a1-4fda-bd1b-13cfef8feaf0 service nova] Releasing lock "refresh_cache-5536af08-bb5c-4170-9b07-61fac08818b2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:34.827433 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Stashing vm_state: active {{(pid=98297) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 28 03:12:34.913498 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Creating config drive at /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config.rescue
May 28 03:12:34.919448 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdgdcgvc4 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:34.978289 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpdgdcgvc4" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:35.118821 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:35.124808 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:35.132322 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:35.132322 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:35.144278 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:35.144278 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.149701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.156044 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.164381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.164381 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.164381 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.164381 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.164381 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.164381 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.164381 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:35.164643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.164643 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.164643 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.164643 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.164643 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.164643 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.164643 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:35.170990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.170990 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.170990 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.170990 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.170990 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.170990 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.170990 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:35.171188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.171188 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.171188 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.171188 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.171188 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.171188 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.171188 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:35.219666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.50.100,3260]
May 28 03:12:35.219666 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.50.100,3260] successful.
May 28 03:12:35.219666 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.230779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.40.100,3260]
May 28 03:12:35.230779 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.40.100,3260] successful.
May 28 03:12:35.230779 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.235054 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.242817 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.252582 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.252853 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:35.253178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:35.256416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:35.257357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('11', '-', '-', 0) found on session 138 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:35.257477 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.262204 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:35.262440 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:35.262744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:35.262863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:35.263670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] HCTL ('14', '-', '-', 0) found on session 139 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:35.263790 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:35.272380 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 138 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:35.272483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:35.284514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Searching for a device in session 139 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:35.284729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:35.399776 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:35.399909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:35.435145 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:35.463202 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:35.467416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:35.557193 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:35.632682 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d311dca7-dd8f-43a5-ab36-87386aade9a6 req-20b274ba-8aae-4389-9148-ad3ae2bf4776 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:35.637908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d311dca7-dd8f-43a5-ab36-87386aade9a6 req-20b274ba-8aae-4389-9148-ad3ae2bf4776 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:35.638062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d311dca7-dd8f-43a5-ab36-87386aade9a6 req-20b274ba-8aae-4389-9148-ad3ae2bf4776 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:35.638181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d311dca7-dd8f-43a5-ab36-87386aade9a6 req-20b274ba-8aae-4389-9148-ad3ae2bf4776 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:35.638344 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d311dca7-dd8f-43a5-ab36-87386aade9a6 req-20b274ba-8aae-4389-9148-ad3ae2bf4776 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:35.638448 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d311dca7-dd8f-43a5-ab36-87386aade9a6 req-20b274ba-8aae-4389-9148-ad3ae2bf4776 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state active and task_state rescuing.
May 28 03:12:35.638626 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:35.908596 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:12:35.909052 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Claim successful on node np0000001589
May 28 03:12:36.090585 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:12:36.237099 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e due to new event <LifecycleEvent: 1779937956.2367315, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:12:36.238958 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937956.2367315, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:36.239073 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Resumed (Lifecycle Event)
May 28 03:12:36.243012 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-75342927-7054-419e-8510-7d09a6d33587 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:36.413364 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating resource usage from migration 57f2616a-e96f-4205-be8e-598a4b27b7d7
May 28 03:12:36.531839 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:36.743314 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:36.749896 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:37.110508 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Found WWN 330000000be132bce for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:12:37.110896 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:37.114245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '330000000be132bce', 'path': '/dev/dm-2', 'multipath_id': '330000000be132bce'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:37.114245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000be132bce', 'path': '/dev/dm-2', 'multipath_id': '330000000be132bce'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:12:37.129031 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:37.129360 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:37.138280 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:37.138691 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:12:37.141184 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:37.253196 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937957.252767, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:37.253416 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Started (Lifecycle Event)
May 28 03:12:37.618567 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-742430739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumemultiattachtest-server-742430739',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-w7beh8wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:31Z,user_data=None,user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=fccadcf9-8b40-445a-b36c-3bb3025d3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:12:37.618813 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:37.619497 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:08:09,bridge_name='br-int',has_traffic_filtering=True,id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c84c71-d8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:37.620265 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'pci_devices' on Instance uuid fccadcf9-8b40-445a-b36c-3bb3025d3829 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:37.632077 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:37.646369 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:37.691409 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6496790a-666d-4d4b-b806-824c0fd5aa73 req-0e766ee8-3059-4d3c-9d87-a5c9a2465e04 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:37.691881 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6496790a-666d-4d4b-b806-824c0fd5aa73 req-0e766ee8-3059-4d3c-9d87-a5c9a2465e04 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:37.692046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6496790a-666d-4d4b-b806-824c0fd5aa73 req-0e766ee8-3059-4d3c-9d87-a5c9a2465e04 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:37.692162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6496790a-666d-4d4b-b806-824c0fd5aa73 req-0e766ee8-3059-4d3c-9d87-a5c9a2465e04 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:37.692334 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6496790a-666d-4d4b-b806-824c0fd5aa73 req-0e766ee8-3059-4d3c-9d87-a5c9a2465e04 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:37.692516 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6496790a-666d-4d4b-b806-824c0fd5aa73 req-0e766ee8-3059-4d3c-9d87-a5c9a2465e04 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state rescued and task_state unrescuing.
May 28 03:12:37.738316 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Unrescuing
May 28 03:12:37.738519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:37.738647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquired lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:37.738810 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:37.759202 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:37.760988 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:38.066712 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:38.122826 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] End _get_guest_xml xml=<domain type="qemu">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <uuid>fccadcf9-8b40-445a-b36c-3bb3025d3829</uuid>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <name>instance-00000038</name>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-742430739</nova:name>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:12:34</nova:creationTime>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:user uuid="ada2cf15d86b4419ab73c67773ff8785">tempest-AttachVolumeMultiAttachTest-1379082653-project-member</nova:user>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:project uuid="52ac8d769a2d4b49807632858d7e6423">tempest-AttachVolumeMultiAttachTest-1379082653</nova:project>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         <nova:port uuid="d9c84c71-d8ee-4a04-8599-47d4cdf9117e">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <system>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <entry name="serial">fccadcf9-8b40-445a-b36c-3bb3025d3829</entry>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <entry name="uuid">fccadcf9-8b40-445a-b36c-3bb3025d3829</entry>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </system>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <os>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   </os>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <features>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   </features>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   <devices>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829/disk.config"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <alias name="ua-b3940b9f-d89a-432d-8162-34706f983b2e"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-2"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <serial>b3940b9f-d89a-432d-8162-34706f983b2e</serial>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <shareable/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:2c:08:09"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <target dev="tapd9c84c71-d8"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </interface>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829/console.log" append="off"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </serial>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <video>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </video>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </rng>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:   </devices>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]: </domain>
May 28 03:12:38.122826 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Preparing to wait for external event network-vif-plugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-742430739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumemultiattachtest-server-742430739',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-w7beh8wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:31Z,user_data=None,user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=fccadcf9-8b40-445a-b36c-3bb3025d3829,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:08:09,bridge_name='br-int',has_traffic_filtering=True,id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c84c71-d8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:38.124906 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:08:09,bridge_name='br-int',has_traffic_filtering=True,id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c84c71-d8') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:12:38.125358 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:38.125699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:38.125990 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:12:38.127018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:38.127208 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e0b586b-e4cb-5236-9a5e-96ba0b75a73a', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:38.128160 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:38.129009 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:38.131041 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:38.131207 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9c84c71-d8, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:38.131616 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9c84c71-d8, col_values=(('qos', UUID('a22b93e8-4682-4217-a8d9-70b9fdaf6f52')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:38.131845 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9c84c71-d8, col_values=(('external_ids', {'iface-id': 'd9c84c71-d8ee-4a04-8599-47d4cdf9117e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:08:09', 'vm-uuid': 'fccadcf9-8b40-445a-b36c-3bb3025d3829'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:38.132712 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:38.134329 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:38.138100 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:38.139860 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.740s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:38.140456 np0000001589 nova-compute[98297]: INFO os_vif [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:08:09,bridge_name='br-int',has_traffic_filtering=True,id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c84c71-d8')
May 28 03:12:38.140875 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.494s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:38.141123 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Migrating
May 28 03:12:38.141425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:38.141661 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:12:38.146543 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:12:38.240991 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:38.263948 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 28 03:12:38.556817 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:38.663916 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:38.663916 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:38.663916 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:38.692114 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:39.168406 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:39.194458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Releasing lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:39.194949 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'flavor' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:39.221197 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:39.319746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:39.319746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:39.410324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:39.414080 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:39.503769 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:39.505939 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:39.506410 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:39.626942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:39.634350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:39.666279 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:39.684109 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:39.684350 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:39.684528 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] No VIF found with MAC fa:16:3e:2c:08:09, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:39.685494 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Using config drive
May 28 03:12:39.745321 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:39.748121 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:39.757185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:39.757709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:39.778659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:39.868512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:39.877620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:39.925054 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5ee4b036-b987-4136-a01b-387d4335f12f req-c6c5ed66-bf03-45f4-90f7-8bcc2c9ad739 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:39.926115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ee4b036-b987-4136-a01b-387d4335f12f req-c6c5ed66-bf03-45f4-90f7-8bcc2c9ad739 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:39.926529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ee4b036-b987-4136-a01b-387d4335f12f req-c6c5ed66-bf03-45f4-90f7-8bcc2c9ad739 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:39.926753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5ee4b036-b987-4136-a01b-387d4335f12f req-c6c5ed66-bf03-45f4-90f7-8bcc2c9ad739 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:39.926967 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5ee4b036-b987-4136-a01b-387d4335f12f req-c6c5ed66-bf03-45f4-90f7-8bcc2c9ad739 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:39.927967 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-5ee4b036-b987-4136-a01b-387d4335f12f req-c6c5ed66-bf03-45f4-90f7-8bcc2c9ad739 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state rescued and task_state unrescuing.
May 28 03:12:39.931365 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:39.942087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:40.002745 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.002891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.041270 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998620027000015 future=<Future at 0x7e4b407dfcb0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:40.048075 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance destroyed successfully.
May 28 03:12:40.048677 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'numa_topology' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:40.102159 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.104524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.174253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:40.192915 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:40.196373 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.196939 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.299642 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.304074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.353220 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Creating config drive at /opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829/disk.config
May 28 03:12:40.357503 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3bpm6lql {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.400981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.401802 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.420729 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3bpm6lql" returned: 0 in 0.062s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.502582 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.505469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.552413 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Object Instance<1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:12:40.595726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.595726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.682123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.690494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.808907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.811875 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:40.912283 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:40.912830 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:12:40.920708 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:12:40.924292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.017618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:41.018267 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.116667 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk.rescue --force-share --output=json" returned: 0 in 0.098s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:41.117316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.194977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.221449 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:41.222005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.247997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.311349 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.346084 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.351007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:41.351613 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.400151 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14a3f84c-ae9f-4d15-aa6b-416b4957fe56 req-a3c7601c-4683-495d-9131-f00c804c4fd5 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-vif-plugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:41.400628 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14a3f84c-ae9f-4d15-aa6b-416b4957fe56 req-a3c7601c-4683-495d-9131-f00c804c4fd5 service nova] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:41.402069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14a3f84c-ae9f-4d15-aa6b-416b4957fe56 req-a3c7601c-4683-495d-9131-f00c804c4fd5 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:41.402069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14a3f84c-ae9f-4d15-aa6b-416b4957fe56 req-a3c7601c-4683-495d-9131-f00c804c4fd5 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:41.402782 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14a3f84c-ae9f-4d15-aa6b-416b4957fe56 req-a3c7601c-4683-495d-9131-f00c804c4fd5 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Processing event network-vif-plugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:12:41.411491 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.438902 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.549090 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.610380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.622384 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.694982 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Starting migrate_disk_and_power_off {{(pid=98297) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 28 03:12:41.723892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.729749 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.735725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:41.735725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.752420 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.777995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.779689 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:41.836900 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:41.837590 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:12:41.843292 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:12:41.845383 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.931210 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-39d69722-051f-4b42-8c08-f92a7f68fce7 req-43df282b-e5d2-40c1-924e-bd80243cbf18 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:41.931600 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-39d69722-051f-4b42-8c08-f92a7f68fce7 req-43df282b-e5d2-40c1-924e-bd80243cbf18 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:41.932620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-39d69722-051f-4b42-8c08-f92a7f68fce7 req-43df282b-e5d2-40c1-924e-bd80243cbf18 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:41.932620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-39d69722-051f-4b42-8c08-f92a7f68fce7 req-43df282b-e5d2-40c1-924e-bd80243cbf18 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:41.932620 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-39d69722-051f-4b42-8c08-f92a7f68fce7 req-43df282b-e5d2-40c1-924e-bd80243cbf18 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:41.932620 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-39d69722-051f-4b42-8c08-f92a7f68fce7 req-43df282b-e5d2-40c1-924e-bd80243cbf18 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state active and task_state resize_migrating.
May 28 03:12:41.959774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:41.960393 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:41.999639 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:42.000049 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:42.001072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:42.001072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:42.001072 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:42.001072 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state rescued and task_state unrescuing.
May 28 03:12:42.001072 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:42.001441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:42.001441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:42.001441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:42.001545 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:42.001725 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state rescued and task_state unrescuing.
May 28 03:12:42.001805 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:42.002816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:42.002816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:42.002816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:42.002816 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:42.002816 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-5dd0e187-5735-493c-844e-9eec494433c8 req-c54b202f-6b54-4837-bd58-17a029ffd594 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received unexpected event network-vif-plugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with vm_state rescued and task_state unrescuing.
May 28 03:12:42.086068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.094071 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.106279 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998675781000202 future=<Future at 0x7e4b78145a30 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:42.114795 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance destroyed successfully.
May 28 03:12:42.118401 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:11:53Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:12:42.118790 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:42.120099 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:42.120576 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:12:42.125997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:42.125997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84be116e-1e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:42.129681 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:42.131541 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:42.132742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:42.133046 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82f2f5f8-1e16-4c9e-b748-cbd3ceb223c3) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:42.135647 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:42.138017 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:42.141346 np0000001589 nova-compute[98297]: INFO os_vif [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e')
May 28 03:12:42.145565 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:12:42.146049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:42.146218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:42.147131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:42.147388 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:12:42.147584 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:42.181608 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: tcp: [136] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: tcp: [137] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:42.181938 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:42.181938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '136'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:12:42.182144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '136')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:42.185485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '137')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:42.187992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646ca660>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:12:42.189628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:12:42.189942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flush multipath device 33000000037ba25cf {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:12:42.224416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.227747 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.241674 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:42.291571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:42.346723 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:12:42.346963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:12:42.348507 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:12:42.361086 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.367667 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:12:42.368310 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:12:42.369599 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:12:42.369947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.386696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:42.414367 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:12:42.416812 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e9aa96d-5450-49b3-bd69-d52b5e9c22de tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:42.417861 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e due to new event <LifecycleEvent: 1779937962.4171538, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:12:42.418201 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937962.4171538, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:42.418386 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Resumed (Lifecycle Event)
May 28 03:12:42.433902 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260]
May 28 03:12:42.433902 np0000001589 nova-compute[98297]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260] successful.
May 28 03:12:42.433902 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:42.435570 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:12:42.442121 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.066s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.443527 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=9830MB free_disk=73.41690826416016GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:12:42.443704 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:42.448279 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:42.448715 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Instance spawned successfully.
May 28 03:12:42.449069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:12:42.457719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:42.475242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:42.516345 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 137, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260]
May 28 03:12:42.516345 np0000001589 nova-compute[98297]: Logout of [sid: 137, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260] successful.
May 28 03:12:42.516345 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:42.538630 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:42.541021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:42.541021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== disconnect_volume: return (393ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:42.541021 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:12:42.544633 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.649649 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.650508 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.750927 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.754247 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:12:42.754247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_resize/disk /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.861337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "cp -r /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_resize/disk /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.862017 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_resize/disk.config /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.910187 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "cp -r /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_resize/disk.config /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.910822 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_resize/disk.info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:42.945544 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:42.965098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "cp -r /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_resize/disk.info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:42.968770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:42.972719 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:42.972991 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:42.973372 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:42.973689 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:42.975316 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:42.975580 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:12:43.071748 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:43.466844 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Applying migration context for instance 04163091-a678-44e3-9e68-2572090c60c2 as it has an incoming, in-progress migration 57f2616a-e96f-4205-be8e-598a4b27b7d7. Migration status is migrating {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 28 03:12:43.468531 np0000001589 nova-compute[98297]: INFO nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating resource usage from migration 57f2616a-e96f-4205-be8e-598a4b27b7d7
May 28 03:12:43.479985 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8a38ddfd-4f65-4123-af2a-4fe6fadd0560 req-8caeb19b-775c-47f8-aa5b-3a424f81b147 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-vif-plugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:43.482242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8a38ddfd-4f65-4123-af2a-4fe6fadd0560 req-8caeb19b-775c-47f8-aa5b-3a424f81b147 service nova] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:43.482242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8a38ddfd-4f65-4123-af2a-4fe6fadd0560 req-8caeb19b-775c-47f8-aa5b-3a424f81b147 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:43.482242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8a38ddfd-4f65-4123-af2a-4fe6fadd0560 req-8caeb19b-775c-47f8-aa5b-3a424f81b147 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:43.482242 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8a38ddfd-4f65-4123-af2a-4fe6fadd0560 req-8caeb19b-775c-47f8-aa5b-3a424f81b147 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] No waiting events found dispatching network-vif-plugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:43.482242 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-8a38ddfd-4f65-4123-af2a-4fe6fadd0560 req-8caeb19b-775c-47f8-aa5b-3a424f81b147 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received unexpected event network-vif-plugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e for instance with vm_state building and task_state spawning.
May 28 03:12:43.482558 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Took 9.43 seconds to spawn the instance on the hypervisor.
May 28 03:12:43.482558 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:43.483609 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937963.4833822, fccadcf9-8b40-445a-b36c-3bb3025d3829 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:43.483983 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] VM Started (Lifecycle Event)
May 28 03:12:43.506016 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00040456199985783314 future=<Future at 0x7e4b406c97c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:43.506119 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:43.506180 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.533567421000043 future=<Future at 0x7e4b407dfcb0 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:43.506326 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.533492701999876 future=<Future at 0x7e4b407dfcb0 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:43.506393 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:43.506430 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=13.598296948000097 future=<Future at 0x7e4b78145a30 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:43.506587 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=13.598221638000268 future=<Future at 0x7e4b78145a30 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:43.528422 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.528736 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.528736 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.528799 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.528835 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 5683aa74-b79d-4dbf-9a99-796cbff0c04d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.530457 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 4811783e-66bd-4c41-8a99-e73bc6c22369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.531513 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.531513 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3b73e16-989c-483c-866f-4e179edfbeef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.531513 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.531513 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 4fabe539-c171-4d50-a5b4-64ee77668e8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.531513 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.532397 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 5536af08-bb5c-4170-9b07-61fac08818b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.532713 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance fccadcf9-8b40-445a-b36c-3bb3025d3829 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.532857 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Migration 57f2616a-e96f-4205-be8e-598a4b27b7d7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 28 03:12:43.533001 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 04163091-a678-44e3-9e68-2572090c60c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:12:43.533317 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:12:43.533475 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=3520MB phys_disk=95GB used_disk=13GB total_vcpus=12 used_vcpus=15 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:12:42 up 40 min,  2 users,  load average: 6.95, 7.01, 4.76\n', 'num_instances': '14', 'num_vm_active': '11', 'num_task_None': '11', 'num_os_type_None': '14', 'num_proj_52ac8d769a2d4b49807632858d7e6423': '6', 'io_workload': '2', 'num_proj_9594031941474707b7b4dbe1e8124dde': '3', 'num_vm_rescued': '2', 'num_proj_367ea52eb22f43adb2cd01467b3473ae': '2', 'num_task_unrescuing': '1', 'num_task_resize_migrating': '1', 'num_proj_0eee8d500ee84b5f86e297c2660e183b': '1', 'num_proj_f79d7d10d3654992aab71cc666e52080': '1', 'num_proj_094dc3cb80814083a18dc5026b895ec5': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:12:43.992596 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:43.997585 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:43.999249 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Took 17.03 seconds to build instance.
May 28 03:12:44.030408 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d662df8e-223c-477a-a980-c4687213eee9 req-3d1fb2cd-4ec3-49d0-a7cc-4e5749eeaed0 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:44.030600 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d662df8e-223c-477a-a980-c4687213eee9 req-3d1fb2cd-4ec3-49d0-a7cc-4e5749eeaed0 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:44.030761 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d662df8e-223c-477a-a980-c4687213eee9 req-3d1fb2cd-4ec3-49d0-a7cc-4e5749eeaed0 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:44.030895 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d662df8e-223c-477a-a980-c4687213eee9 req-3d1fb2cd-4ec3-49d0-a7cc-4e5749eeaed0 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:44.031011 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d662df8e-223c-477a-a980-c4687213eee9 req-3d1fb2cd-4ec3-49d0-a7cc-4e5749eeaed0 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:44.031116 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d662df8e-223c-477a-a980-c4687213eee9 req-3d1fb2cd-4ec3-49d0-a7cc-4e5749eeaed0 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state active and task_state resize_migrating.
May 28 03:12:44.132907 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:44.133970 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:44.202053 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Port 84be116e-1e2a-45c8-aec8-8b6a1aac2998 binding to destination host np0000001589 is already ACTIVE {{(pid=98297) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 03:12:44.273788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:44.274012 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:44.408333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:44.408333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing instance network info cache due to event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:44.408333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] Acquiring lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:44.408333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] Acquired lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:44.408333 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:44.500731 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937964.5004048, fccadcf9-8b40-445a-b36c-3bb3025d3829 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:44.501143 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] VM Paused (Lifecycle Event)
May 28 03:12:44.503403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.534s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:44.776953 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:44.909893 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:45.005036 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:45.007814 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937965.007579, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:45.007932 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Started (Lifecycle Event)
May 28 03:12:45.210067 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:12:45.220005 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:45.224065 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:45.224809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:45.224972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:45.287041 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:12:45.287862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.844s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:45.291129 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:45.291387 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 03:12:45.346496 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updated VIF entry in instance network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:12:45.346764 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:45.511387 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:45.514683 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:45.798351 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] There are 0 instances to clean {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 03:12:45.798626 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:45.798815 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98297) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 03:12:45.848661 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b438462f-3f48-4106-a49c-eb65c1985e1b req-cab71288-7bd3-4630-b507-87266379c6e2 service nova] Releasing lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:46.017741 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937966.0174468, fccadcf9-8b40-445a-b36c-3bb3025d3829 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:46.017889 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] VM Resumed (Lifecycle Event)
May 28 03:12:46.235481 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:46.297857 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:46.297979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:46.298134 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:12:46.302627 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:46.487474 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:46.487678 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing instance network info cache due to event network-changed-6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:12:46.489605 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] Acquiring lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:12:46.489605 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] Acquired lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:12:46.489605 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Refreshing network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:12:46.522647 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:46.526094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:46.801396 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:46.808249 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:12:46.991391 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:47.145541 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:47.169840 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:47.320124 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:47.415950 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:47.541243 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updated VIF entry in instance network info cache for port 6e42b07b-f56c-496d-ab17-b2beb99ff194. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:12:47.541611 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [{"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:47.804093 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:47.805240 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:47.805678 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:47.806052 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:47.806572 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:12:47.806947 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.33 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:12:47.823089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:48.043239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd00c791-9716-4726-9b56-f7516a32ced9 req-ea09cd64-5416-472c-90a0-c5a28341f982 service nova] Releasing lock "refresh_cache-1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:12:48.072426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:48.200572 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:48.200740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:48.200923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:48.201058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:48.201167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:48.202950 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Terminating instance
May 28 03:12:48.334372 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:48.345926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:12:48.366143 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:48.416041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:12:48.416678 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:12:48.427070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:12:48.429558 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fed7:d771', 'fe80::fc16:3eff:fe26:b4bc', 'fe80::ac8c:9cff:fe07:8685', 'fe80::fc16:3eff:fe00:ae0f', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fe2c:809', 'fe80::fc16:3eff:fee0:12b8'] 
May 28 03:12:48.429779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:12:48.429981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:12:48.430454 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:48.706493 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:12:48.735648 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:48.736832 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:48.756480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:48.900589 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cd63523c-7ffc-4d62-b133-c92ef0a3ea4b req-051ca6cc-174a-49d4-8a69-2236243e0963 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-vif-unplugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:48.900816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd63523c-7ffc-4d62-b133-c92ef0a3ea4b req-051ca6cc-174a-49d4-8a69-2236243e0963 service nova] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:48.900990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd63523c-7ffc-4d62-b133-c92ef0a3ea4b req-051ca6cc-174a-49d4-8a69-2236243e0963 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:48.901162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd63523c-7ffc-4d62-b133-c92ef0a3ea4b req-051ca6cc-174a-49d4-8a69-2236243e0963 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:48.901256 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cd63523c-7ffc-4d62-b133-c92ef0a3ea4b req-051ca6cc-174a-49d4-8a69-2236243e0963 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] No waiting events found dispatching network-vif-unplugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:48.903215 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cd63523c-7ffc-4d62-b133-c92ef0a3ea4b req-051ca6cc-174a-49d4-8a69-2236243e0963 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-vif-unplugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:12:48.921430 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:48.927216 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.009343 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.018344 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.034104 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999651963999895 future=<Future at 0x7e4b40514ef0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:49.035153 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Instance destroyed successfully.
May 28 03:12:49.040594 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'resources' on Instance uuid fccadcf9-8b40-445a-b36c-3bb3025d3829 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:49.194474 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:49.194651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:49.545478 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-742430739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumemultiattachtest-server-742430739',id=56,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:43Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-w7beh8wn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:12:44Z,user_data=None,user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=fccadcf9-8b40-445a-b36c-3bb3025d3829,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:12:49.545702 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "address": "fa:16:3e:2c:08:09", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9c84c71-d8", "ovs_interfaceid": "d9c84c71-d8ee-4a04-8599-47d4cdf9117e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:49.546317 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:08:09,bridge_name='br-int',has_traffic_filtering=True,id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c84c71-d8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:49.546546 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:08:09,bridge_name='br-int',has_traffic_filtering=True,id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c84c71-d8') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:12:49.547820 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.548007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9c84c71-d8, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:49.549048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.550101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:49.550668 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.551549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.551685 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a22b93e8-4682-4217-a8d9-70b9fdaf6f52) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:49.552154 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.552549 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:49.553189 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:49.556979 np0000001589 nova-compute[98297]: INFO os_vif [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:08:09,bridge_name='br-int',has_traffic_filtering=True,id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9c84c71-d8')
May 28 03:12:49.562872 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Starting finish_migration {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 28 03:12:49.563957 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance directory exists: not creating {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 28 03:12:49.564056 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Creating image(s)
May 28 03:12:49.565974 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:49.619508 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:12:49.619830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:49.619978 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:49.620421 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:49.620711 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b3940b9f-d89a-432d-8162-34706f983b2e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:12:49.620848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:12:49.644642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:49.644642 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:49.644642 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:49.644642 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:49.644642 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:49.644642 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:49.644642 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:49.644951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:49.644951 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:49.644951 np0000001589 nova-compute[98297]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:49.644951 np0000001589 nova-compute[98297]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e (non-flash)
May 28 03:12:49.644951 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:49.644951 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:49.644951 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:49.644951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', '139'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:12:49.645248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', '139')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:49.646120 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e', '138')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:12:49.646851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4051d080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:12:49.647087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Removing multipathed devices sdf, sdi {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:12:49.647348 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flush multipath device 330000000be132bce {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:12:49.656930 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:49.657280 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:12:49.657483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:49.700740 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'flavor' on Instance uuid 4fabe539-c171-4d50-a5b4-64ee77668e8a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:49.704748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:49.742692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:12:49.753243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:49.753659 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Cannot resize image /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:12:49.781934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:12:49.782140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:12:49.783434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if device paths {'sdf', 'sdi'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:12:49.794711 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Device paths {'sdf', 'sdi'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:12:49.795002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:12:49.806783 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:49.839026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.40.100,3260]
May 28 03:12:49.839026 np0000001589 nova-compute[98297]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.40.100,3260] successful.
May 28 03:12:49.839026 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:49.852944 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:49.863946 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:49.890394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 138, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.50.100,3260]
May 28 03:12:49.890394 np0000001589 nova-compute[98297]: Logout of [sid: 138, target: iqn.2023-03.storpool.com:os--volume-b3940b9f-d89a-432d-8162-34706f983b2e, portal: 192.168.50.100,3260] successful.
May 28 03:12:49.890394 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:49.904691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:49.905093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:49.905298 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== disconnect_volume: return (285ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:49.905486 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:12:49.905855 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Deleting instance files /opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829_del
May 28 03:12:49.906455 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Deletion of /opt/stack/data/nova/instances/fccadcf9-8b40-445a-b36c-3bb3025d3829_del complete
May 28 03:12:50.257643 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:12:50.257791 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Ensure instance console log exists: /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:12:50.258115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:50.258335 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:50.258453 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:50.260912 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Start _get_guest_xml network_info=[{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '774588ae-fdd0-449f-bf99-fb61737acce7', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '04163091-a678-44e3-9e68-2572090c60c2', 'attached_at': '2026-05-28T03:12:48.000000', 'detached_at': '', 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'serial': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:12:50.265021 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:12:50.266239 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-872502143', uuid='04163091-a678-44e3-9e68-2572090c60c2'), owner=OwnerMeta(userid='2d927d6b89cf4f0c96580968ea9c3791', username='tempest-TestEncryptedCinderVolumes-781621704-project-member', projectid='0eee8d500ee84b5f86e297c2660e183b', projectname='tempest-TestEncryptedCinderVolumes-781621704'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='tempest-1446704530', flavorid='736c1771-ec4f-45d3-8d1c-1bfc9f1472f1', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={}, swap=0), network_info=[{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937970.2658892) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:12:50.267409 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:12:50.267782 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:12:50.268661 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:12:50.268813 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:12:50.269690 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:12:50.269959 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T03:12:33Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={},flavorid='736c1771-ec4f-45d3-8d1c-1bfc9f1472f1',id=13,is_public=True,memory_mb=192,name='tempest-1446704530',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:12:50.270104 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:12:50.270192 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:12:50.270308 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:12:50.270391 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:12:50.270516 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:12:50.270680 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:12:50.270784 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:12:50.270932 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:12:50.271017 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:12:50.271134 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:12:50.281749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:50.368874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:12:50.369331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:50.369589 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:50.370172 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:50.370577 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:12:50.370965 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:50.371122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:50.371460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:50.371680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:12:50.384209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:50.384878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:50.385323 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:50.385542 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:50.385923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:50.386113 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:50.398014 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:50.398014 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:50.402204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:50.402204 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:50.409449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff] added
May 28 03:12:50.409449 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:50.409449 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:50.409449 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:50.409449 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:50.409449 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:50.409449 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:50.409736 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:50.409881 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0242(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:50.409966 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:50.414112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff] added
May 28 03:12:50.414112 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:50.414112 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:50.414112 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:50.414112 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:50.414112 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:50.414112 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:50.414499 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:50.414499 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:50.414784 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:50.415724 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Took 1.71 seconds to destroy the instance on the hypervisor.
May 28 03:12:50.416372 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:12:50.416663 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:12:50.416760 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:12:50.417174 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:50.483496 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:12:50.708912 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:50.775517 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-08c44f6c-3cf6-41e2-a650-1ef411ba1578 req-7efcc3c8-d904-4c6a-8e3b-47a26cf55fd8 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-vif-deleted-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:50.775998 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-08c44f6c-3cf6-41e2-a650-1ef411ba1578 req-7efcc3c8-d904-4c6a-8e3b-47a26cf55fd8 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Neutron deleted interface d9c84c71-d8ee-4a04-8599-47d4cdf9117e; detaching it from the instance and deleting it from the info cache
May 28 03:12:50.777372 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-08c44f6c-3cf6-41e2-a650-1ef411ba1578 req-7efcc3c8-d904-4c6a-8e3b-47a26cf55fd8 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Detach interface failed, port_id=d9c84c71-d8ee-4a04-8599-47d4cdf9117e, reason: Instance fccadcf9-8b40-445a-b36c-3bb3025d3829 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:12:50.955781 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1a60dd9c-522a-44b1-ae61-789ddb39be22 req-a862a627-3b77-4ec6-b06a-24fdb69bd787 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-vif-unplugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:50.956073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1a60dd9c-522a-44b1-ae61-789ddb39be22 req-a862a627-3b77-4ec6-b06a-24fdb69bd787 service nova] Acquiring lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:50.959089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1a60dd9c-522a-44b1-ae61-789ddb39be22 req-a862a627-3b77-4ec6-b06a-24fdb69bd787 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:50.959089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1a60dd9c-522a-44b1-ae61-789ddb39be22 req-a862a627-3b77-4ec6-b06a-24fdb69bd787 service nova] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:50.959089 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1a60dd9c-522a-44b1-ae61-789ddb39be22 req-a862a627-3b77-4ec6-b06a-24fdb69bd787 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] No waiting events found dispatching network-vif-unplugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:50.959089 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1a60dd9c-522a-44b1-ae61-789ddb39be22 req-a862a627-3b77-4ec6-b06a-24fdb69bd787 service nova] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Received event network-vif-unplugged-d9c84c71-d8ee-4a04-8599-47d4cdf9117e for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:12:51.230043 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:12:51.410421 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:51.416818 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:51.424434 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:51.424434 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:51.431996 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:51.431996 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.437397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.447315 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.454337 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.454337 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.454337 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.454337 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.454337 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:51.454638 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.454638 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.454638 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.454638 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.454638 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:51.461017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.461017 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.461017 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.461017 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.461017 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:51.461252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.461252 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.461252 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.461252 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.461252 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:51.491361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260]
May 28 03:12:51.491361 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260] successful.
May 28 03:12:51.491361 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.503844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.514662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260]
May 28 03:12:51.514662 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260] successful.
May 28 03:12:51.514662 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.521465 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.521465 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.521465 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.521465 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.521465 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.521465 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.521465 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:51.521686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.521686 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.521686 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.521686 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.521686 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.521686 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.521686 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:51.521850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:51.521939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:51.522654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('9', '-', '-', 0) found on session 140 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:51.522758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:51.527807 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:51.537241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 140 and hctl ['9', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:51.544649 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.544649 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.544649 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.544649 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.544649 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.544649 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.544649 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:51.544960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.544960 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:51.544960 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.544960 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:51.544960 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.544960 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:51.544960 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:51.544960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:51.545173 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:51.545764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('10', '-', '-', 0) found on session 141 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:51.545841 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:51.559660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 141 and hctl ['10', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:51.731740 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Took 1.31 seconds to deallocate network for instance.
May 28 03:12:51.795799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:51.795799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:51.795799 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Attaching volume bb006ae2-4d16-4f84-9976-d00992eeaf32 to /dev/vdb
May 28 03:12:51.828711 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:51.839933 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:12:51.859259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:51.911596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:12:51.912558 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:12:51.923552 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:12:51.923552 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fed7:d771', 'fe80::fc16:3eff:fe26:b4bc', 'fe80::ac8c:9cff:fe07:8685', 'fe80::fc16:3eff:fe00:ae0f', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fee0:12b8'] 
May 28 03:12:51.923552 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:12:51.924145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:12:51.924478 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:51.924850 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updating existing volume attachment record: 62bd9f17-0678-4e3b-9e35-31ed1ce8d3e6 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:12:52.274345 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:12:52.478963 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:12:52.480134 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb006ae2-4d16-4f84-9976-d00992eeaf32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:52.480351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:52.538189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 140 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:52.538437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:52.560424 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 141 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:52.560620 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:52.780596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:52.780771 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:53.075070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:53.385949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:12:53.474299 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:12:53.474532 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:12:53.977016 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:12:54.400208 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found WWN 33000000037ba25cf for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:12:54.400684 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:54.401082 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.921s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:54.401277 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb006ae2-4d16-4f84-9976-d00992eeaf32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:12:54.401621 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== connect_volume: return (4030ms) {'type': 'block', 'scsi_wwn': '33000000037ba25cf', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000037ba25cf'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:54.401743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000037ba25cf', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000037ba25cf'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:12:54.412759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:54.413253 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:54.413640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:54.413898 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:54.414089 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:54.414250 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:54.425011 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:54.425011 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:54.431675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:12:54.431675 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:54.437506 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32] added
May 28 03:12:54.437506 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:54.437506 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:54.437506 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:54.437506 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:54.437506 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:54.437506 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:54.437692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:54.437896 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:54.438215 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:54.440353 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'attaching', 'instance': '04163091-a678-44e3-9e68-2572090c60c2', 'attached_at': '2026-05-28T03:12:48.000000', 'detached_at': '', 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'serial': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:12:54.442475 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:12:54.442680 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:12:54.442809 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:12:54.447171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32] added
May 28 03:12:54.447171 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:12:54.447171 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:54.447171 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:54.447171 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:12:54.447171 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:12:54.447171 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:54.447366 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:12:54.447470 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0332(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:12:54.447597 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:12:54.455125 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:12:54.455125 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:12:54.455125 np0000001589 nova-compute[98297]:     <volume>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</volume>
May 28 03:12:54.455125 np0000001589 nova-compute[98297]:   </usage>
May 28 03:12:54.455125 np0000001589 nova-compute[98297]: </secret>
May 28 03:12:54.455125 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:12:54.483383 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.702s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:54.529013 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocations for instance fccadcf9-8b40-445a-b36c-3bb3025d3829
May 28 03:12:54.552769 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.962653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:11:53Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:12:54.962960 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:54.963642 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:54.965521 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] End _get_guest_xml xml=<domain type="qemu">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <uuid>04163091-a678-44e3-9e68-2572090c60c2</uuid>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <name>instance-00000034</name>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-872502143</nova:name>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:12:50</nova:creationTime>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:flavor name="tempest-1446704530" id="736c1771-ec4f-45d3-8d1c-1bfc9f1472f1">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:extraSpecs/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:user uuid="2d927d6b89cf4f0c96580968ea9c3791">tempest-TestEncryptedCinderVolumes-781621704-project-member</nova:user>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:project uuid="0eee8d500ee84b5f86e297c2660e183b">tempest-TestEncryptedCinderVolumes-781621704</nova:project>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <nova:port uuid="84be116e-1e2a-45c8-aec8-8b6a1aac2998">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <system>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <entry name="serial">04163091-a678-44e3-9e68-2572090c60c2</entry>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <entry name="uuid">04163091-a678-44e3-9e68-2572090c60c2</entry>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </system>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <os>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   </os>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <features>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   </features>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   <devices>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <alias name="ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <serial>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</serial>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <encryption format="luks">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:         <secret type="passphrase" uuid="24e8c70a-a98a-42ab-8ed3-6b47ba75d0dc"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       </encryption>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </disk>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:c7:48:ab"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <target dev="tap84be116e-1e"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </interface>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/console.log" append="off"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </serial>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <video>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </video>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </rng>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:   </devices>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]: </domain>
May 28 03:12:54.965521 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:12:54.968800 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:11:53Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:12:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:12:54.968800 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "vif_mac": "fa:16:3e:c7:48:ab"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:12:54.968800 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:12:54.968800 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:12:54.968800 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.968800 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:54.968800 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:12:54.969745 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.969892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a47b2b28-a0c8-5a63-9b62-1753952c8978', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:54.970688 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.971296 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:54.972086 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.973413 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.973539 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84be116e-1e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:54.973874 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84be116e-1e, col_values=(('qos', UUID('d6aa5261-c6db-4fa0-8539-4dbb97fef935')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:54.974018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84be116e-1e, col_values=(('external_ids', {'iface-id': '84be116e-1e2a-45c8-aec8-8b6a1aac2998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:48:ab', 'vm-uuid': '04163091-a678-44e3-9e68-2572090c60c2'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:12:54.974934 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.975764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:12:54.979816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:54.980537 np0000001589 nova-compute[98297]: INFO os_vif [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e')
May 28 03:12:55.438469 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:55.448117 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:55.454712 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:55.454712 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:12:55.463337 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:12:55.463337 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.470246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.474997 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.483958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.483958 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.483958 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.483958 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.483958 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.483958 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.483958 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:55.484187 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.484187 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.484187 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.484187 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.484187 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.484187 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.484187 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:55.492364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.492364 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.492364 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.492364 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.492364 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.492364 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.492364 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:55.492618 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.492618 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.492618 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.492618 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.492618 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.492618 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.492618 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:55.524277 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.40.100,3260]
May 28 03:12:55.524277 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.40.100,3260] successful.
May 28 03:12:55.524277 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.537787 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.538416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e2047344-6958-4215-8f7a-ccd9a2188324 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "fccadcf9-8b40-445a-b36c-3bb3025d3829" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.338s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:55.551611 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.50.100,3260]
May 28 03:12:55.551611 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.50.100,3260] successful.
May 28 03:12:55.551611 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.556692 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.557000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:55.557218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:55.557218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:55.558157 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] HCTL ('11', '-', '-', 0) found on session 142 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:55.558283 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:55.564090 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:12:55.577700 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching for a device in session 142 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:55.577810 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb006ae2-4d16-4f84-9976-d00992eeaf32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.585131 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:12:55.585410 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:12:55.585660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:55.585821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:12:55.586914 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] HCTL ('14', '-', '-', 0) found on session 143 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:12:55.587041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:12:55.600032 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching for a device in session 143 and hctl ['14', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:56.496526 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:56.496955 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:56.496955 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:56.496955 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] No VIF found with MAC fa:16:3e:c7:48:ab, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:56.497391 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Using config drive
May 28 03:12:56.600660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Searching for a device in session 143 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:12:56.600828 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bb006ae2-4d16-4f84-9976-d00992eeaf32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:12:56.708691 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:56.708852 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:56.910638 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:56.938561 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:56.939961 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:57.041688 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:57.107161 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.002370603999679588 future=<Future at 0x7e4b78145a30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:57.108609 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:57.109053 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779937962.10457, 04163091-a678-44e3-9e68-2572090c60c2 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:57.109511 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Stopped (Lifecycle Event)
May 28 03:12:57.112032 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.922251178999886 future=<Future at 0x7e4b40514ef0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:57.112215 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.921552131000226 future=<Future at 0x7e4b40514ef0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:12:57.143206 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e604b875-718a-463f-8c39-8495bd968f26 req-9340b4f1-701a-46af-96c0-92b76fe4d718 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:57.143206 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e604b875-718a-463f-8c39-8495bd968f26 req-9340b4f1-701a-46af-96c0-92b76fe4d718 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:57.143206 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e604b875-718a-463f-8c39-8495bd968f26 req-9340b4f1-701a-46af-96c0-92b76fe4d718 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:57.143206 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e604b875-718a-463f-8c39-8495bd968f26 req-9340b4f1-701a-46af-96c0-92b76fe4d718 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:57.144065 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e604b875-718a-463f-8c39-8495bd968f26 req-9340b4f1-701a-46af-96c0-92b76fe4d718 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:57.146203 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e604b875-718a-463f-8c39-8495bd968f26 req-9340b4f1-701a-46af-96c0-92b76fe4d718 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state active and task_state resize_finish.
May 28 03:12:57.213543 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'flavor' on Instance uuid 254c1717-ee79-4b55-8cf6-c18a282bf9fb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:57.333661 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:57.336699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:57.341822 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:57.362985 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:57.431152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Found WWN 330000000c1a79492 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:12:57.431152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:12:57.431152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] <== connect_volume: return (4950ms) {'type': 'block', 'scsi_wwn': '330000000c1a79492', 'path': '/dev/dm-2', 'multipath_id': '330000000c1a79492'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:57.431152 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c1a79492', 'path': '/dev/dm-2', 'multipath_id': '330000000c1a79492'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:12:57.436292 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'flavor' on Instance uuid 4fabe539-c171-4d50-a5b4-64ee77668e8a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:57.613271 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:57.939926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Attempting to attach volume bb006ae2-4d16-4f84-9976-d00992eeaf32 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:12:57.940483 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:12:57.940483 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:12:57.940483 np0000001589 nova-compute[98297]:   <alias name="ua-bb006ae2-4d16-4f84-9976-d00992eeaf32"/>
May 28 03:12:57.940483 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:12:57.940483 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:12:57.940483 np0000001589 nova-compute[98297]:   <serial>bb006ae2-4d16-4f84-9976-d00992eeaf32</serial>
May 28 03:12:57.940483 np0000001589 nova-compute[98297]: </disk>
May 28 03:12:57.940483 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:12:58.075767 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:58.219394 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:58.638255 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937978.6329114, 04163091-a678-44e3-9e68-2572090c60c2 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:58.638255 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Resumed (Lifecycle Event)
May 28 03:12:58.638255 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:12:58.638255 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance running successfully.
May 28 03:12:58.638255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Failed to set time: agent not configured {{(pid=98297) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 28 03:12:58.638255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-53abc6f4-63f4-4bc3-b134-fb4541f39ce1 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] finish_migration finished successfully. {{(pid=98297) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 28 03:12:59.049954 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:59.050164 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:59.050405 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:59.050583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:59.050740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:59.053400 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Terminating instance
May 28 03:12:59.136378 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:12:59.138242 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:12:59.212167 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-41fcc97b-1a98-42c9-9943-b9c0d8f7a44a req-c197fd5b-9ba5-4318-96e6-f6999d38c363 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:12:59.212808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-41fcc97b-1a98-42c9-9943-b9c0d8f7a44a req-c197fd5b-9ba5-4318-96e6-f6999d38c363 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:59.213197 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-41fcc97b-1a98-42c9-9943-b9c0d8f7a44a req-c197fd5b-9ba5-4318-96e6-f6999d38c363 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:59.213626 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-41fcc97b-1a98-42c9-9943-b9c0d8f7a44a req-c197fd5b-9ba5-4318-96e6-f6999d38c363 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:12:59.213881 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-41fcc97b-1a98-42c9-9943-b9c0d8f7a44a req-c197fd5b-9ba5-4318-96e6-f6999d38c363 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:12:59.214323 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-41fcc97b-1a98-42c9-9943-b9c0d8f7a44a req-c197fd5b-9ba5-4318-96e6-f6999d38c363 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state active and task_state resize_finish.
May 28 03:12:59.291610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:12:59.291749 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:12:59.291927 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Attaching volume 0471dbb5-53dc-4944-bed1-4d3035ce3a60 to /dev/vdb
May 28 03:12:59.326095 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:59.336474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:12:59.356891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:12:59.399786 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:12:59.400046 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:12:59.408207 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:12:59.410735 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fed3:5b9c', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fe24:3ded', 'fe80::fc16:3eff:fed7:d771', 'fe80::fc16:3eff:fe26:b4bc', 'fe80::ac8c:9cff:fe07:8685', 'fe80::fc16:3eff:fe00:ae0f', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fee0:12b8', 'fe80::fc16:3eff:fec7:48ab', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:12:59.410868 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:12:59.410958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:12:59.411170 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:12:59.411423 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Updating existing volume attachment record: cdcc4b8a-1557-45ca-977c-ce4b2b698bdf {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:12:59.557002 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:12:59.579820 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:59.589691 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:59.594653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:59.596914 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:59.596914 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:12:59.596914 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] No VIF found with MAC fa:16:3e:d7:d7:71, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:12:59.599532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:59.642543 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 28 03:12:59.642543 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779937979.640789, 04163091-a678-44e3-9e68-2572090c60c2 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:12:59.642543 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Started (Lifecycle Event)
May 28 03:12:59.741816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:59.747583 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:59.878099 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Instance destroyed successfully.
May 28 03:12:59.878647 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'resources' on Instance uuid b3b73e16-989c-483c-866f-4e179edfbeef {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:12:59.975476 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:12:59.980644 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '254c1717-ee79-4b55-8cf6-c18a282bf9fb', 'attached_at': '', 'detached_at': '', 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'serial': '0471dbb5-53dc-4944-bed1-4d3035ce3a60'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:12:59.981935 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:12:59.982262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:12:59.982474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:59.982912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:59.983082 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:12:59.993454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:59.994020 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:12:59.994416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:59.994672 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:12:59.994984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:12:59.995155 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:00.007880 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:00.007880 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:00.012422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:00.012422 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:00.020135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60] added
May 28 03:13:00.020135 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:00.020135 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:00.020135 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:00.020135 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:00.020135 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:00.020135 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:00.020385 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:00.020385 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:00.020584 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:00.028621 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60] added
May 28 03:13:00.028621 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:00.028621 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:00.028621 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:00.028621 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:00.028621 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:00.028621 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:00.028969 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:00.029027 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:00.029293 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:00.144570 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:00.146479 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:13:00.381011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=44,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:11:43Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-p6bko20t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:11:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3b73e16-989c-483c-866f-4e179edfbeef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:00.381295 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "address": "fa:16:3e:24:3d:ed", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc80fcc18-01", "ovs_interfaceid": "c80fcc18-0110-4f7b-97b1-60565e8719a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:00.382089 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:00.382405 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:00.383671 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:00.383857 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc80fcc18-01, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:00.384948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:00.385906 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:00.386595 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:00.387044 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:00.387173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64137333-9527-45ee-b960-137ca8d3f3c3) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:00.387590 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:00.387951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:00.388637 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:00.390120 np0000001589 nova-compute[98297]: INFO os_vif [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:3d:ed,bridge_name='br-int',has_traffic_filtering=True,id=c80fcc18-0110-4f7b-97b1-60565e8719a9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc80fcc18-01')
May 28 03:13:00.390431 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Deleting instance files /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_del
May 28 03:13:00.398949 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Deletion of /opt/stack/data/nova/instances/b3b73e16-989c-483c-866f-4e179edfbeef_del complete
May 28 03:13:00.649725 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999679303999983 future=<Future at 0x7e4b645d48c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:00.905535 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:13:00.906073 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:00.906287 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:00.906380 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:00.907003 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:00.937286 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:00.980732 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:01.010089 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:01.010472 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:01.010665 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:01.021014 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:13:01.029719 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:01.036320 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:01.036320 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:01.044711 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:01.044711 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.052791 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.061296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.073245 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.081631 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.081829 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:01.113501 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.40.100,3260]
May 28 03:13:01.113501 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.40.100,3260] successful.
May 28 03:13:01.113501 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.117974 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Port 84be116e-1e2a-45c8-aec8-8b6a1aac2998 binding to destination host np0000001589 is already ACTIVE {{(pid=98297) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 28 03:13:01.117974 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:13:01.117974 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:13:01.117974 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:13:01.128878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.136970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.50.100,3260]
May 28 03:13:01.136970 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.50.100,3260] successful.
May 28 03:13:01.136970 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.145982 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90bbe4b8-4f09-4fed-a2f6-0bbd92154c77 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.352s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.149207 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.152628 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:01.153028 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:01.153197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:01.154655 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] HCTL ('15', '-', '-', 0) found on session 144 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:01.154820 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:01.160771 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:01.177815 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching for a device in session 144 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:01.177815 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.189155 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:01.191285 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] HCTL ('16', '-', '-', 0) found on session 145 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:01.191285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:01.209241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching for a device in session 145 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:01.209241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:01.306248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:01.306549 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:01.307188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:01.307188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:01.307188 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] No waiting events found dispatching network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:01.307188 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:01.307420 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:01.307420 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] Acquiring lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:01.307687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:01.308932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] Lock "b3b73e16-989c-483c-866f-4e179edfbeef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:01.308932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] No waiting events found dispatching network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:01.308932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8845efcd-187f-4050-92d4-ac74e454846d req-8c2ea6c3-7de9-46d8-a50d-cf53c46af5b5 service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-unplugged-c80fcc18-0110-4f7b-97b1-60565e8719a9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:01.485494 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4c682f5-3c17-4de2-ba3b-e29673ae3585 req-401dffaa-49c7-4407-b4a3-de881dc1c6cd service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Received event network-vif-deleted-c80fcc18-0110-4f7b-97b1-60565e8719a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:01.485704 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-a4c682f5-3c17-4de2-ba3b-e29673ae3585 req-401dffaa-49c7-4407-b4a3-de881dc1c6cd service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Neutron deleted interface c80fcc18-0110-4f7b-97b1-60565e8719a9; detaching it from the instance and deleting it from the info cache
May 28 03:13:01.487099 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4c682f5-3c17-4de2-ba3b-e29673ae3585 req-401dffaa-49c7-4407-b4a3-de881dc1c6cd service nova] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Detach interface failed, port_id=c80fcc18-0110-4f7b-97b1-60565e8719a9, reason: Instance b3b73e16-989c-483c-866f-4e179edfbeef could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:01.618829 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:01.929158 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:01.930390 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:01.995606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:13:02.061163 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:02.434031 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Took 1.53 seconds to deallocate network for instance.
May 28 03:13:02.563109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:13:02.940326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:02.940666 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:03.014314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Found WWN 330000000097f7e56 for multipath device dm-3 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:13:03.014675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:03.015677 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000097f7e56', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000097f7e56'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:03.015817 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000097f7e56', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '330000000097f7e56'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:13:03.017707 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:13:03.017929 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:13:03.018102 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:13:03.034487 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:13:03.034487 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:13:03.034487 np0000001589 nova-compute[98297]:     <volume>0471dbb5-53dc-4944-bed1-4d3035ce3a60</volume>
May 28 03:13:03.034487 np0000001589 nova-compute[98297]:   </usage>
May 28 03:13:03.034487 np0000001589 nova-compute[98297]: </secret>
May 28 03:13:03.034487 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:13:03.040791 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'flavor' on Instance uuid 254c1717-ee79-4b55-8cf6-c18a282bf9fb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:03.066263 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Creating tmpfile /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/tmp4d1z2ncd to verify with other compute node that the instance is on the same shared storage. {{(pid=98297) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 28 03:13:03.066527 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:13:03.077814 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:03.543802 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Attempting to attach volume 0471dbb5-53dc-4944-bed1-4d3035ce3a60 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:13:03.548286 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:   <alias name="ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60"/>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:   <serial>0471dbb5-53dc-4944-bed1-4d3035ce3a60</serial>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="cfc2e993-ebc2-4bee-9b9c-5c3f12a6a426"/>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:03.548286 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:13:03.598997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:03.603885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:03.629393 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:03.639627 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:03.648958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:03.670208 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:03.670465 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:03.764122 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f4f5bc7a-0b60-4259-9401-677504737d03 req-6b4246e2-e4bb-413a-a3bd-ccdbd256567c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:03.764513 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f4f5bc7a-0b60-4259-9401-677504737d03 req-6b4246e2-e4bb-413a-a3bd-ccdbd256567c service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:03.764828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f4f5bc7a-0b60-4259-9401-677504737d03 req-6b4246e2-e4bb-413a-a3bd-ccdbd256567c service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:03.764917 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f4f5bc7a-0b60-4259-9401-677504737d03 req-6b4246e2-e4bb-413a-a3bd-ccdbd256567c service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:03.765067 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f4f5bc7a-0b60-4259-9401-677504737d03 req-6b4246e2-e4bb-413a-a3bd-ccdbd256567c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:03.765185 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f4f5bc7a-0b60-4259-9401-677504737d03 req-6b4246e2-e4bb-413a-a3bd-ccdbd256567c service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state resized and task_state resize_reverting.
May 28 03:13:03.906436 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999702786999933 future=<Future at 0x7e4b407adc70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:03.909734 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance destroyed successfully.
May 28 03:13:03.910088 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'resources' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:04.034181 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.000420133999796235 future=<Future at 0x7e4b40514ef0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:04.034568 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Emitting event <LifecycleEvent: 1779937969.0336466, fccadcf9-8b40-445a-b36c-3bb3025d3829 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:04.034819 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] VM Stopped (Lifecycle Event)
May 28 03:13:04.035608 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:04.035723 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.61362537299965 future=<Future at 0x7e4b645d48c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:04.035812 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=11.613528843999575 future=<Future at 0x7e4b645d48c0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:04.122527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:04.122726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:04.173183 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:04.412607 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(13),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=13,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:59Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=Flavor(13),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:12:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:04.412607 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:04.415738 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:04.415738 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:04.415738 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:04.415738 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84be116e-1e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:04.415738 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:04.418650 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:04.419945 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:04.421821 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6aa5261-c6db-4fa0-8539-4dbb97fef935) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:04.421821 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:04.422112 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:04.424358 np0000001589 nova-compute[98297]: INFO os_vif [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e')
May 28 03:13:04.427599 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:13:04.427746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:04.427939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:04.428389 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:04.429273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:13:04.429273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [140] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [141] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:04.457508 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:04.458946 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '140'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '141'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:13:04.458946 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '140')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:04.460026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '141')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:04.460890 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646ba2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:13:04.461115 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:13:04.461403 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flush multipath device 33000000037ba25cf {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:13:04.492404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:04.537443 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: fccadcf9-8b40-445a-b36c-3bb3025d3829] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:04.542887 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:04.598553 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:13:04.598856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:13:04.600164 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:13:04.611950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:13:04.612293 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:13:04.625048 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Detaching volume bb006ae2-4d16-4f84-9976-d00992eeaf32
May 28 03:13:04.627565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:04.662179 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260]
May 28 03:13:04.662179 np0000001589 nova-compute[98297]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260] successful.
May 28 03:13:04.662179 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:04.671974 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Attempting to driver detach volume bb006ae2-4d16-4f84-9976-d00992eeaf32 from mountpoint /dev/vdb
May 28 03:13:04.680414 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Found disk vdb by alias ua-bb006ae2-4d16-4f84-9976-d00992eeaf32 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:04.681955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.741s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:04.684858 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:04.685971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Found disk vdb by alias ua-bb006ae2-4d16-4f84-9976-d00992eeaf32 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:04.686110 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Attempting to detach device vdb from instance 4fabe539-c171-4d50-a5b4-64ee77668e8a from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:13:04.686459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:04.686459 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:04.686459 np0000001589 nova-compute[98297]:   <alias name="ua-bb006ae2-4d16-4f84-9976-d00992eeaf32"/>
May 28 03:13:04.686459 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:13:04.686459 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:04.686459 np0000001589 nova-compute[98297]:   <serial>bb006ae2-4d16-4f84-9976-d00992eeaf32</serial>
May 28 03:13:04.686459 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:04.686459 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:04.686459 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:04.694120 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully detached device vdb from instance 4fabe539-c171-4d50-a5b4-64ee77668e8a from the persistent domain config.
May 28 03:13:04.694331 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] (1/8): Attempting to detach device vdb with device alias ua-bb006ae2-4d16-4f84-9976-d00992eeaf32 from instance 4fabe539-c171-4d50-a5b4-64ee77668e8a from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:13:04.694581 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:04.694581 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:04.694581 np0000001589 nova-compute[98297]:   <alias name="ua-bb006ae2-4d16-4f84-9976-d00992eeaf32"/>
May 28 03:13:04.694581 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:13:04.694581 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:04.694581 np0000001589 nova-compute[98297]:   <serial>bb006ae2-4d16-4f84-9976-d00992eeaf32</serial>
May 28 03:13:04.694581 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:04.694581 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:04.694581 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:04.700892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:04.735165 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260]
May 28 03:13:04.735165 np0000001589 nova-compute[98297]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260] successful.
May 28 03:13:04.735165 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:04.745651 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocations for instance b3b73e16-989c-483c-866f-4e179edfbeef
May 28 03:13:04.753266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:04.754061 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:04.754177 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== disconnect_volume: return (326ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:04.754303 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:13:05.206775 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937985.206422, 4fabe539-c171-4d50-a5b4-64ee77668e8a => ua-bb006ae2-4d16-4f84-9976-d00992eeaf32> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:13:05.207393 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bb006ae2-4d16-4f84-9976-d00992eeaf32 for instance 4fabe539-c171-4d50-a5b4-64ee77668e8a {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:13:05.210805 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully detached device vdb from instance 4fabe539-c171-4d50-a5b4-64ee77668e8a from the live domain config.
May 28 03:13:05.211772 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:13:05.212041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb006ae2-4d16-4f84-9976-d00992eeaf32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:05.212186 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:05.212521 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:05.212825 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bb006ae2-4d16-4f84-9976-d00992eeaf32', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:13:05.212977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:05.239785 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: tcp: [142] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: tcp: [143] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32 (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:05.240021 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:05.240021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', '142'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', '143'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:13:05.240295 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', '142')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:05.241003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32', '143')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:05.241726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b644a58a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32'): ({'sdi'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:13:05.241892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Removing multipathed devices sdf, sdi {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:13:05.242081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Flush multipath device 330000000c1a79492 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:13:05.268877 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:05.314645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:05.366639 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Checking to see if SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:13:05.366792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:13:05.367652 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Checking to see if device paths {'sdf', 'sdi'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:13:05.384459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Device paths {'sdf', 'sdi'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:13:05.384665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:13:05.400694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:05.434058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.40.100,3260]
May 28 03:13:05.434058 np0000001589 nova-compute[98297]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.40.100,3260] successful.
May 28 03:13:05.434058 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:05.448863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:05.461191 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:05.491402 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.50.100,3260]
May 28 03:13:05.491402 np0000001589 nova-compute[98297]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-bb006ae2-4d16-4f84-9976-d00992eeaf32, portal: 192.168.50.100,3260] successful.
May 28 03:13:05.491402 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:05.506021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:05.506197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:05.506373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] <== disconnect_volume: return (293ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:05.506439 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:13:05.754174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f8013ce0-a6ac-4aae-a58e-85d06261608b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3b73e16-989c-483c-866f-4e179edfbeef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.704s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:05.849700 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c65122a4-adbc-43f9-9730-6f3764de63c4 req-e67847be-8238-4dc8-b7e3-49cf86d90373 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:05.850173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c65122a4-adbc-43f9-9730-6f3764de63c4 req-e67847be-8238-4dc8-b7e3-49cf86d90373 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:05.850455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c65122a4-adbc-43f9-9730-6f3764de63c4 req-e67847be-8238-4dc8-b7e3-49cf86d90373 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:05.850524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c65122a4-adbc-43f9-9730-6f3764de63c4 req-e67847be-8238-4dc8-b7e3-49cf86d90373 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:05.850703 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c65122a4-adbc-43f9-9730-6f3764de63c4 req-e67847be-8238-4dc8-b7e3-49cf86d90373 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:05.850841 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c65122a4-adbc-43f9-9730-6f3764de63c4 req-e67847be-8238-4dc8-b7e3-49cf86d90373 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state resized and task_state resize_reverting.
May 28 03:13:05.882077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:05.882240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:06.055082 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'flavor' on Instance uuid 4fabe539-c171-4d50-a5b4-64ee77668e8a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:06.214727 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:06.214727 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:06.214727 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:06.214727 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No VIF found with MAC fa:16:3e:26:b4:bc, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:13:06.265128 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:06.265304 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:06.265522 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:06.265701 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:06.265834 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:06.267751 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Terminating instance
May 28 03:13:06.384699 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'migration_context' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:06.770803 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:06.791770 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:06.797418 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:06.810938 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:06.886754 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Object Instance<04163091-a678-44e3-9e68-2572090c60c2> lazy-loaded attributes: resources,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:13:06.940137 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Refreshing inventories for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 03:13:06.979993 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:06.988839 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:07.002752 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Updating ProviderTree inventory for provider 672703c4-2150-4765-9740-44d3bdb44a8c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 03:13:07.003074 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 03:13:07.052992 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Refreshing aggregate associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, aggregates: None {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 03:13:07.062746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de792f7a-e601-41dd-a47e-599f334450ee tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.940s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:07.108480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:07.127930 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Refreshing trait associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, traits: COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 03:13:07.137783 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999822168999799 future=<Future at 0x7e4b64504dd0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:07.141206 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Instance destroyed successfully.
May 28 03:13:07.142727 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'resources' on Instance uuid b00002ac-1bf2-43ff-9836-3aa0f11fdabb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:07.646201 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=42,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:10:51Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-mscd5hbc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b00002ac-1bf2-43ff-9836-3aa0f11fdabb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:07.646201 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "address": "fa:16:3e:d3:5b:9c", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf6d0b8a-02", "ovs_interfaceid": "bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:07.646201 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:07.646201 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:07.647093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:07.647093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf6d0b8a-02, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:07.649058 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:07.649300 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:07.651173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:07.651957 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:07.652141 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1d8fdba-7477-46f7-b7a5-ec1088e84535) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:07.654575 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:07.655956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:07.662170 np0000001589 nova-compute[98297]: INFO os_vif [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:5b:9c,bridge_name='br-int',has_traffic_filtering=True,id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf6d0b8a-02')
May 28 03:13:07.662170 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Deleting instance files /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_del
May 28 03:13:07.672083 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Deletion of /opt/stack/data/nova/instances/b00002ac-1bf2-43ff-9836-3aa0f11fdabb_del complete
May 28 03:13:07.748601 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:07.748929 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:07.762660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aec9642c-2d34-45eb-b76e-0f7a9ec85fbd tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.471s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:07.911270 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:07.911868 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] No waiting events found dispatching network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Acquiring lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] No waiting events found dispatching network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-unplugged-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-changed-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Refreshing instance network info cache due to event network-changed-fe085d6e-ad52-449d-b91b-aee0791962c5. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Acquiring lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Acquired lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:13:07.915028 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Refreshing network info cache for port fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:13:07.921703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:07.921703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:07.921703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:07.921703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:07.921703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:07.923913 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Terminating instance
May 28 03:13:08.080352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:08.179688 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Took 1.41 seconds to destroy the instance on the hypervisor.
May 28 03:13:08.180217 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:08.180506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:08.180637 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:08.181214 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:08.223858 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:08.223980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:08.252942 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:08.289923 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:08.415701 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:08.426136 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:08.450662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:08.453978 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:08.470971 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:08.554686 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-294bd760-9e45-4f8f-9082-d09c06b26392 req-47d101f9-ced0-4bd2-9e8c-91e7e953ff0f service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Received event network-vif-deleted-bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:08.554757 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-294bd760-9e45-4f8f-9082-d09c06b26392 req-47d101f9-ced0-4bd2-9e8c-91e7e953ff0f service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Neutron deleted interface bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26; detaching it from the instance and deleting it from the info cache
May 28 03:13:08.557580 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-294bd760-9e45-4f8f-9082-d09c06b26392 req-47d101f9-ced0-4bd2-9e8c-91e7e953ff0f service nova] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Detach interface failed, port_id=bf6d0b8a-02a6-462f-a5b1-bbd135e8cd26, reason: Instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:08.616820 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:08.622005 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:08.729728 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Detaching volume 0471dbb5-53dc-4944-bed1-4d3035ce3a60
May 28 03:13:08.749075 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999698229999922 future=<Future at 0x7e4b406cf6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:08.750910 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Instance destroyed successfully.
May 28 03:13:08.751322 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'resources' on Instance uuid 4fabe539-c171-4d50-a5b4-64ee77668e8a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:08.754088 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:08.769481 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Attempting to driver detach volume 0471dbb5-53dc-4944-bed1-4d3035ce3a60 from mountpoint /dev/vdb
May 28 03:13:08.807244 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '254c1717-ee79-4b55-8cf6-c18a282bf9fb', 'attached_at': '', 'detached_at': '', 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'serial': '0471dbb5-53dc-4944-bed1-4d3035ce3a60'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:13:08.811386 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Found disk vdb by alias ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:08.812761 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Found disk vdb by alias ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:08.812928 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Attempting to detach device vdb from instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:13:08.813255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   <alias name="ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60"/>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   <serial>0471dbb5-53dc-4944-bed1-4d3035ce3a60</serial>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="cfc2e993-ebc2-4bee-9b9c-5c3f12a6a426"/>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:08.813255 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:08.818779 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully detached device vdb from instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb from the persistent domain config.
May 28 03:13:08.818982 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] (1/8): Attempting to detach device vdb with device alias ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60 from instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:13:08.819244 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   <alias name="ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60"/>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   <serial>0471dbb5-53dc-4944-bed1-4d3035ce3a60</serial>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="cfc2e993-ebc2-4bee-9b9c-5c3f12a6a426"/>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:08.819244 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:08.879962 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updated VIF entry in instance network info cache for port fe085d6e-ad52-449d-b91b-aee0791962c5. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:13:08.880215 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updating instance_info_cache with network_info: [{"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:09.007658 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:09.257849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-906912063',display_name='tempest-TestStampPattern-server-906912063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-teststamppattern-server-906912063',id=53,image_ref='6e0d4ea0-013d-4edd-939b-661eac5cbbf4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKEgysMdWopO6E3aAZPHlXvRqDZ+TYxL5JhnJTwlr4MspE/uoCewfhs6aHx4RT/K6l3FanqteTUkMjEY/GUBECAVHfwAYzhiHcP0zlwzDEZm0H6EvR9YWcZvaI8+O+Z7g==',key_name='tempest-TestStampPattern-70636981',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:10Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367ea52eb22f43adb2cd01467b3473ae',ramdisk_id='',reservation_id='r-3yau7mxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='090d3888-c5fe-4b64-8caa-d93fc3f39bf3',image_min_disk='1',image_min_ram='0',image_owner_id='367ea52eb22f43adb2cd01467b3473ae',image_owner_project_name='tempest-TestStampPattern-277675958',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-277675958-project-member',image_user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',owner_project_name='tempest-TestStampPattern-277675958',owner_user_name='tempest-TestStampPattern-277675958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:12:11Z,user_data=None,user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',uuid=4fabe539-c171-4d50-a5b4-64ee77668e8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:09.258170 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converting VIF {"id": "fe085d6e-ad52-449d-b91b-aee0791962c5", "address": "fa:16:3e:d7:d7:71", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe085d6e-ad", "ovs_interfaceid": "fe085d6e-ad52-449d-b91b-aee0791962c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:09.258836 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:d7:71,bridge_name='br-int',has_traffic_filtering=True,id=fe085d6e-ad52-449d-b91b-aee0791962c5,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe085d6e-ad') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:09.259095 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:d7:71,bridge_name='br-int',has_traffic_filtering=True,id=fe085d6e-ad52-449d-b91b-aee0791962c5,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe085d6e-ad') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:09.260270 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:09.260270 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe085d6e-ad, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:09.261052 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:09.261805 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:09.263606 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.381s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:09.263785 np0000001589 nova-compute[98297]: DEBUG nova.compute.rpcapi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98297) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 28 03:13:09.268209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:09.268493 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76cefce0-ae5e-4856-8c4e-586e00d69407) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:09.270233 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:09.270995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:09.276897 np0000001589 nova-compute[98297]: INFO os_vif [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:d7:71,bridge_name='br-int',has_traffic_filtering=True,id=fe085d6e-ad52-449d-b91b-aee0791962c5,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe085d6e-ad')
May 28 03:13:09.278852 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Deleting instance files /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a_del
May 28 03:13:09.279553 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Deletion of /opt/stack/data/nova/instances/4fabe539-c171-4d50-a5b4-64ee77668e8a_del complete
May 28 03:13:09.299816 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779937989.2994442, 254c1717-ee79-4b55-8cf6-c18a282bf9fb => ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:13:09.301013 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0471dbb5-53dc-4944-bed1-4d3035ce3a60 for instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:13:09.303192 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully detached device vdb from instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb from the live domain config.
May 28 03:13:09.305729 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:13:09.306030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:09.306145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:09.306498 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:09.306779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0471dbb5-53dc-4944-bed1-4d3035ce3a60', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:13:09.306904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:13:09.331665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:09.331665 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:09.331665 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:09.331665 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:09.331665 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:09.331665 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:09.331665 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:09.331947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:09.331947 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:09.331947 np0000001589 nova-compute[98297]: tcp: [144] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:09.331947 np0000001589 nova-compute[98297]: tcp: [145] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60 (non-flash)
May 28 03:13:09.331947 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:09.331947 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:09.331947 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:09.332080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '144'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '145'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:13:09.332160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '144')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:09.333249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60', '145')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:09.334189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646ca480>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'): ({'sdk'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:13:09.334417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Removing multipathed devices sdk, sdj {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:13:09.334709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flush multipath device 330000000097f7e56 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:13:09.369219 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:09.382245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bc257589-cd24-4ad1-9b08-1b9d1df513d0 req-9f759c89-fcc2-4a51-9b32-0636d50306c1 service nova] Releasing lock "refresh_cache-4fabe539-c171-4d50-a5b4-64ee77668e8a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:13:09.411619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:09.463798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:13:09.464033 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:13:09.464943 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:13:09.477283 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:13:09.477510 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:13:09.490748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:09.509598 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Took 1.33 seconds to deallocate network for instance.
May 28 03:13:09.525261 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.40.100,3260]
May 28 03:13:09.525261 np0000001589 nova-compute[98297]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.40.100,3260] successful.
May 28 03:13:09.525261 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:09.540274 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:09.551840 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:09.582411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.50.100,3260]
May 28 03:13:09.582411 np0000001589 nova-compute[98297]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-0471dbb5-53dc-4944-bed1-4d3035ce3a60, portal: 192.168.50.100,3260] successful.
May 28 03:13:09.582411 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:09.597370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:09.598472 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:09.598729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== disconnect_volume: return (291ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:09.598849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:13:09.786803 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 03:13:09.787384 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:09.787619 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:09.787726 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:09.787918 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:09.875932 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:09.960898 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-vif-unplugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:09.961066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:09.961204 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:09.961358 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:09.961426 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] No waiting events found dispatching network-vif-unplugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:09.961551 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-vif-unplugged-fe085d6e-ad52-449d-b91b-aee0791962c5 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:09.961659 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-vif-unplugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:09.962011 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] Acquiring lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:09.962134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:09.962215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:09.962338 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] No waiting events found dispatching network-vif-unplugged-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:09.962431 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e2b123e0-ea92-4cc3-9623-e0f5d539f73d req-1ac47571-112b-4f47-acfa-59bfc2585c02 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-vif-unplugged-fe085d6e-ad52-449d-b91b-aee0791962c5 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:10.016413 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:10.017199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:10.082717 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:10.142523 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'flavor' on Instance uuid 254c1717-ee79-4b55-8cf6-c18a282bf9fb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:10.162762 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c298ec3b-67cc-454e-9b3d-10f1b1a7fd2d req-af70f67b-342e-4f1a-aec0-620d6ad1f549 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Received event network-vif-deleted-fe085d6e-ad52-449d-b91b-aee0791962c5 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:10.162876 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-c298ec3b-67cc-454e-9b3d-10f1b1a7fd2d req-af70f67b-342e-4f1a-aec0-620d6ad1f549 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Neutron deleted interface fe085d6e-ad52-449d-b91b-aee0791962c5; detaching it from the instance and deleting it from the info cache
May 28 03:13:10.164636 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c298ec3b-67cc-454e-9b3d-10f1b1a7fd2d req-af70f67b-342e-4f1a-aec0-620d6ad1f549 service nova] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Detach interface failed, port_id=fe085d6e-ad52-449d-b91b-aee0791962c5, reason: Instance 4fabe539-c171-4d50-a5b4-64ee77668e8a could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:10.551998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:10.552333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:10.603262 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:10.603480 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:10.619483 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:10.827347 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Swapping old allocation on dict_keys(['672703c4-2150-4765-9740-44d3bdb44a8c']) held by migration 57f2616a-e96f-4205-be8e-598a4b27b7d7 for instance
May 28 03:13:10.909512 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Overwriting current allocation {'allocations': {'672703c4-2150-4765-9740-44d3bdb44a8c': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 75}}, 'project_id': '0eee8d500ee84b5f86e297c2660e183b', 'user_id': '2d927d6b89cf4f0c96580968ea9c3791', 'consumer_generation': 1} on consumer 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 28 03:13:10.983629 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:11.041294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:13:11.042397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquired lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:13:11.042397 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:13:11.056250 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid 5536af08-bb5c-4170-9b07-61fac08818b2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:11.105849 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:11.121741 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Took 1.33 seconds to deallocate network for instance.
May 28 03:13:11.147189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0669b67a-dfbc-45c4-8379-e3eb3e78d44c tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.923s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:11.492547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:11.492701 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:11.492877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:11.493023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:11.493133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:11.494968 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Terminating instance
May 28 03:13:11.543869 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:11.612359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.595s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:11.627616 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:11.627616 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:11.686147 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocations for instance b00002ac-1bf2-43ff-9836-3aa0f11fdabb
May 28 03:13:11.879011 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:11.997708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:12.014203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.016674 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.030274 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:12.036428 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.062257 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:12.064093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.177102 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87bbd02c-7b6b-40ce-a312-c428cfa4a02e req-7af54586-f24f-4f16-89f1-6304dd815b3e service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-vif-unplugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:12.177705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87bbd02c-7b6b-40ce-a312-c428cfa4a02e req-7af54586-f24f-4f16-89f1-6304dd815b3e service nova] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:12.177705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87bbd02c-7b6b-40ce-a312-c428cfa4a02e req-7af54586-f24f-4f16-89f1-6304dd815b3e service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:12.177705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87bbd02c-7b6b-40ce-a312-c428cfa4a02e req-7af54586-f24f-4f16-89f1-6304dd815b3e service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:12.177866 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87bbd02c-7b6b-40ce-a312-c428cfa4a02e req-7af54586-f24f-4f16-89f1-6304dd815b3e service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] No waiting events found dispatching network-vif-unplugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:12.178003 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87bbd02c-7b6b-40ce-a312-c428cfa4a02e req-7af54586-f24f-4f16-89f1-6304dd815b3e service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-vif-unplugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:12.219132 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:12.219402 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:12.327935 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999750435999886 future=<Future at 0x7e4b6449b9b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:12.330104 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Instance destroyed successfully.
May 28 03:13:12.330760 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'resources' on Instance uuid 254c1717-ee79-4b55-8cf6-c18a282bf9fb {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:12.532331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Releasing lock "refresh_cache-04163091-a678-44e3-9e68-2572090c60c2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:13:12.532840 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:12.544113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:13:12.565668 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:12.617714 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:13:12.618049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:13:12.629392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:13:12.631063 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fe00:ae0f', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fee0:12b8'] 
May 28 03:13:12.631185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:13:12.631369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:13:12.631667 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:12.694840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eb59c39c-dbb2-4229-b86f-8789c99578cf tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b00002ac-1bf2-43ff-9836-3aa0f11fdabb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.429s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:12.722375 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:12.833560 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:12:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2134597055',display_name='tempest-TestEncryptedCinderVolumes-server-2134597055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-2134597055',id=54,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGggu/dW0Ix35tNFNC9k0hJxy/M7yp9zaU+iBEDEz6w78FvOF1+etaLyxoQ4VJ9n5AZfwJZiSK2MYNwk1XBYsXoKSCWgbZnTfmbyHRovEJqWRi+BzpS0WnkxNV07GAt0ig==',key_name='tempest-keypair-1941161888',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:19Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-p7ne2ygp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:12:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=254c1717-ee79-4b55-8cf6-c18a282bf9fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:12.833818 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "address": "fa:16:3e:26:b4:bc", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap757b64c0-7f", "ovs_interfaceid": "757b64c0-7f62-4838-87fd-50b2d42bc6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:12.834319 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:b4:bc,bridge_name='br-int',has_traffic_filtering=True,id=757b64c0-7f62-4838-87fd-50b2d42bc6f6,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757b64c0-7f') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:12.834570 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:b4:bc,bridge_name='br-int',has_traffic_filtering=True,id=757b64c0-7f62-4838-87fd-50b2d42bc6f6,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757b64c0-7f') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:12.835844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.836156 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap757b64c0-7f, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:12.837403 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.838142 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:12.838524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.839323 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.839492 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=347d1c09-2231-46ff-9e60-10164c9a39e3) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:12.839940 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.840417 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:12.840675 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:12.842331 np0000001589 nova-compute[98297]: INFO os_vif [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:b4:bc,bridge_name='br-int',has_traffic_filtering=True,id=757b64c0-7f62-4838-87fd-50b2d42bc6f6,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap757b64c0-7f')
May 28 03:13:12.842612 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Deleting instance files /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb_del
May 28 03:13:12.843645 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Deletion of /opt/stack/data/nova/instances/254c1717-ee79-4b55-8cf6-c18a282bf9fb_del complete
May 28 03:13:13.091417 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:13.128559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:13.128713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:13.128890 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Attaching volume cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f to /dev/vdb
May 28 03:13:13.162722 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:13.173106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:13:13.193710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:13.230418 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.602s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:13.245075 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:13:13.245421 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:13:13.253546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:13:13.255101 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fef8:75b3', 'fe80::74dc:23ff:fe9f:6608', 'fe80::fc16:3eff:fe39:9333', 'fe80::fc16:3eff:fe12:88e0', 'fe80::6491:8dff:fe24:5d48', 'fe80::fc16:3eff:fead:9935', 'fe80::d001:faff:fe90:5909', 'fe80::fc16:3eff:fe7e:fa65', 'fe80::fc16:3eff:fe8e:4b79', 'fe80::fc16:3eff:fe00:ae0f', 'fe80::10ec:c3ff:fe53:b9ec', 'fe80::fc16:3eff:fee0:12b8'] 
May 28 03:13:13.255306 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:13:13.255716 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:13:13.256091 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:13.256262 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Updating existing volume attachment record: 97ceb008-0088-41c4-9813-5b24338097c0 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:13:13.284387 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Deleted allocations for instance 4fabe539-c171-4d50-a5b4-64ee77668e8a
May 28 03:13:13.351073 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:13:13.351766 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:13.352045 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:13.352150 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:13.352445 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:13.413479 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:13.716176 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Starting finish_revert_migration {{(pid=98297) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 28 03:13:13.727653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Start _get_guest_xml network_info=[{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '09d46268-913f-4431-9c49-c4632a82ac88', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '04163091-a678-44e3-9e68-2572090c60c2', 'attached_at': '2026-05-28T03:13:13.000000', 'detached_at': '', 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'serial': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:13:13.729642 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:13:13.730616 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-872502143', uuid='04163091-a678-44e3-9e68-2572090c60c2'), owner=OwnerMeta(userid='2d927d6b89cf4f0c96580968ea9c3791', username='tempest-TestEncryptedCinderVolumes-781621704-project-member', projectid='0eee8d500ee84b5f86e297c2660e183b', projectname='tempest-TestEncryptedCinderVolumes-781621704'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779937993.7302992) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:13:13.731783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:13:13.732069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:13:13.733051 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:13:13.733240 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:13:13.734270 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:13:13.734556 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:13:13.734714 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:13:13.734836 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:13:13.734985 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:13:13.735087 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:13:13.735189 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:13:13.735370 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:13:13.735473 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:13:13.735680 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:13:13.735778 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:13:13.735887 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:13:13.736023 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'vcpu_model' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:13.802288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:13:13.802642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:13.802767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:13.803121 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:13.803308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:13:13.817375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:13.818034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:13.818822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:13.819007 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:13.819675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:13.820366 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:13:13.829523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:13.829523 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:13.833679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:13.833679 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:13.841281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f] added
May 28 03:13:13.841281 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:13.841281 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:13.841281 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:13.841281 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:13.841281 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:13.841281 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:13.841281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:13.841576 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:13.841576 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:13.844499 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f] added
May 28 03:13:13.844499 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:13.844499 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:13.844499 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:13.844499 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:13.844499 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:13.844499 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:13.844630 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:13.844811 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:13.844958 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:14.246717 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-vif-unplugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:14.247077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] Acquiring lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:14.247077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:14.247180 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:14.247308 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] No waiting events found dispatching network-vif-unplugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:14.247427 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-vif-unplugged-757b64c0-7f62-4838-87fd-50b2d42bc6f6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:14.247558 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Received event network-vif-deleted-757b64c0-7f62-4838-87fd-50b2d42bc6f6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:14.247953 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Neutron deleted interface 757b64c0-7f62-4838-87fd-50b2d42bc6f6; detaching it from the instance and deleting it from the info cache
May 28 03:13:14.249870 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-486f560c-af77-4333-a7c9-ed02e6ebaf7b req-a43420d2-b9dc-4cdd-bee7-7fa817083809 service nova] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Detach interface failed, port_id=757b64c0-7f62-4838-87fd-50b2d42bc6f6, reason: Instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:14.253004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:14.287876 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:14.295514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43a10b53-95fd-4229-a7d8-7cf26b909073 tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "4fabe539-c171-4d50-a5b4-64ee77668e8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.375s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:14.347546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:13:14.348809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:14.348809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:14.348809 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:14.349106 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:13:14.349477 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:14.349634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:14.396689 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:14.396938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:14.397294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:14.397418 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:14.397566 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:14.399980 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Terminating instance
May 28 03:13:14.795570 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Took 1.44 seconds to deallocate network for instance.
May 28 03:13:14.842047 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:14.845496 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:14.856113 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:14.856113 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:14.862311 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:14.862311 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.869683 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.875335 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.884366 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.884366 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.884366 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.884366 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.884366 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:14.884675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.884675 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.884675 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.884675 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.884675 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:14.890166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.890166 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.890166 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.890166 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.890166 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:14.890328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.890328 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.890328 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.890328 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.890328 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:14.903396 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:14.917816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.50.100,3260]
May 28 03:13:14.917816 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.50.100,3260] successful.
May 28 03:13:14.917816 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.928697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:14.931008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.40.100,3260]
May 28 03:13:14.931008 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.40.100,3260] successful.
May 28 03:13:14.931008 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.931532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:14.933296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.945050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:14.951474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.951474 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.951474 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.951474 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.951474 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.951474 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.951474 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:14.951731 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.951731 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.951731 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.951731 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.951731 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.951731 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.951731 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:14.951917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:14.952004 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:14.952723 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] HCTL ('9', '-', '-', 0) found on session 146 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:14.952845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:14.955631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:14.961573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.961573 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.961573 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.961573 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.961573 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.961573 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.961573 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:14.961824 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.961824 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:14.961824 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.961824 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:14.961824 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.961824 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:14.961824 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:14.962656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:14.962656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:14.963030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] HCTL ('10', '-', '-', 0) found on session 147 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:14.963148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:14.971110 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching for a device in session 146 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:14.971316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:14.978494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Searching for a device in session 147 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:14.978558 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:15.097675 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6f4f3aa1-8cfd-4796-b799-c0fbc1422a92 req-3f257f8c-f467-43db-8f49-e3d1ac9c777d service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-vif-unplugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:15.098105 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6f4f3aa1-8cfd-4796-b799-c0fbc1422a92 req-3f257f8c-f467-43db-8f49-e3d1ac9c777d service nova] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:15.098262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6f4f3aa1-8cfd-4796-b799-c0fbc1422a92 req-3f257f8c-f467-43db-8f49-e3d1ac9c777d service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:15.098384 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6f4f3aa1-8cfd-4796-b799-c0fbc1422a92 req-3f257f8c-f467-43db-8f49-e3d1ac9c777d service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:15.098549 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6f4f3aa1-8cfd-4796-b799-c0fbc1422a92 req-3f257f8c-f467-43db-8f49-e3d1ac9c777d service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] No waiting events found dispatching network-vif-unplugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:15.098695 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6f4f3aa1-8cfd-4796-b799-c0fbc1422a92 req-3f257f8c-f467-43db-8f49-e3d1ac9c777d service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-vif-unplugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:15.100434 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.108349 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.232995 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99963615500019 future=<Future at 0x7e4b407b7fb0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:15.234314 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Instance destroyed successfully.
May 28 03:13:15.234788 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'resources' on Instance uuid 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:15.302375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:15.302710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:15.649772 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00038980700037427596 future=<Future at 0x7e4b645d48c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:15.650345 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Emitting event <LifecycleEvent: 1779937980.6492734, b3b73e16-989c-483c-866f-4e179edfbeef => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:15.650510 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:15.650687 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] VM Stopped (Lifecycle Event)
May 28 03:13:15.651984 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.254109736999908 future=<Future at 0x7e4b407adc70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:15.653287 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.2527754400002777 future=<Future at 0x7e4b407adc70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:15.736969 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-1',id=39,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:08:35Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-2vq8owna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=0eb715c5-e8bf-49d1-8610-d46e7afa4bf4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:15.737455 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "address": "fa:16:3e:12:88:e0", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b6b2f0a-a4", "ovs_interfaceid": "6b6b2f0a-a4ea-4541-8c6e-5bc47a888021", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:15.738125 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6b2f0a-a4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:15.738395 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6b2f0a-a4') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:15.740136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.740136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b6b2f0a-a4, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:15.741491 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.742293 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:15.742907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.743681 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.743852 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8488c997-11a4-4994-8689-c8a2b3db34e7) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:15.744372 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.744949 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:15.745126 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:15.746798 np0000001589 nova-compute[98297]: INFO os_vif [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:88:e0,bridge_name='br-int',has_traffic_filtering=True,id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b6b2f0a-a4')
May 28 03:13:15.747100 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Deleting instance files /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4_del
May 28 03:13:15.748041 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Deletion of /opt/stack/data/nova/instances/0eb715c5-e8bf-49d1-8610-d46e7afa4bf4_del complete
May 28 03:13:15.755878 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:15.756108 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:15.819100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:13:16.153376 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: b3b73e16-989c-483c-866f-4e179edfbeef] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:16.254573 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:13:16.255088 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:16.255414 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:16.255542 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:16.255787 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:16.258458 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:16.343372 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:16.572708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-67c2e148-6590-476e-a5bd-46ab6e9591f7 req-ad9d6620-9202-4fa0-8bcd-0fc3f047e80f service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-vif-deleted-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:16.572848 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-67c2e148-6590-476e-a5bd-46ab6e9591f7 req-ad9d6620-9202-4fa0-8bcd-0fc3f047e80f service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Neutron deleted interface 6b6b2f0a-a4ea-4541-8c6e-5bc47a888021; detaching it from the instance and deleting it from the info cache
May 28 03:13:16.574813 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-67c2e148-6590-476e-a5bd-46ab6e9591f7 req-ad9d6620-9202-4fa0-8bcd-0fc3f047e80f service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Detach interface failed, port_id=6b6b2f0a-a4ea-4541-8c6e-5bc47a888021, reason: Instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:16.765326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.462s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:16.809397 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Deleted allocations for instance 254c1717-ee79-4b55-8cf6-c18a282bf9fb
May 28 03:13:16.833955 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found WWN 3300000006f39dc74 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:13:16.834239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:16.834528 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000006f39dc74', 'path': '/dev/dm-1', 'multipath_id': '3300000006f39dc74'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:16.834651 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000006f39dc74', 'path': '/dev/dm-1', 'multipath_id': '3300000006f39dc74'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:13:16.834906 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.485s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:16.835105 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:13:16.838691 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid 5536af08-bb5c-4170-9b07-61fac08818b2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:16.847328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:16.847867 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:16.848030 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:13:16.849729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:16.850130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:16.850333 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:16.860362 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:16.860362 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:16.865451 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:16.865451 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:16.872288 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff] added
May 28 03:13:16.872288 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:16.872288 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:16.872288 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:16.872288 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:16.872288 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:16.872288 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:16.872613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:16.872613 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:16.872696 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:16.876615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff] added
May 28 03:13:16.876615 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:16.876615 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:16.876615 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:16.876615 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:16.876615 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:16.876615 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:16.876931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:16.876931 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:16.876931 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:17.030419 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:17.121977 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-changed-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:17.121977 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Refreshing instance network info cache due to event network-changed-4b43a2e0-2651-4b1c-8a03-ace93250f6a3. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:13:17.121977 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] Acquiring lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:13:17.122086 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] Acquired lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:13:17.122290 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Refreshing network info cache for port 4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:13:17.161832 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-99bdb911-895f-4a4b-83e3-123f9744d1ed req-38bdb026-1380-4150-9fe1-cc1a465aec14 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-vif-unplugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:17.162339 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-99bdb911-895f-4a4b-83e3-123f9744d1ed req-38bdb026-1380-4150-9fe1-cc1a465aec14 service nova] Acquiring lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:17.162519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-99bdb911-895f-4a4b-83e3-123f9744d1ed req-38bdb026-1380-4150-9fe1-cc1a465aec14 service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:17.162681 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-99bdb911-895f-4a4b-83e3-123f9744d1ed req-38bdb026-1380-4150-9fe1-cc1a465aec14 service nova] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:17.163160 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-99bdb911-895f-4a4b-83e3-123f9744d1ed req-38bdb026-1380-4150-9fe1-cc1a465aec14 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] No waiting events found dispatching network-vif-unplugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:17.163313 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-99bdb911-895f-4a4b-83e3-123f9744d1ed req-38bdb026-1380-4150-9fe1-cc1a465aec14 service nova] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Received event network-vif-unplugged-6b6b2f0a-a4ea-4541-8c6e-5bc47a888021 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:17.341074 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Attempting to attach volume cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:13:17.342427 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:13:17.342427 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:17.342427 np0000001589 nova-compute[98297]:   <alias name="ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f"/>
May 28 03:13:17.342427 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:13:17.342427 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:17.342427 np0000001589 nova-compute[98297]:   <serial>cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f</serial>
May 28 03:13:17.342427 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:17.342427 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:13:17.531979 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Took 1.28 seconds to deallocate network for instance.
May 28 03:13:17.624534 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:17.642184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:17.642356 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:17.642531 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:17.642640 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:17.642736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:17.644523 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Terminating instance
May 28 03:13:17.818241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb03da77-c01d-4c0d-97df-9efd397caadf tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "254c1717-ee79-4b55-8cf6-c18a282bf9fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.325s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:17.873182 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:13:17.879108 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:17.886189 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:17.886189 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.891178 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:17.893835 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:17.893835 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.900371 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.908520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.917044 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.917044 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.917044 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.917044 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.917044 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.917044 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.917044 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:17.917302 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.917302 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.917302 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.917302 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.917302 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.917302 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.917302 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:17.923273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.923273 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.923273 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.923273 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.923273 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.923273 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.923273 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:17.923514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.923514 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.923514 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.923514 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.923514 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.923514 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.923514 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:17.957581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260]
May 28 03:13:17.957581 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260] successful.
May 28 03:13:17.957581 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.958846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260]
May 28 03:13:17.958846 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260] successful.
May 28 03:13:17.958846 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.969435 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.973744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.984987 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.985346 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:17.985575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:17.985575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:17.986727 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('11', '-', '-', 0) found on session 148 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:17.986894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.987706 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:17.987964 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:17.988257 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:17.988257 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:17.989033 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] HCTL ('14', '-', '-', 0) found on session 149 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:17.989143 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:18.003836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 148 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:18.003991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:18.009520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Searching for a device in session 149 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:18.009692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:18.012789 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updated VIF entry in instance network info cache for port 4b43a2e0-2651-4b1c-8a03-ace93250f6a3. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:13:18.013026 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updating instance_info_cache with network_info: [{"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:18.038256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:18.038360 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:18.147126 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:18.164809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.166863 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.182686 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.185929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.201500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.206043 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.445644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.473081 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999682300000131 future=<Future at 0x7e4b4067f6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:18.477637 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Instance destroyed successfully.
May 28 03:13:18.477980 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lazy-loading 'resources' on Instance uuid 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:18.482812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.488290 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.491940 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:18.493041 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:18.506274 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.515901 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f29c624e-4aee-43cc-a74b-853d21e7cf08 req-57093e4c-6fac-4eb6-86aa-d30bf9b060b1 service nova] Releasing lock "refresh_cache-090d3888-c5fe-4b64-8caa-d93fc3f39bf3" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:13:18.647732 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:18.648438 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:18.648612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:18.648712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:18.648881 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] No waiting events found dispatching network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:18.649039 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:18.649178 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:18.649360 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:18.649509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:18.649707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:18.649812 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] No waiting events found dispatching network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:18.649937 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2b580066-5bff-4a24-8a7a-f4087bb434e9 req-e5f4dae8-c46f-45c5-bf62-7b75dfb10330 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:18.798308 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.804777 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.807105 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.832457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.850680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:13:18.907059 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0009875219998320972 future=<Future at 0x7e4b407adc70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:18.907168 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:18.907296 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.2302995559998635 future=<Future at 0x7e4b64504dd0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:18.907377 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.230203696999979 future=<Future at 0x7e4b64504dd0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:18.908047 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779937983.90598, 04163091-a678-44e3-9e68-2572090c60c2 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:18.908321 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Stopped (Lifecycle Event)
May 28 03:13:18.924241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.947509 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.986502 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1249486223',display_name='tempest-TestStampPattern-server-1249486223',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-teststamppattern-server-1249486223',id=49,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKEgysMdWopO6E3aAZPHlXvRqDZ+TYxL5JhnJTwlr4MspE/uoCewfhs6aHx4RT/K6l3FanqteTUkMjEY/GUBECAVHfwAYzhiHcP0zlwzDEZm0H6EvR9YWcZvaI8+O+Z7g==',key_name='tempest-TestStampPattern-70636981',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:10:58Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='367ea52eb22f43adb2cd01467b3473ae',ramdisk_id='',reservation_id='r-4cetocqn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-277675958',owner_user_name='tempest-TestStampPattern-277675958-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:11:57Z,user_data=None,user_id='4e16a5f4c7c34b3f9e725ac1fd8884cd',uuid=090d3888-c5fe-4b64-8caa-d93fc3f39bf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:18.986502 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converting VIF {"id": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "address": "fa:16:3e:ad:99:35", "network": {"id": "7fd5dacd-d382-41f7-8f95-6cd44ecd8279", "bridge": "br-int", "label": "tempest-TestStampPattern-1618280937-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "367ea52eb22f43adb2cd01467b3473ae", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b43a2e0-26", "ovs_interfaceid": "4b43a2e0-2651-4b1c-8a03-ace93250f6a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:18.986943 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:99:35,bridge_name='br-int',has_traffic_filtering=True,id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b43a2e0-26') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:18.987140 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:99:35,bridge_name='br-int',has_traffic_filtering=True,id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b43a2e0-26') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:18.988295 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.988442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b43a2e0-26, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:18.990494 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.991364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:18.992536 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.992746 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64d3955a-8fb2-4c12-8575-020ba9870712) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:18.993237 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.993735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:18.993960 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:18.994788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:18.995849 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:19.000826 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:19.001325 np0000001589 nova-compute[98297]: INFO os_vif [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:99:35,bridge_name='br-int',has_traffic_filtering=True,id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3,network=Network(7fd5dacd-d382-41f7-8f95-6cd44ecd8279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b43a2e0-26')
May 28 03:13:19.002325 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:19.003274 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] No VIF found with MAC fa:16:3e:00:ae:0f, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:13:19.003274 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Deleting instance files /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3_del
May 28 03:13:19.005969 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Deletion of /opt/stack/data/nova/instances/090d3888-c5fe-4b64-8caa-d93fc3f39bf3_del complete
May 28 03:13:19.413277 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:19.503993 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.466s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:19.512020 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 03:13:19.513011 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:19.513267 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:19.513343 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:19.513682 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:19.565154 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocations for instance 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4
May 28 03:13:19.593443 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:19.870930 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found WWN 33000000037ba25cf for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:13:19.872050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:19.872694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== connect_volume: return (5522ms) {'type': 'block', 'scsi_wwn': '33000000037ba25cf', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '33000000037ba25cf'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:19.872842 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000037ba25cf', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '33000000037ba25cf'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:13:19.888192 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bfacf804-3878-41d3-ace4-3a7230f6e278 req-16e1aead-bcc7-4f86-bcd9-aa60828ea7ee service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-deleted-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:19.889314 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-bfacf804-3878-41d3-ace4-3a7230f6e278 req-16e1aead-bcc7-4f86-bcd9-aa60828ea7ee service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Neutron deleted interface 4b43a2e0-2651-4b1c-8a03-ace93250f6a3; detaching it from the instance and deleting it from the info cache
May 28 03:13:19.891133 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bfacf804-3878-41d3-ace4-3a7230f6e278 req-16e1aead-bcc7-4f86-bcd9-aa60828ea7ee service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Detach interface failed, port_id=4b43a2e0-2651-4b1c-8a03-ace93250f6a3, reason: Instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:19.902315 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'attaching', 'instance': '04163091-a678-44e3-9e68-2572090c60c2', 'attached_at': '2026-05-28T03:13:13.000000', 'detached_at': '', 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'serial': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:13:19.902891 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:13:19.903106 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:13:19.903262 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:13:19.918368 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:13:19.918368 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:13:19.918368 np0000001589 nova-compute[98297]:     <volume>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</volume>
May 28 03:13:19.918368 np0000001589 nova-compute[98297]:   </usage>
May 28 03:13:19.918368 np0000001589 nova-compute[98297]: </secret>
May 28 03:13:19.918368 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:13:20.344153 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:20.428000 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:59Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:13:20.428264 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:20.428699 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:20.430839 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] End _get_guest_xml xml=<domain type="qemu">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <uuid>04163091-a678-44e3-9e68-2572090c60c2</uuid>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <name>instance-00000034</name>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-872502143</nova:name>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:13:13</nova:creationTime>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:user uuid="2d927d6b89cf4f0c96580968ea9c3791">tempest-TestEncryptedCinderVolumes-781621704-project-member</nova:user>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:project uuid="0eee8d500ee84b5f86e297c2660e183b">tempest-TestEncryptedCinderVolumes-781621704</nova:project>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <nova:port uuid="84be116e-1e2a-45c8-aec8-8b6a1aac2998">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <system>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <entry name="serial">04163091-a678-44e3-9e68-2572090c60c2</entry>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <entry name="uuid">04163091-a678-44e3-9e68-2572090c60c2</entry>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </system>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <os>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   </os>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <features>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   </features>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   <devices>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </disk>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk.config"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </disk>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <alias name="ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <serial>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</serial>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <encryption format="luks">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:         <secret type="passphrase" uuid="4920bc77-3d5b-475c-a965-d161fb541e1f"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       </encryption>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </disk>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:c7:48:ab"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <target dev="tap84be116e-1e"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </interface>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/console.log" append="off"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </serial>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <video>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </video>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </rng>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:   </devices>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]: </domain>
May 28 03:13:20.430839 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Preparing to wait for external event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:59Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(13),node='np0000001589',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:20.434209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:13:20.435024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.435133 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a47b2b28-a0c8-5a63-9b62-1753952c8978', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:20.436070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.436888 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:20.437065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.439336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.439495 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84be116e-1e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:20.439934 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84be116e-1e, col_values=(('qos', UUID('69e1c9bc-ab1c-4ebf-8e24-c7d78b0976d3')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:20.440202 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84be116e-1e, col_values=(('external_ids', {'iface-id': '84be116e-1e2a-45c8-aec8-8b6a1aac2998', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:48:ab', 'vm-uuid': '04163091-a678-44e3-9e68-2572090c60c2'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:20.441325 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.443114 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:20.449282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.450407 np0000001589 nova-compute[98297]: INFO os_vif [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e')
May 28 03:13:20.550541 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3a10c81e-ead4-4f35-a795-8061ea059362 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.422s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:20.574693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-09f57c95-e086-4bfd-9690-d57b2c386b3c tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "0eb715c5-e8bf-49d1-8610-d46e7afa4bf4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.178s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:20.720947 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:20.721087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:20.721294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:20.721436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:20.721656 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] No waiting events found dispatching network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:20.721656 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received unexpected event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 for instance with vm_state active and task_state deleting.
May 28 03:13:20.721755 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:20.721981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:20.722117 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:20.722192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:20.722328 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] No waiting events found dispatching network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:20.723118 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received unexpected event network-vif-plugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 for instance with vm_state active and task_state deleting.
May 28 03:13:20.723205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:20.723388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:20.723427 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:20.723595 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:20.723650 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] No waiting events found dispatching network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:20.723741 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:20.723829 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:20.723925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Acquiring lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:20.724038 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:20.724170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:20.724282 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] No waiting events found dispatching network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:20.724373 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6950536d-abc7-45f8-bfa4-e4a750cd91ec req-8efdc39e-be2a-4a49-b0fc-28cb77f7f155 service nova] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Received event network-vif-unplugged-4b43a2e0-2651-4b1c-8a03-ace93250f6a3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:20.846436 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Took 1.33 seconds to deallocate network for instance.
May 28 03:13:20.892983 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:20.917739 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:21.000159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:21.056004 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:21.056241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:21.153359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:21.153546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:21.265345 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:21.267255 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:21.291622 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:21.352578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:21.352734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:21.445095 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:21.445282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:21.445414 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:21.445561 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:21.445673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:21.448034 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Terminating instance
May 28 03:13:21.559380 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Detaching volume cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f
May 28 03:13:21.597986 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Attempting to driver detach volume cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f from mountpoint /dev/vdb
May 28 03:13:21.607147 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found disk vdb by alias ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:21.608981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Found disk vdb by alias ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:21.608981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Attempting to detach device vdb from instance 5536af08-bb5c-4170-9b07-61fac08818b2 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:13:21.608981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:21.608981 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:21.608981 np0000001589 nova-compute[98297]:   <alias name="ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f"/>
May 28 03:13:21.608981 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:13:21.608981 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:21.608981 np0000001589 nova-compute[98297]:   <serial>cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f</serial>
May 28 03:13:21.608981 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:21.608981 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:21.608981 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:21.618486 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully detached device vdb from instance 5536af08-bb5c-4170-9b07-61fac08818b2 from the persistent domain config.
May 28 03:13:21.618932 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] (1/8): Attempting to detach device vdb with device alias ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f from instance 5536af08-bb5c-4170-9b07-61fac08818b2 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:13:21.619335 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:21.619335 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:21.619335 np0000001589 nova-compute[98297]:   <alias name="ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f"/>
May 28 03:13:21.619335 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:13:21.619335 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:21.619335 np0000001589 nova-compute[98297]:   <serial>cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f</serial>
May 28 03:13:21.619335 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:21.619335 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:21.619335 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:21.656551 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Detaching volume 9f850e76-a644-43cb-a4b2-e204e14c727f
May 28 03:13:21.703686 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Attempting to driver detach volume 9f850e76-a644-43cb-a4b2-e204e14c727f from mountpoint /dev/vdb
May 28 03:13:21.714304 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Found disk vdb by alias ua-9f850e76-a644-43cb-a4b2-e204e14c727f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:21.715412 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Found disk vdb by alias ua-9f850e76-a644-43cb-a4b2-e204e14c727f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:21.715569 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Attempting to detach device vdb from instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:13:21.715841 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:21.715841 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:21.715841 np0000001589 nova-compute[98297]:   <alias name="ua-9f850e76-a644-43cb-a4b2-e204e14c727f"/>
May 28 03:13:21.715841 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:13:21.715841 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:21.715841 np0000001589 nova-compute[98297]:   <serial>9f850e76-a644-43cb-a4b2-e204e14c727f</serial>
May 28 03:13:21.715841 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:21.715841 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:21.715841 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:21.729668 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully detached device vdb from instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e from the persistent domain config.
May 28 03:13:21.729806 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] (1/8): Attempting to detach device vdb with device alias ua-9f850e76-a644-43cb-a4b2-e204e14c727f from instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:13:21.730024 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:21.730024 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:21.730024 np0000001589 nova-compute[98297]:   <alias name="ua-9f850e76-a644-43cb-a4b2-e204e14c727f"/>
May 28 03:13:21.730024 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:13:21.730024 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:21.730024 np0000001589 nova-compute[98297]:   <serial>9f850e76-a644-43cb-a4b2-e204e14c727f</serial>
May 28 03:13:21.730024 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:13:21.730024 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:21.730024 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:21.843664 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:21.843927 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:21.952328 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:21.952903 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:21.953550 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:21.953550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:21.953674 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:21.953798 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Processing event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:13:21.953952 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:21.954122 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:21.954375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:21.954550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:21.954652 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:21.954788 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-1d3f5afe-e7e4-4e57-8c10-3418e081a742 req-a1bce58b-258f-4ce3-9cc4-acdaa1abfbba service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received unexpected event network-vif-plugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with vm_state resized and task_state resize_reverting.
May 28 03:13:21.981676 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:21.985750 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.007096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.137774 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938002.1359715, 5536af08-bb5c-4170-9b07-61fac08818b2 => ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:13:22.138628 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0010129340003004472 future=<Future at 0x7e4b64504dd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:22.138747 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:22.139701 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f for instance 5536af08-bb5c-4170-9b07-61fac08818b2 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:13:22.139965 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Emitting event <LifecycleEvent: 1779937987.1375334, b00002ac-1bf2-43ff-9836-3aa0f11fdabb => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:22.140160 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] VM Stopped (Lifecycle Event)
May 28 03:13:22.140680 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.6080998789998375 future=<Future at 0x7e4b406cf6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:22.140960 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.607882514999801 future=<Future at 0x7e4b406cf6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:22.144675 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully detached device vdb from instance 5536af08-bb5c-4170-9b07-61fac08818b2 from the live domain config.
May 28 03:13:22.147779 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:13:22.149110 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:22.149355 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:22.149699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:22.149952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:13:22.150070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:13:22.177906 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f02cac3f-5913-41aa-9b58-ea067cd1f7f8 req-f529cb06-b4ef-43f4-b0ed-fdcf0e74e854 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:22.178401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f02cac3f-5913-41aa-9b58-ea067cd1f7f8 req-f529cb06-b4ef-43f4-b0ed-fdcf0e74e854 service nova] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:22.178744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f02cac3f-5913-41aa-9b58-ea067cd1f7f8 req-f529cb06-b4ef-43f4-b0ed-fdcf0e74e854 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:22.179371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f02cac3f-5913-41aa-9b58-ea067cd1f7f8 req-f529cb06-b4ef-43f4-b0ed-fdcf0e74e854 service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:22.179371 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f02cac3f-5913-41aa-9b58-ea067cd1f7f8 req-f529cb06-b4ef-43f4-b0ed-fdcf0e74e854 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] No waiting events found dispatching network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:22.179371 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f02cac3f-5913-41aa-9b58-ea067cd1f7f8 req-f529cb06-b4ef-43f4-b0ed-fdcf0e74e854 service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:22.185612 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.189563 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.189772 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:22.189966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', '147'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:13:22.190063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', '147')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:22.191563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f', '146')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:22.192244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.194821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646c8860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f'): ({'sdd'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:13:22.194821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:13:22.194821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Flush multipath device 3300000006f39dc74 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:13:22.226731 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:22.270764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:22.275065 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938002.2745893, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => ua-9f850e76-a644-43cb-a4b2-e204e14c727f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:13:22.276432 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9f850e76-a644-43cb-a4b2-e204e14c727f for instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:13:22.278871 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully detached device vdb from instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e from the live domain config.
May 28 03:13:22.280298 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:13:22.280580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f850e76-a644-43cb-a4b2-e204e14c727f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:22.280685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:22.322929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:13:22.323101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:13:22.324164 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:13:22.336108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:13:22.336381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:13:22.346745 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:22.352189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.387188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.40.100,3260]
May 28 03:13:22.387188 np0000001589 nova-compute[98297]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.40.100,3260] successful.
May 28 03:13:22.387188 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.406691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.416402 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999673693000204 future=<Future at 0x7e4b646b4ad0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:22.418640 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Instance destroyed successfully.
May 28 03:13:22.420144 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'resources' on Instance uuid b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:22.422320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.452328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.50.100,3260]
May 28 03:13:22.452328 np0000001589 nova-compute[98297]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-cd710e56-e6ed-4fa1-95ee-df3cfaed2b9f, portal: 192.168.50.100,3260] successful.
May 28 03:13:22.452328 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.469854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.470158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:22.470330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] <== disconnect_volume: return (320ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:22.470504 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:13:22.473250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.192s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:22.473513 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f850e76-a644-43cb-a4b2-e204e14c727f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:13:22.473679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsi session list stdout=tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [135] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:22.507733 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '134')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:22.507733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f', '135')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:22.508367 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40531620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:13:22.508553 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:13:22.508779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Flush multipath device 33000000081196cc6 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:13:22.543512 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:22.590172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:22.641960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:13:22.642110 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:13:22.643542 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: b00002ac-1bf2-43ff-9836-3aa0f11fdabb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:22.644401 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:13:22.654992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:13:22.654992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:13:22.666371 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.699417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.40.100,3260]
May 28 03:13:22.699417 np0000001589 nova-compute[98297]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.40.100,3260] successful.
May 28 03:13:22.699417 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.713331 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.724067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.751599 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.50.100,3260]
May 28 03:13:22.751599 np0000001589 nova-compute[98297]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-9f850e76-a644-43cb-a4b2-e204e14c727f, portal: 192.168.50.100,3260] successful.
May 28 03:13:22.751599 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.765585 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:22.765922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:22.765991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] <== disconnect_volume: return (485ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:22.766093 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:13:22.775365 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938002.77513, 04163091-a678-44e3-9e68-2572090c60c2 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:22.775530 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Started (Lifecycle Event)
May 28 03:13:22.776400 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:13:22.781991 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance running successfully.
May 28 03:13:22.782267 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] finish_revert_migration finished successfully. {{(pid=98297) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 28 03:13:22.853647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.501s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:22.897822 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Deleted allocations for instance 090d3888-c5fe-4b64-8caa-d93fc3f39bf3
May 28 03:13:22.921413 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:08:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='multiattach-server-0',id=36,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3ohkFWvpgozls956xnztTnL+dHr3TdCHUu6PP0bWsXazse47VrdezgIvmbHABgfSCN4vnRscE9WNuuJgCYC4YNsjB+neBryHH3mu6PDqkxOkK7GhVN4SGFmmdACLdaag==',key_name='tempest-keypair-1011035342',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:08:15Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-hvoopm8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:08:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=b3c95ae0-6741-420b-baa9-d96e1a8ac6d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:22.921642 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "38a13c7d-8add-4161-b90c-90fa6721ff37", "address": "fa:16:3e:39:93:33", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38a13c7d-8a", "ovs_interfaceid": "38a13c7d-8add-4161-b90c-90fa6721ff37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:22.922147 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:93:33,bridge_name='br-int',has_traffic_filtering=True,id=38a13c7d-8add-4161-b90c-90fa6721ff37,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a13c7d-8a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:22.922360 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:93:33,bridge_name='br-int',has_traffic_filtering=True,id=38a13c7d-8add-4161-b90c-90fa6721ff37,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a13c7d-8a') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:22.923290 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.923598 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38a13c7d-8a, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:22.924771 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.925457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:22.925903 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.926602 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.926729 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed6cbfac-78fa-42a9-beb4-a15ae6e6012c) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:22.927221 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.927721 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:22.927787 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:22.929392 np0000001589 nova-compute[98297]: INFO os_vif [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:93:33,bridge_name='br-int',has_traffic_filtering=True,id=38a13c7d-8add-4161-b90c-90fa6721ff37,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38a13c7d-8a')
May 28 03:13:22.929665 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Deleting instance files /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6_del
May 28 03:13:22.930337 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Deletion of /opt/stack/data/nova/instances/b3c95ae0-6741-420b-baa9-d96e1a8ac6d6_del complete
May 28 03:13:23.021761 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'flavor' on Instance uuid 5536af08-bb5c-4170-9b07-61fac08818b2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:23.092264 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:23.280002 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:23.282832 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:13:23.318902 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'flavor' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:23.438123 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Took 1.48 seconds to destroy the instance on the hypervisor.
May 28 03:13:23.438775 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:23.439041 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:23.439127 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:23.439743 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:23.564022 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:23.751069 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0022927009999875736 future=<Future at 0x7e4b406cf6e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:23.751982 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Emitting event <LifecycleEvent: 1779937988.7486935, 4fabe539-c171-4d50-a5b4-64ee77668e8a => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:23.752148 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] VM Stopped (Lifecycle Event)
May 28 03:13:23.752678 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:23.753208 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.5744433820000268 future=<Future at 0x7e4b6449b9b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:23.753331 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.574300036000295 future=<Future at 0x7e4b6449b9b0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:23.788806 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 28 03:13:23.789119 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938003.7888808, 04163091-a678-44e3-9e68-2572090c60c2 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:23.789294 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Paused (Lifecycle Event)
May 28 03:13:23.855604 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8c0f3b62-40cc-4e85-917e-5b8e1e64ea4e tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance to original state: 'active'
May 28 03:13:23.872651 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-039cc9bd-0bb6-463c-8103-69b05aa31d5f req-1ec9be40-83f0-4b7d-879a-e98f34fd20fe service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-deleted-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:23.873031 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-039cc9bd-0bb6-463c-8103-69b05aa31d5f req-1ec9be40-83f0-4b7d-879a-e98f34fd20fe service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Neutron deleted interface 38a13c7d-8add-4161-b90c-90fa6721ff37; detaching it from the instance and deleting it from the info cache
May 28 03:13:23.875159 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-039cc9bd-0bb6-463c-8103-69b05aa31d5f req-1ec9be40-83f0-4b7d-879a-e98f34fd20fe service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Detach interface failed, port_id=38a13c7d-8add-4161-b90c-90fa6721ff37, reason: Instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:23.906196 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-546e37d4-68a3-4f35-bf28-c1d0a2346e7a tempest-TestStampPattern-277675958 tempest-TestStampPattern-277675958-project-member] Lock "090d3888-c5fe-4b64-8caa-d93fc3f39bf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.264s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:24.027804 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fb28eff8-d927-45d8-8290-d5fe9b5bb873 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.970s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:24.234378 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bf73c1cb-3672-4cd7-ab5b-56567b7ccb8d req-a26ab02f-e075-48fc-97fa-a8ee30b8e8ad service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:24.234468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bf73c1cb-3672-4cd7-ab5b-56567b7ccb8d req-a26ab02f-e075-48fc-97fa-a8ee30b8e8ad service nova] Acquiring lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:24.234596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bf73c1cb-3672-4cd7-ab5b-56567b7ccb8d req-a26ab02f-e075-48fc-97fa-a8ee30b8e8ad service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:24.234718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bf73c1cb-3672-4cd7-ab5b-56567b7ccb8d req-a26ab02f-e075-48fc-97fa-a8ee30b8e8ad service nova] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:24.234828 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bf73c1cb-3672-4cd7-ab5b-56567b7ccb8d req-a26ab02f-e075-48fc-97fa-a8ee30b8e8ad service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] No waiting events found dispatching network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:24.234951 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bf73c1cb-3672-4cd7-ab5b-56567b7ccb8d req-a26ab02f-e075-48fc-97fa-a8ee30b8e8ad service nova] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Received event network-vif-unplugged-38a13c7d-8add-4161-b90c-90fa6721ff37 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:24.254935 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: 4fabe539-c171-4d50-a5b4-64ee77668e8a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:24.292136 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:24.294423 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938004.294112, 04163091-a678-44e3-9e68-2572090c60c2 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:24.294615 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Resumed (Lifecycle Event)
May 28 03:13:24.302606 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:24.334485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:24.334485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:24.334485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:24.334485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:24.334485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:24.334866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f1bb6d61-88c7-4239-8aad-c09068521ac7 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.181s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:24.336784 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Terminating instance
May 28 03:13:24.799494 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:24.801492 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:13:24.813300 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Took 1.37 seconds to deallocate network for instance.
May 28 03:13:24.841646 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:24.875065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:24.909175 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:24.910921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:24.935797 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:24.937854 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:25.202468 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Instance destroyed successfully.
May 28 03:13:25.202971 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lazy-loading 'resources' on Instance uuid 5536af08-bb5c-4170-9b07-61fac08818b2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:25.304202 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999729657999978 future=<Future at 0x7e4b646b5f40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:25.309694 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:25.309918 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:25.344764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:25.344943 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:25.528775 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:25.528976 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:25.529165 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:25.529355 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:25.529479 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:25.531512 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Terminating instance
May 28 03:13:25.705591 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2065603755',display_name='tempest-AttachVolumeNegativeTest-server-2065603755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumenegativetest-server-2065603755',id=55,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPcOsOEyXBorfz6k6uq/UvFyOugSXnZE2vI/BaIaJ6o7XtcBqccXWGVKyqaL59fcUz6VLZXrWnx3NX+sPMidAvpOYC7Izy6dcBwHuNQZtHMJAeBx7Sjv5qH6iS8xiFv3Fg==',key_name='tempest-keypair-1437738668',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:31Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='094dc3cb80814083a18dc5026b895ec5',ramdisk_id='',reservation_id='r-vyq6bv5v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-414697469',owner_user_name='tempest-AttachVolumeNegativeTest-414697469-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fba297a0d43248c883c9b6100d92cae8',uuid=5536af08-bb5c-4170-9b07-61fac08818b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:25.706153 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converting VIF {"id": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "address": "fa:16:3e:00:ae:0f", "network": {"id": "09eed956-7e53-4339-ab01-10f3f019b035", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1111882297-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "094dc3cb80814083a18dc5026b895ec5", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap317630c5-3c", "ovs_interfaceid": "317630c5-3c64-45a5-bf0c-fe46bdb55689", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:25.707091 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:25.707730 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:ae:0f,bridge_name='br-int',has_traffic_filtering=True,id=317630c5-3c64-45a5-bf0c-fe46bdb55689,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317630c5-3c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:25.708028 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:25.709161 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:ae:0f,bridge_name='br-int',has_traffic_filtering=True,id=317630c5-3c64-45a5-bf0c-fe46bdb55689,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317630c5-3c') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:25.710207 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:25.710441 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap317630c5-3c, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:25.711462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:25.712201 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:25.713188 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:25.713929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:25.714088 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51006332-1d0f-4554-b896-1345ac474012) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:25.714515 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:25.714929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:25.715257 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:25.717210 np0000001589 nova-compute[98297]: INFO os_vif [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:ae:0f,bridge_name='br-int',has_traffic_filtering=True,id=317630c5-3c64-45a5-bf0c-fe46bdb55689,network=Network(09eed956-7e53-4339-ab01-10f3f019b035),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap317630c5-3c')
May 28 03:13:25.717470 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Deleting instance files /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2_del
May 28 03:13:25.718110 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Deletion of /opt/stack/data/nova/instances/5536af08-bb5c-4170-9b07-61fac08818b2_del complete
May 28 03:13:25.848175 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Detaching volume 9ea570b2-c55c-41ba-8f2d-b4019fa567ff
May 28 03:13:25.892305 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Attempting to driver detach volume 9ea570b2-c55c-41ba-8f2d-b4019fa567ff from mountpoint /dev/vdb
May 28 03:13:25.944915 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'attaching', 'instance': '04163091-a678-44e3-9e68-2572090c60c2', 'attached_at': '2026-05-28T03:13:13.000000', 'detached_at': '', 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'serial': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:13:25.949125 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:25.950267 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:25.950375 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Attempting to detach device vdb from instance 04163091-a678-44e3-9e68-2572090c60c2 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:13:25.950601 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   <alias name="ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff"/>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   <serial>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</serial>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="4920bc77-3d5b-475c-a965-d161fb541e1f"/>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:25.950601 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:25.955488 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance 04163091-a678-44e3-9e68-2572090c60c2 from the persistent domain config.
May 28 03:13:25.955624 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] (1/8): Attempting to detach device vdb with device alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff from instance 04163091-a678-44e3-9e68-2572090c60c2 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:13:25.955826 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   <alias name="ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff"/>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   <serial>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</serial>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="4920bc77-3d5b-475c-a965-d161fb541e1f"/>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:25.955826 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:26.035677 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:26.054879 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.059349 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.076548 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.210545 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:26.224542 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 03:13:26.225150 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:26.227276 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:26.227276 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:26.227276 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:26.234607 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.239660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.344774 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-vif-unplugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:26.344774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:26.344774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:26.344774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:26.344774 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] No waiting events found dispatching network-vif-unplugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:26.344774 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-vif-unplugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:26.344774 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-vif-unplugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:26.344955 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Acquiring lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:26.345016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:26.345149 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Lock "5536af08-bb5c-4170-9b07-61fac08818b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:26.345302 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] No waiting events found dispatching network-vif-unplugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:26.345452 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-vif-unplugged-317630c5-3c64-45a5-bf0c-fe46bdb55689 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:26.345602 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:26.345776 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:26.345916 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:26.346098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:26.346218 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:26.346715 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9130dd31-be40-4c8b-a07d-1febff732a09 req-70953df3-99a0-4416-be9e-f9e4152fceb4 service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:26.350165 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:26.376310 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999719880000157 future=<Future at 0x7e4b406a8ad0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:26.383612 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Instance destroyed successfully.
May 28 03:13:26.384119 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'resources' on Instance uuid 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:26.720514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.410s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:26.792164 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocations for instance b3c95ae0-6741-420b-baa9-d96e1a8ac6d6
May 28 03:13:26.878205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7282ac09-234f-41c3-9acb-fdbd22d9e576 req-90ee5def-ee66-498d-a0d3-6a7e82b084ad service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Received event network-vif-deleted-317630c5-3c64-45a5-bf0c-fe46bdb55689 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:26.880553 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-7282ac09-234f-41c3-9acb-fdbd22d9e576 req-90ee5def-ee66-498d-a0d3-6a7e82b084ad service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Neutron deleted interface 317630c5-3c64-45a5-bf0c-fe46bdb55689; detaching it from the instance and deleting it from the info cache
May 28 03:13:26.882294 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7282ac09-234f-41c3-9acb-fdbd22d9e576 req-90ee5def-ee66-498d-a0d3-6a7e82b084ad service nova] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Detach interface failed, port_id=317630c5-3c64-45a5-bf0c-fe46bdb55689, reason: Instance 5536af08-bb5c-4170-9b07-61fac08818b2 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:26.888432 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-156457100',display_name='tempest-ServerRescueNegativeTestJSON-server-156457100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-156457100',id=51,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7kD3Q6EZH1F3MDGbGnUsuJRQXycZa80tL/VAcvBthSvvTQiPayA8ZY28K9PY3iV9SgCvY9KtM/k4ckMzkbsBelKLIJccfDKEYc+R8y3bDCNehMq6+tEXjg+MkpvBMLUw==',key_name='tempest-keypair-191609345',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:12:36Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-02rf1ufk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:12:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:26.888667 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "address": "fa:16:3e:e0:12:b8", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e42b07b-f5", "ovs_interfaceid": "6e42b07b-f56c-496d-ab17-b2beb99ff194", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:26.889334 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:26.889630 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:26.892701 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.892953 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e42b07b-f5, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:26.895876 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:26.897762 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.897762 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d9fe97f-6fd4-416a-a8cc-2a9c0b503c23) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:26.897762 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.898323 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:26.898904 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:26.900194 np0000001589 nova-compute[98297]: INFO os_vif [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:12:b8,bridge_name='br-int',has_traffic_filtering=True,id=6e42b07b-f56c-496d-ab17-b2beb99ff194,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e42b07b-f5')
May 28 03:13:26.900513 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Deleting instance files /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e_del
May 28 03:13:26.901426 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Deletion of /opt/stack/data/nova/instances/1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e_del complete
May 28 03:13:27.328033 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00035106499990433804 future=<Future at 0x7e4b6449b9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:27.328584 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779937992.3275828, 254c1717-ee79-4b55-8cf6-c18a282bf9fb => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:27.328719 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:27.328925 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] VM Stopped (Lifecycle Event)
May 28 03:13:27.329095 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.9034975519998625 future=<Future at 0x7e4b407b7fb0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:27.330236 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.902361874000235 future=<Future at 0x7e4b407b7fb0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:27.331697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:27.339406 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:27.407874 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 03:13:27.409588 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:27.409913 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:27.410051 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:27.410297 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:27.467735 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:27.831626 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 254c1717-ee79-4b55-8cf6-c18a282bf9fb] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:27.843552 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d94764be-8ffd-428d-8445-d28beffeef4b tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "b3c95ae0-6741-420b-baa9-d96e1a8ac6d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.398s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:27.844481 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Took 1.62 seconds to deallocate network for instance.
May 28 03:13:28.350453 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:28.350857 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:28.393757 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:28.427819 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c6567a43-6bcd-4b59-87af-b6981773e29b req-f641ea58-4bee-4cc6-83e3-f50b6ddbd76c service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:28.427819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c6567a43-6bcd-4b59-87af-b6981773e29b req-f641ea58-4bee-4cc6-83e3-f50b6ddbd76c service nova] Acquiring lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:28.427819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c6567a43-6bcd-4b59-87af-b6981773e29b req-f641ea58-4bee-4cc6-83e3-f50b6ddbd76c service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:28.427819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c6567a43-6bcd-4b59-87af-b6981773e29b req-f641ea58-4bee-4cc6-83e3-f50b6ddbd76c service nova] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:28.427819 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c6567a43-6bcd-4b59-87af-b6981773e29b req-f641ea58-4bee-4cc6-83e3-f50b6ddbd76c service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] No waiting events found dispatching network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:28.427819 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c6567a43-6bcd-4b59-87af-b6981773e29b req-f641ea58-4bee-4cc6-83e3-f50b6ddbd76c service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-unplugged-6e42b07b-f56c-496d-ab17-b2beb99ff194 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:28.716523 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:28.716713 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:28.895699 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Took 1.49 seconds to deallocate network for instance.
May 28 03:13:28.959389 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b23d9fb-a261-4bdc-bb64-f1a9e3d605ef req-3d5b7fa0-d58c-4a17-9734-3ceae7e40a3e service nova] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Received event network-vif-deleted-6e42b07b-f56c-496d-ab17-b2beb99ff194 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:29.044200 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:29.044482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:29.044645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:29.044784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:29.044893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:29.048592 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Terminating instance
May 28 03:13:29.219107 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:29.225035 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.406564 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:29.551321 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:29.568737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.573595 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.590793 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.594815 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.614982 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.616983 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.729313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.379s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:29.730808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.323s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:29.811650 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Deleted allocations for instance 5536af08-bb5c-4170-9b07-61fac08818b2
May 28 03:13:29.848662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.883060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.884910 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999709089000135 future=<Future at 0x7e4b407f68d0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:29.887005 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:29.904287 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Instance destroyed successfully.
May 28 03:13:29.904287 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lazy-loading 'resources' on Instance uuid 138a2f6c-4e95-4349-b9f6-e4557fe7f546 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:29.904287 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.158360 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:30.158571 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:30.234509 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0018919939998340851 future=<Future at 0x7e4b407b7fb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:30.235300 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Emitting event <LifecycleEvent: 1779937995.2325015, 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:30.235533 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] VM Stopped (Lifecycle Event)
May 28 03:13:30.239818 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:30.243351 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.2294160139999804 future=<Future at 0x7e4b4067f6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:30.243549 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.229238054000234 future=<Future at 0x7e4b4067f6e0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:30.243937 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.251741 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.275304 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.363092 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.385664 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.410559 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:07:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-223705336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-attachvolumemultiattachtest-server-223705336',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:07:57Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52ac8d769a2d4b49807632858d7e6423',ramdisk_id='',reservation_id='r-gmg7v0o6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-1379082653',owner_user_name='tempest-AttachVolumeMultiAttachTest-1379082653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:07:57Z,user_data=None,user_id='ada2cf15d86b4419ab73c67773ff8785',uuid=138a2f6c-4e95-4349-b9f6-e4557fe7f546,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:30.410940 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converting VIF {"id": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "address": "fa:16:3e:f8:75:b3", "network": {"id": "328722f9-6849-46a3-bcc4-8f684f38d965", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-1602259529-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "52ac8d769a2d4b49807632858d7e6423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eeba967-ca", "ovs_interfaceid": "2eeba967-caa5-4c62-b27b-9bc2637e1ef9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:30.411245 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeba967-ca') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:30.411468 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeba967-ca') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:30.412953 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.413104 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eeba967-ca, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:30.414105 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.414970 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.415274 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:30.415713 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.416319 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.416497 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bee93b76-47e5-49e2-be75-15ffaf60af87) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:30.417181 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:30.418203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:30.419415 np0000001589 nova-compute[98297]: INFO os_vif [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9,network=Network(328722f9-6849-46a3-bcc4-8f684f38d965),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eeba967-ca')
May 28 03:13:30.446982 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:13:30.447291 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:30.447467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:30.448172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:30.448172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '30e0fbdc-ff94-459f-8225-6376530e147f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:13:30.448172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:13:30.475565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:30.475565 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:30.475565 np0000001589 nova-compute[98297]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:30.475565 np0000001589 nova-compute[98297]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:30.475565 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:30.475565 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:30.475565 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:30.475796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:30.475796 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:30.475796 np0000001589 nova-compute[98297]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:30.475796 np0000001589 nova-compute[98297]: tcp: [151] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:30.475796 np0000001589 nova-compute[98297]: tcp: [90] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:30.475796 np0000001589 nova-compute[98297]: tcp: [91] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f (non-flash)
May 28 03:13:30.475796 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:30.475951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '150'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '151'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:13:30.475951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '90')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:30.476786 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f', '91')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:30.484141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4069bb00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'): ({'sdh'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:13:30.484460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Removing multipathed devices sdg, sdh {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:13:30.484712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Flush multipath device 33000000030783bfd {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:13:30.543464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:30.597342 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:30.647671 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:13:30.647853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:13:30.648606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:13:30.661126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:13:30.662044 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:30.667141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:13:30.680076 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:30.712572 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 90, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.40.100,3260]
May 28 03:13:30.712572 np0000001589 nova-compute[98297]: Logout of [sid: 90, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.40.100,3260] successful.
May 28 03:13:30.712572 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:30.727210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:30.737245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:30.742280 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: 0eb715c5-e8bf-49d1-8610-d46e7afa4bf4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:30.771019 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 91, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.50.100,3260]
May 28 03:13:30.771019 np0000001589 nova-compute[98297]: Logout of [sid: 91, target: iqn.2023-03.storpool.com:os--volume-30e0fbdc-ff94-459f-8225-6376530e147f, portal: 192.168.50.100,3260] successful.
May 28 03:13:30.771019 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:30.788943 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:30.789232 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:30.789393 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] <== disconnect_volume: return (341ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:30.789487 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:13:30.789721 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Deleting instance files /opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546_del
May 28 03:13:30.790272 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Deletion of /opt/stack/data/nova/instances/138a2f6c-4e95-4349-b9f6-e4557fe7f546_del complete
May 28 03:13:30.820661 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3c615617-412f-450e-b596-942ebd75c8e4 tempest-AttachVolumeNegativeTest-414697469 tempest-AttachVolumeNegativeTest-414697469-project-member] Lock "5536af08-bb5c-4170-9b07-61fac08818b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.488s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:30.959903 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff for instance 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:13:31.035932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:31.037421 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:31.037746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:31.037810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:31.037939 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] No waiting events found dispatching network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:31.038003 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:31.038114 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:31.038241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:31.040287 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:31.040287 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:31.040287 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] No waiting events found dispatching network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:31.040287 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:31.040287 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:31.040287 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:31.040287 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:31.040792 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:31.040792 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] No waiting events found dispatching network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:31.040792 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received unexpected event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 for instance with vm_state active and task_state deleting.
May 28 03:13:31.040792 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:31.040921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:31.041066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:31.042513 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:31.042646 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] No waiting events found dispatching network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:31.042798 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received unexpected event network-vif-plugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 for instance with vm_state active and task_state deleting.
May 28 03:13:31.042932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:31.043076 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:31.043214 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:31.043351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:31.043461 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] No waiting events found dispatching network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:31.043860 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:31.043911 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:31.044067 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Acquiring lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:31.044205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:31.044346 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:31.044754 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] No waiting events found dispatching network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:31.044754 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-09a16e6d-632a-44ba-99e2-919592e30419 req-dc973321-20ad-4377-99ec-4ad4d7d43bfd service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-unplugged-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:31.169873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.440s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:31.230511 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Deleted allocations for instance 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e
May 28 03:13:31.298752 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Took 1.75 seconds to destroy the instance on the hypervisor.
May 28 03:13:31.299437 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:31.299796 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:31.299965 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:31.300206 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:31.378917 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:31.715085 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6272ea27-454c-4b15-b71e-2dddd64d973e req-c1fc1e47-0162-4875-b200-3ba296c5410d service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Received event network-vif-deleted-2eeba967-caa5-4c62-b27b-9bc2637e1ef9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:31.715612 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-6272ea27-454c-4b15-b71e-2dddd64d973e req-c1fc1e47-0162-4875-b200-3ba296c5410d service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Neutron deleted interface 2eeba967-caa5-4c62-b27b-9bc2637e1ef9; detaching it from the instance and deleting it from the info cache
May 28 03:13:31.717829 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6272ea27-454c-4b15-b71e-2dddd64d973e req-c1fc1e47-0162-4875-b200-3ba296c5410d service nova] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Detach interface failed, port_id=2eeba967-caa5-4c62-b27b-9bc2637e1ef9, reason: Instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:32.144568 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:32.241460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e263073e-5432-4b9d-ba41-56aee8579a6b tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.712s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:32.646754 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Took 1.35 seconds to deallocate network for instance.
May 28 03:13:33.094755 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:33.138117 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:33.138658 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:13:33.196216 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Took 0.55 seconds to detach 1 volumes for instance.
May 28 03:13:33.473254 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003872799998134724 future=<Future at 0x7e4b4067f6e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:33.473761 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Emitting event <LifecycleEvent: 1779937998.4726737, 090d3888-c5fe-4b64-8caa-d93fc3f39bf3 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:33.473996 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:33.474185 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] VM Stopped (Lifecycle Event)
May 28 03:13:33.475169 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.940907179000078 future=<Future at 0x7e4b646b4ad0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:33.475316 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.940740439000365 future=<Future at 0x7e4b646b4ad0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:33.702709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:33.702891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:33.967493 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:33.967733 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:33.976904 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 090d3888-c5fe-4b64-8caa-d93fc3f39bf3] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:34.470802 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:34.978110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.275s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:35.071170 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Deleted allocations for instance 138a2f6c-4e95-4349-b9f6-e4557fe7f546
May 28 03:13:35.346993 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:35.347179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:35.347401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:35.347611 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:35.347720 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:35.350017 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Terminating instance
May 28 03:13:35.417582 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:35.856151 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:35.872339 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:35.876400 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:35.895989 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.039683 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d1866afa-5ef7-4a27-a10a-4f154d16e463 req-f1c0b42e-7729-40e7-91f1-3ee6e246a053 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:36.039892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d1866afa-5ef7-4a27-a10a-4f154d16e463 req-f1c0b42e-7729-40e7-91f1-3ee6e246a053 service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:36.040059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d1866afa-5ef7-4a27-a10a-4f154d16e463 req-f1c0b42e-7729-40e7-91f1-3ee6e246a053 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:36.040210 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d1866afa-5ef7-4a27-a10a-4f154d16e463 req-f1c0b42e-7729-40e7-91f1-3ee6e246a053 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:36.041378 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d1866afa-5ef7-4a27-a10a-4f154d16e463 req-f1c0b42e-7729-40e7-91f1-3ee6e246a053 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] No waiting events found dispatching network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:36.041516 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d1866afa-5ef7-4a27-a10a-4f154d16e463 req-f1c0b42e-7729-40e7-91f1-3ee6e246a053 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:36.080668 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc420143-473a-4ab3-b43c-a80128371103 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Lock "138a2f6c-4e95-4349-b9f6-e4557fe7f546" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.036s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:36.085756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.092063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.188922 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999778808999963 future=<Future at 0x7e4b4079e870 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:36.190770 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Instance destroyed successfully.
May 28 03:13:36.191149 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'resources' on Instance uuid 4811783e-66bd-4c41-8a99-e73bc6c22369 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:36.693256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1250321770',display_name='tempest-ServerRescueNegativeTestJSON-server-1250321770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-1250321770',id=48,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:10:58Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-t7ezqaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:10:58Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=4811783e-66bd-4c41-8a99-e73bc6c22369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:36.693513 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "address": "fa:16:3e:7e:fa:65", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba208e14-55", "ovs_interfaceid": "ba208e14-55c6-4fdf-933b-cf2baad34ce4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:36.693929 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:36.694119 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:36.694866 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.695025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba208e14-55, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:36.697123 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.697123 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:36.698025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.698620 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.698759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81f2cc78-93ad-4aa0-86f2-d52812b82380) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:36.703268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.703268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:36.703268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:36.704782 np0000001589 nova-compute[98297]: INFO os_vif [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:fa:65,bridge_name='br-int',has_traffic_filtering=True,id=ba208e14-55c6-4fdf-933b-cf2baad34ce4,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba208e14-55')
May 28 03:13:36.705026 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Deleting instance files /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369_del
May 28 03:13:36.706093 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Deletion of /opt/stack/data/nova/instances/4811783e-66bd-4c41-8a99-e73bc6c22369_del complete
May 28 03:13:36.844960 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:37.137916 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:37.219443 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 03:13:37.220132 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:37.220497 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:37.220648 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:37.220895 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:37.302749 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:37.416517 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004117789999327215 future=<Future at 0x7e4b646b4ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:37.418780 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779938002.416, b3c95ae0-6741-420b-baa9-d96e1a8ac6d6 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:37.418780 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:37.418780 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] VM Stopped (Lifecycle Event)
May 28 03:13:37.418780 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.886646775000372 future=<Future at 0x7e4b646b5f40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:37.418780 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=2.8856511960002535 future=<Future at 0x7e4b646b5f40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:37.641541 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:37.641738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:37.641934 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:37.642143 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:13:37.919732 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: b3c95ae0-6741-420b-baa9-d96e1a8ac6d6] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:38.059436 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:38.114127 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa049448-3d97-4a4c-81eb-dae7812063df req-ffa1e3ea-ac6d-4699-a206-b73630813196 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:38.114313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa049448-3d97-4a4c-81eb-dae7812063df req-ffa1e3ea-ac6d-4699-a206-b73630813196 service nova] Acquiring lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:38.114455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa049448-3d97-4a4c-81eb-dae7812063df req-ffa1e3ea-ac6d-4699-a206-b73630813196 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:38.114583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa049448-3d97-4a4c-81eb-dae7812063df req-ffa1e3ea-ac6d-4699-a206-b73630813196 service nova] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:38.115869 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa049448-3d97-4a4c-81eb-dae7812063df req-ffa1e3ea-ac6d-4699-a206-b73630813196 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] No waiting events found dispatching network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:38.115979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa049448-3d97-4a4c-81eb-dae7812063df req-ffa1e3ea-ac6d-4699-a206-b73630813196 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-unplugged-ba208e14-55c6-4fdf-933b-cf2baad34ce4 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:38.116080 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa049448-3d97-4a4c-81eb-dae7812063df req-ffa1e3ea-ac6d-4699-a206-b73630813196 service nova] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Received event network-vif-deleted-ba208e14-55c6-4fdf-933b-cf2baad34ce4 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:38.396470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:38.396892 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:38.561316 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Took 1.34 seconds to deallocate network for instance.
May 28 03:13:38.675484 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:38.783536 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:13:38.786304 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:38.883511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:13:38.899105 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:38.903292 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:13:39.002250 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:13:39.002752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:39.071277 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:39.072737 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:39.119763 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:13:39.120239 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-2 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:13:39.125311 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:13:39.127592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:39.186463 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.060s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:13:39.187114 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13189MB free_disk=73.6823616027832GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:13:39.187321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:39.259664 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:39.345125 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:39.345422 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:39.467595 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:39.848572 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:40.304408 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004567539999698056 future=<Future at 0x7e4b646b5f40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:40.305029 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Emitting event <LifecycleEvent: 1779938005.30384, 5536af08-bb5c-4170-9b07-61fac08818b2 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:40.305970 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:40.305970 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] VM Stopped (Lifecycle Event)
May 28 03:13:40.306971 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.0690344399999958 future=<Future at 0x7e4b406a8ad0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:40.308250 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.0687841959997968 future=<Future at 0x7e4b406a8ad0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:40.354058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.282s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:40.355206 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.167s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:40.401576 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Deleted allocations for instance 4811783e-66bd-4c41-8a99-e73bc6c22369
May 28 03:13:40.808273 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fa7ca3b5-f94a-43e5-ab17-a7f8ff1be6e3 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5536af08-bb5c-4170-9b07-61fac08818b2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:41.376427 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0002600359998723434 future=<Future at 0x7e4b406a8ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:41.376539 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:41.376664 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.5078604949999317 future=<Future at 0x7e4b407f68d0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:41.376721 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=3.507767563000016 future=<Future at 0x7e4b407f68d0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:41.378036 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] Emitting event <LifecycleEvent: 1779938006.3758047, 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:41.378036 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] VM Stopped (Lifecycle Event)
May 28 03:13:41.410535 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 5683aa74-b79d-4dbf-9a99-796cbff0c04d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:13:41.410805 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 04163091-a678-44e3-9e68-2572090c60c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:13:41.411721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-366e8e69-57ef-4c0e-b8c2-f41ef3018055 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "4811783e-66bd-4c41-8a99-e73bc6c22369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.064s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:41.700063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:41.879373 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6dc4709a-b4df-4bbe-96b3-2968711eee3e tempest-ImageDependencyTests-1045797042 tempest-ImageDependencyTests-1045797042-project-member] [instance: 1e7f9617-6ca1-4bdd-9378-ec3ec4c33a6e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:41.913110 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 36ec36eb-f71f-4df1-b082-a228b94b6ab2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 28 03:13:41.913319 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:13:41.913456 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:13:39 up 41 min,  2 users,  load average: 5.47, 6.55, 4.74\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_9594031941474707b7b4dbe1e8124dde': '1', 'io_workload': '0', 'num_proj_0eee8d500ee84b5f86e297c2660e183b': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:13:42.077809 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:42.077964 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:42.503831 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:42.504026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:42.504189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:42.504351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:42.504466 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:42.506541 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Terminating instance
May 28 03:13:42.580121 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:43.009659 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:43.026294 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.027851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.043671 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.045813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.061726 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.067690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.085822 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:13:43.085973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.732s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:43.086524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.619s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:43.086780 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:13:43.091107 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:13:43.091341 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Claim successful on node np0000001589
May 28 03:13:43.096631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.166870 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-814ca60e-96ae-48f1-9078-b8669a7df603 req-f8a68a9d-50d9-4a40-af08-552fabd995b3 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:43.167415 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-814ca60e-96ae-48f1-9078-b8669a7df603 req-f8a68a9d-50d9-4a40-af08-552fabd995b3 service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:43.167631 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-814ca60e-96ae-48f1-9078-b8669a7df603 req-f8a68a9d-50d9-4a40-af08-552fabd995b3 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:43.167783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-814ca60e-96ae-48f1-9078-b8669a7df603 req-f8a68a9d-50d9-4a40-af08-552fabd995b3 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:43.167941 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-814ca60e-96ae-48f1-9078-b8669a7df603 req-f8a68a9d-50d9-4a40-af08-552fabd995b3 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:43.168096 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-814ca60e-96ae-48f1-9078-b8669a7df603 req-f8a68a9d-50d9-4a40-af08-552fabd995b3 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:43.324081 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999632607999956 future=<Future at 0x7e4b407c1ac0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:43.325581 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Instance destroyed successfully.
May 28 03:13:43.326109 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lazy-loading 'resources' on Instance uuid 5683aa74-b79d-4dbf-9a99-796cbff0c04d {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:43.828455 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:10:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-631836882',display_name='tempest-ServerRescueNegativeTestJSON-server-631836882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-serverrescuenegativetestjson-server-631836882',id=47,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:11:13Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9594031941474707b7b4dbe1e8124dde',ramdisk_id='',reservation_id='r-0jlzqija',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1294831380',owner_user_name='tempest-ServerRescueNegativeTestJSON-1294831380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:11:19Z,user_data=None,user_id='f21fb57a7c104603aa9c06ad57a1ebc8',uuid=5683aa74-b79d-4dbf-9a99-796cbff0c04d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:43.828646 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converting VIF {"id": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "address": "fa:16:3e:8e:4b:79", "network": {"id": "fb024b41-66bc-4c1e-8b10-13f607afe906", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1975828982-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9594031941474707b7b4dbe1e8124dde", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape848b1f6-21", "ovs_interfaceid": "e848b1f6-2106-4918-8d83-ef483c8c12f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:43.829233 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:43.829464 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:43.831115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.831395 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape848b1f6-21, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:43.832265 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.832959 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:43.833080 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.833700 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.833830 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28734349-56af-42e1-8c43-78d3c72831f2) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:43.834233 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:43.834664 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:43.836348 np0000001589 nova-compute[98297]: INFO os_vif [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4b:79,bridge_name='br-int',has_traffic_filtering=True,id=e848b1f6-2106-4918-8d83-ef483c8c12f9,network=Network(fb024b41-66bc-4c1e-8b10-13f607afe906),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape848b1f6-21')
May 28 03:13:43.836616 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Deleting instance files /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d_del
May 28 03:13:43.837889 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Deletion of /opt/stack/data/nova/instances/5683aa74-b79d-4dbf-9a99-796cbff0c04d_del complete
May 28 03:13:44.256530 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:44.256883 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:44.343900 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 03:13:44.344613 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:44.345629 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:44.345810 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:44.346032 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:44.440602 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:44.759182 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:44.884896 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00034728799982985947 future=<Future at 0x7e4b407f68d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:44.885027 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:44.885408 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779938009.8844588, 138a2f6c-4e95-4349-b9f6-e4557fe7f546 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:44.885602 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.303129326000089 future=<Future at 0x7e4b4079e870 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:44.885698 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] VM Stopped (Lifecycle Event)
May 28 03:13:44.887117 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.301571294000041 future=<Future at 0x7e4b4079e870 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:45.086653 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:45.087113 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:45.087489 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:45.087694 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:45.087804 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:13:45.088156 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.05 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:13:45.162686 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:45.219457 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f2623c3-d0bc-4e6f-9851-5c7161d7b55e req-ab850750-07cd-4d5c-9584-09f62f06c504 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:45.219938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f2623c3-d0bc-4e6f-9851-5c7161d7b55e req-ab850750-07cd-4d5c-9584-09f62f06c504 service nova] Acquiring lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:45.220115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f2623c3-d0bc-4e6f-9851-5c7161d7b55e req-ab850750-07cd-4d5c-9584-09f62f06c504 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:45.220252 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1f2623c3-d0bc-4e6f-9851-5c7161d7b55e req-ab850750-07cd-4d5c-9584-09f62f06c504 service nova] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:45.220403 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f2623c3-d0bc-4e6f-9851-5c7161d7b55e req-ab850750-07cd-4d5c-9584-09f62f06c504 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] No waiting events found dispatching network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:45.220522 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f2623c3-d0bc-4e6f-9851-5c7161d7b55e req-ab850750-07cd-4d5c-9584-09f62f06c504 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-unplugged-e848b1f6-2106-4918-8d83-ef483c8c12f9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:45.220614 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1f2623c3-d0bc-4e6f-9851-5c7161d7b55e req-ab850750-07cd-4d5c-9584-09f62f06c504 service nova] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Received event network-vif-deleted-e848b1f6-2106-4918-8d83-ef483c8c12f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:45.267103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.181s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:45.267660 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:13:45.388486 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 138a2f6c-4e95-4349-b9f6-e4557fe7f546] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:45.664663 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Took 1.32 seconds to deallocate network for instance.
May 28 03:13:45.774109 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:13:45.774302 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:13:45.774615 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:45.775026 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:45.841957 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c083fd5d4f04c58b1c5ecc8cae5ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79d7d10d3654992aab71cc666e52080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:13:46.135106 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:46.135570 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:13:46.169388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:46.169595 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:46.277336 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:13:46.308054 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Successfully created port: a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:13:46.365927 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:46.366130 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:46.781116 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:13:46.808687 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Successfully updated port: a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:13:46.848600 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-changed-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:46.848760 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Refreshing instance network info cache due to event network-changed-a09a6cb5-6e93-4e4d-929e-418f2c913c7b. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:13:46.849107 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] Acquiring lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:13:46.849154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] Acquired lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:13:46.849279 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Refreshing network info cache for port a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:13:46.871717 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:47.134037 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:47.134358 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:13:47.137431 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:13:47.138119 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:13:47.284966 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Booting with volume 01da8d8f-ada6-4078-aae3-3fe231cfc35c at /dev/vda
May 28 03:13:47.310485 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:13:47.317854 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:47.328418 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:13:47.346294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:47.359267 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:47.379712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.210s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:47.396404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:13:47.396758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:13:47.405969 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:13:47.406914 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fec7:48ab', 'fe80::24e0:96ff:fee5:ac82'] 
May 28 03:13:47.410129 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:13:47.410378 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:13:47.410563 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:47.410782 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Updating existing volume attachment record: 3762b21a-749a-4523-a3cf-b2133a743c56 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:13:47.448455 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Deleted allocations for instance 5683aa74-b79d-4dbf-9a99-796cbff0c04d
May 28 03:13:47.458185 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:13:47.615514 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:48.097771 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:48.117770 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-226b0692-daa2-4cdd-8ad3-0da7aa3a48c3 req-434ed883-0a57-4535-9233-c89e7acf416b service nova] Releasing lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:13:48.118429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquired lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:13:48.118549 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:13:48.457446 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-29b8d066-3619-48d6-87c8-2a79e6319875 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Lock "5683aa74-b79d-4dbf-9a99-796cbff0c04d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.953s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:48.676470 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:13:48.834715 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:48.837396 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:48.980255 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Updating instance_info_cache with network_info: [{"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:49.479403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Releasing lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:13:49.479810 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Instance network_info: |[{"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:13:49.510196 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:13:49.511206 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:13:49.511623 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Creating image(s)
May 28 03:13:49.511931 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:13:49.512056 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Ensure instance console log exists: /opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:13:49.512274 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:49.512463 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:49.512679 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:49.513053 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Start _get_guest_xml network_info=[{"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '3762b21a-749a-4523-a3cf-b2133a743c56', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '36ec36eb-f71f-4df1-b082-a228b94b6ab2', 'attached_at': '', 'detached_at': '', 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'serial': '01da8d8f-ada6-4078-aae3-3fe231cfc35c'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:13:49.516630 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:13:49.517650 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1670598071', uuid='36ec36eb-f71f-4df1-b082-a228b94b6ab2'), owner=OwnerMeta(userid='3c083fd5d4f04c58b1c5ecc8cae5ffce', username='tempest-TestEncryptedCinderVolumes-124411028-project-member', projectid='f79d7d10d3654992aab71cc666e52080', projectname='tempest-TestEncryptedCinderVolumes-124411028'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938029.5173028) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:13:49.518736 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:13:49.519028 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:13:49.519904 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:13:49.520132 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:13:49.521238 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:13:49.521506 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:13:49.521712 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:13:49.521712 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:13:49.521815 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:13:49.521971 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:13:49.522134 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:13:49.522318 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:13:49.522412 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:13:49.522507 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:13:49.522604 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:13:49.522711 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:13:49.531835 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:13:49.532117 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:49.532245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:49.532822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:49.532989 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:13:49.543749 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:49.544164 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:49.544583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:49.544747 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:13:49.545015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:49.545781 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:49.557568 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:49.557568 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:49.558368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:13:49.558368 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:49.568863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c] added
May 28 03:13:49.568863 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:49.568863 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:49.568863 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:49.568863 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:49.568863 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:49.568863 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:49.569041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:49.569170 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:49.569354 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:49.571692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c] added
May 28 03:13:49.571692 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:13:49.571692 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:49.571692 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:49.571692 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:13:49.571692 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:13:49.571692 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:49.571853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:13:49.571963 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:13:49.572069 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:13:50.257045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:50.569824 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:13:50.572478 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:50.581108 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:50.581108 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:13:50.586494 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:13:50.586494 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.591829 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.597840 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.603625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.603625 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.603625 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:50.603822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.603822 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.603822 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:50.610092 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.610092 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.610092 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:50.610248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.610248 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.610248 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:50.638065 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.40.100,3260]
May 28 03:13:50.638065 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.40.100,3260] successful.
May 28 03:13:50.638065 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.650539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.662596 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.50.100,3260]
May 28 03:13:50.662596 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.50.100,3260] successful.
May 28 03:13:50.662596 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.667470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.667470 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.667470 np0000001589 nova-compute[98297]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.667470 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.667470 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:50.667696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.667696 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.667696 np0000001589 nova-compute[98297]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.667696 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.667696 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:50.667826 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:50.667977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:50.668506 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] HCTL ('7', '-', '-', 0) found on session 152 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:50.668610 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:50.675422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:50.681182 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching for a device in session 152 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:50.681182 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:50.687398 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.687398 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.687398 np0000001589 nova-compute[98297]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.687398 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.687398 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:50.687592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.687592 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:50.687592 np0000001589 nova-compute[98297]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.687592 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:50.687592 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:50.687860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:50.687954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:13:50.688545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] HCTL ('8', '-', '-', 0) found on session 153 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:13:50.688606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:13:50.701023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching for a device in session 153 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:13:50.701023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:13:50.960503 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Waiting for libvirt event about the detach of device vdb with device alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff from instance 04163091-a678-44e3-9e68-2572090c60c2 is timed out.
May 28 03:13:50.962483 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Found disk vdb by alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:13:50.962666 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Failed to detach device vdb with device alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff from instance 04163091-a678-44e3-9e68-2572090c60c2 from the live domain config. Libvirt did not report any error but the device is still in the config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2694}}
May 28 03:13:50.962744 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] (2/8): Attempting to detach device vdb with device alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff from instance 04163091-a678-44e3-9e68-2572090c60c2 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:13:50.962973 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   <alias name="ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff"/>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   <serial>9ea570b2-c55c-41ba-8f2d-b4019fa567ff</serial>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="4920bc77-3d5b-475c-a965-d161fb541e1f"/>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]: </disk>
May 28 03:13:50.962973 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:13:51.189079 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00037380000003395253 future=<Future at 0x7e4b4079e870 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:51.189177 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:51.189311 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.1343171950002215 future=<Future at 0x7e4b407c1ac0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:51.189393 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.1342229300003055 future=<Future at 0x7e4b407c1ac0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:51.190236 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] Emitting event <LifecycleEvent: 1779938016.1886265, 4811783e-66bd-4c41-8a99-e73bc6c22369 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:51.190442 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] VM Stopped (Lifecycle Event)
May 28 03:13:51.459991 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938031.4596007, 04163091-a678-44e3-9e68-2572090c60c2 => ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:13:51.460919 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9ea570b2-c55c-41ba-8f2d-b4019fa567ff for instance 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:13:51.463065 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully detached device vdb from instance 04163091-a678-44e3-9e68-2572090c60c2 from the live domain config.
May 28 03:13:51.465985 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:13:51.465985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:13:51.465985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:13:51.545215 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:13:51.692969 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-54192a7e-abfb-4c18-8597-71c39bc69de2 tempest-ServerRescueNegativeTestJSON-1294831380 tempest-ServerRescueNegativeTestJSON-1294831380-project-member] [instance: 4811783e-66bd-4c41-8a99-e73bc6c22369] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:51.770064 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:13:52.561363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Found WWN 330000000b69d6386 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:13:52.561623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:52.562240 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.096s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:13:52.562881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000b69d6386', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b69d6386'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:52.563168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:13:52.563519 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b69d6386', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000b69d6386'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:13:52.563740 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:13:52.590931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:52.590931 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:52.590931 np0000001589 nova-compute[98297]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:52.590931 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:52.590931 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:13:52.591083 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsi session list stdout=tcp: [148] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:52.591083 np0000001589 nova-compute[98297]: tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff (non-flash)
May 28 03:13:52.591083 np0000001589 nova-compute[98297]: tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:52.591083 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:13:52.591083 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:13:52.591296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '148'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '153')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:13:52.592448 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '148')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:52.593305 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '36ec36eb-f71f-4df1-b082-a228b94b6ab2', 'attached_at': '', 'detached_at': '', 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'serial': '01da8d8f-ada6-4078-aae3-3fe231cfc35c'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:13:52.593982 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:13:52.594350 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:13:52.594603 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:13:52.596136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff', '149')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:13:52.596851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b80113420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'): ({'sdi'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:13:52.597020 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Removing multipathed devices sdf, sdi {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:13:52.597269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Flush multipath device 33000000037ba25cf {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:13:52.609659 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:13:52.609659 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:13:52.609659 np0000001589 nova-compute[98297]:     <volume>01da8d8f-ada6-4078-aae3-3fe231cfc35c</volume>
May 28 03:13:52.609659 np0000001589 nova-compute[98297]:   </usage>
May 28 03:13:52.609659 np0000001589 nova-compute[98297]: </secret>
May 28 03:13:52.609659 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:13:52.631118 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:52.668938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:13:52.710484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:13:52.710794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] SCSI volumes sdf, sdi have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:13:52.711347 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Checking to see if device paths {'sdf', 'sdi'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:13:52.721819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Device paths {'sdf', 'sdi'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:13:52.722080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:13:52.732113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:52.763112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260]
May 28 03:13:52.763112 np0000001589 nova-compute[98297]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.40.100,3260] successful.
May 28 03:13:52.763112 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:52.776416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:52.787401 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:52.811906 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260]
May 28 03:13:52.811906 np0000001589 nova-compute[98297]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-9ea570b2-c55c-41ba-8f2d-b4019fa567ff, portal: 192.168.50.100,3260] successful.
May 28 03:13:52.811906 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:52.823827 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:13:52.824843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:13:52.824843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] <== disconnect_volume: return (1359ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:13:52.824843 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:13:53.099301 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:53.119453 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1670598071',display_name='tempest-TestEncryptedCinderVolumes-server-1670598071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-1670598071',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi3vJNnDIElDEAAwxPUVBXZKn7sMCbEuglEXeMuNQartNpc8N/d1RU1Uw75nYeLhX6jbFMlPSftQ7+doVErlwwXTaS2ozDh0aq8sEOq1mhbuF2kYDA+aAw4tl2xir1Z7w==',key_name='tempest-TestEncryptedCinderVolumes-336152319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-zyuxoqha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:13:47Z,user_data=None,user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=36ec36eb-f71f-4df1-b082-a228b94b6ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:13:53.119727 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:53.120334 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:78:94,bridge_name='br-int',has_traffic_filtering=True,id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09a6cb5-6e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:53.121419 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'pci_devices' on Instance uuid 36ec36eb-f71f-4df1-b082-a228b94b6ab2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:53.367619 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'flavor' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:53.624180 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] End _get_guest_xml xml=<domain type="qemu">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <uuid>36ec36eb-f71f-4df1-b082-a228b94b6ab2</uuid>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <name>instance-00000039</name>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1670598071</nova:name>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:13:49</nova:creationTime>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:user uuid="3c083fd5d4f04c58b1c5ecc8cae5ffce">tempest-TestEncryptedCinderVolumes-124411028-project-member</nova:user>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:project uuid="f79d7d10d3654992aab71cc666e52080">tempest-TestEncryptedCinderVolumes-124411028</nova:project>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <nova:port uuid="a09a6cb5-6e93-4e4d-929e-418f2c913c7b">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <system>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <entry name="serial">36ec36eb-f71f-4df1-b082-a228b94b6ab2</entry>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <entry name="uuid">36ec36eb-f71f-4df1-b082-a228b94b6ab2</entry>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </system>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <os>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   </os>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <features>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   </features>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   <devices>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2/disk.config"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </disk>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <alias name="ua-01da8d8f-ada6-4078-aae3-3fe231cfc35c"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <serial>01da8d8f-ada6-4078-aae3-3fe231cfc35c</serial>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <encryption format="luks">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:         <secret type="passphrase" uuid="b58910e2-303a-4b70-b74d-f698d0330ed5"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       </encryption>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </disk>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:14:78:94"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <target dev="tapa09a6cb5-6e"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </interface>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2/console.log" append="off"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </serial>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <video>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </video>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </rng>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:   </devices>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]: </domain>
May 28 03:13:53.624180 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:13:53.626324 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Preparing to wait for external event network-vif-plugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:13:53.626324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:53.626324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:53.626324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:53.626324 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1670598071',display_name='tempest-TestEncryptedCinderVolumes-server-1670598071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-1670598071',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi3vJNnDIElDEAAwxPUVBXZKn7sMCbEuglEXeMuNQartNpc8N/d1RU1Uw75nYeLhX6jbFMlPSftQ7+doVErlwwXTaS2ozDh0aq8sEOq1mhbuF2kYDA+aAw4tl2xir1Z7w==',key_name='tempest-TestEncryptedCinderVolumes-336152319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-zyuxoqha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:13:47Z,user_data=None,user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=36ec36eb-f71f-4df1-b082-a228b94b6ab2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:13:53.626324 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:53.626324 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:78:94,bridge_name='br-int',has_traffic_filtering=True,id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09a6cb5-6e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:53.626655 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:78:94,bridge_name='br-int',has_traffic_filtering=True,id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09a6cb5-6e') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:13:53.626957 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:53.627294 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:53.627522 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:13:53.628348 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:53.628500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99629840-c073-5af7-b456-e1b81d14b012', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:53.649997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:53.651397 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:53.653725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:53.653946 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa09a6cb5-6e, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:53.654428 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa09a6cb5-6e, col_values=(('qos', UUID('7e20324f-1ce7-4f44-b335-785397a71a9d')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:53.654651 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa09a6cb5-6e, col_values=(('external_ids', {'iface-id': 'a09a6cb5-6e93-4e4d-929e-418f2c913c7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:78:94', 'vm-uuid': '36ec36eb-f71f-4df1-b082-a228b94b6ab2'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:53.655660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:53.657250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:53.661456 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:53.662525 np0000001589 nova-compute[98297]: INFO os_vif [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:78:94,bridge_name='br-int',has_traffic_filtering=True,id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09a6cb5-6e')
May 28 03:13:54.372774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3004de71-5fe0-429e-aee8-2835569a0601 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:54.577870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:54.578023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:54.578176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:54.578318 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:54.578407 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:54.580138 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Terminating instance
May 28 03:13:55.083772 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:13:55.107422 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.123778 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.125151 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.154789 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.177684 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:55.177812 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:13:55.177921 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No VIF found with MAC fa:16:3e:14:78:94, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:13:55.178403 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Using config drive
May 28 03:13:55.237443 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-176fe8b3-e420-4188-95e4-6bbffbbfafea req-8203983b-3601-465d-9e44-913d68345746 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:55.237970 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-176fe8b3-e420-4188-95e4-6bbffbbfafea req-8203983b-3601-465d-9e44-913d68345746 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:55.238138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-176fe8b3-e420-4188-95e4-6bbffbbfafea req-8203983b-3601-465d-9e44-913d68345746 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:55.238253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-176fe8b3-e420-4188-95e4-6bbffbbfafea req-8203983b-3601-465d-9e44-913d68345746 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:55.238376 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-176fe8b3-e420-4188-95e4-6bbffbbfafea req-8203983b-3601-465d-9e44-913d68345746 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:55.238485 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-176fe8b3-e420-4188-95e4-6bbffbbfafea req-8203983b-3601-465d-9e44-913d68345746 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:55.399938 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999717855999734 future=<Future at 0x7e4b781dba40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:55.401760 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Instance destroyed successfully.
May 28 03:13:55.402280 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lazy-loading 'resources' on Instance uuid 04163091-a678-44e3-9e68-2572090c60c2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:13:55.683126 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:55.795580 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Creating config drive at /opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2/disk.config
May 28 03:13:55.799270 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr665bojr {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:13:55.862509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr665bojr" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:13:55.906330 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-872502143',display_name='tempest-TestEncryptedCinderVolumes-server-872502143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-872502143',id=52,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVddGFRjmD9jgibVb4Z9Fww5R7czz3+uF+I192tH1lRG+FzlKSeYg61+0JXGhkvkWG6fgi4RHN8Is08dxuRrasE7eqC5EJHjNSnp+MrNMTomalTJ8NsuEiYRBdmpLNWsA==',key_name='tempest-keypair-1163923866',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:13:23Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0eee8d500ee84b5f86e297c2660e183b',ramdisk_id='',reservation_id='r-965afcx0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-781621704',owner_user_name='tempest-TestEncryptedCinderVolumes-781621704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:13:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d927d6b89cf4f0c96580968ea9c3791',uuid=04163091-a678-44e3-9e68-2572090c60c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:13:55.906539 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converting VIF {"id": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "address": "fa:16:3e:c7:48:ab", "network": {"id": "fd63d79b-c916-4ffd-974f-016fe074eb9b", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1191494358-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "0eee8d500ee84b5f86e297c2660e183b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap84be116e-1e", "ovs_interfaceid": "84be116e-1e2a-45c8-aec8-8b6a1aac2998", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:13:55.907450 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:13:55.907693 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:13:55.909086 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.909430 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84be116e-1e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:55.911511 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:55.917794 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.918469 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.918610 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69e1c9bc-ab1c-4ebf-8e24-c7d78b0976d3) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:13:55.919336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.919756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:13:55.924985 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:55.927281 np0000001589 nova-compute[98297]: INFO os_vif [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:48:ab,bridge_name='br-int',has_traffic_filtering=True,id=84be116e-1e2a-45c8-aec8-8b6a1aac2998,network=Network(fd63d79b-c916-4ffd-974f-016fe074eb9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84be116e-1e')
May 28 03:13:55.928877 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Deleting instance files /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_del
May 28 03:13:55.934467 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Deletion of /opt/stack/data/nova/instances/04163091-a678-44e3-9e68-2572090c60c2_del complete
May 28 03:13:56.270465 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:56.291617 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:56.293174 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:56.379716 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:56.386178 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:56.444842 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e8b10f7c-7590-4fd2-b811-0c2ba1ad012d req-ef770488-227b-4e88-82bf-cb9ae1274845 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-vif-plugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:56.445180 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e8b10f7c-7590-4fd2-b811-0c2ba1ad012d req-ef770488-227b-4e88-82bf-cb9ae1274845 service nova] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:56.445514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e8b10f7c-7590-4fd2-b811-0c2ba1ad012d req-ef770488-227b-4e88-82bf-cb9ae1274845 service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:56.448521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e8b10f7c-7590-4fd2-b811-0c2ba1ad012d req-ef770488-227b-4e88-82bf-cb9ae1274845 service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:56.448619 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e8b10f7c-7590-4fd2-b811-0c2ba1ad012d req-ef770488-227b-4e88-82bf-cb9ae1274845 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Processing event network-vif-plugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:13:56.449981 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Took 1.37 seconds to destroy the instance on the hypervisor.
May 28 03:13:56.450940 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:13:56.451205 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:13:56.451357 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:13:56.451704 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:56.542890 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:13:56.629071 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:56.662199 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:56.662199 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:57.011584 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56fe7d49-deed-4fcb-8fcd-bf8b3ed8759d req-7c5bfb49-ea3e-4eb7-9e32-f495be0a72f9 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-deleted-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:57.011726 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-56fe7d49-deed-4fcb-8fcd-bf8b3ed8759d req-7c5bfb49-ea3e-4eb7-9e32-f495be0a72f9 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Neutron deleted interface 84be116e-1e2a-45c8-aec8-8b6a1aac2998; detaching it from the instance and deleting it from the info cache
May 28 03:13:57.013775 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56fe7d49-deed-4fcb-8fcd-bf8b3ed8759d req-7c5bfb49-ea3e-4eb7-9e32-f495be0a72f9 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Detach interface failed, port_id=84be116e-1e2a-45c8-aec8-8b6a1aac2998, reason: Instance 04163091-a678-44e3-9e68-2572090c60c2 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:13:57.311913 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ff45e480-1629-4f38-b5ff-490f1dadf869 req-fc1c8a80-d9cd-49a0-be82-961040e1aac3 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:57.312359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff45e480-1629-4f38-b5ff-490f1dadf869 req-fc1c8a80-d9cd-49a0-be82-961040e1aac3 service nova] Acquiring lock "04163091-a678-44e3-9e68-2572090c60c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:57.312594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff45e480-1629-4f38-b5ff-490f1dadf869 req-fc1c8a80-d9cd-49a0-be82-961040e1aac3 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:57.312896 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff45e480-1629-4f38-b5ff-490f1dadf869 req-fc1c8a80-d9cd-49a0-be82-961040e1aac3 service nova] Lock "04163091-a678-44e3-9e68-2572090c60c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:57.313163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ff45e480-1629-4f38-b5ff-490f1dadf869 req-fc1c8a80-d9cd-49a0-be82-961040e1aac3 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] No waiting events found dispatching network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:57.313469 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ff45e480-1629-4f38-b5ff-490f1dadf869 req-fc1c8a80-d9cd-49a0-be82-961040e1aac3 service nova] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Received event network-vif-unplugged-84be116e-1e2a-45c8-aec8-8b6a1aac2998 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:13:57.466733 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:13:57.845465 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938037.8450167, 36ec36eb-f71f-4df1-b082-a228b94b6ab2 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:57.845732 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] VM Started (Lifecycle Event)
May 28 03:13:57.847633 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:13:57.850617 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:13:57.852614 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Instance spawned successfully.
May 28 03:13:57.853451 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:13:57.968590 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Took 1.52 seconds to deallocate network for instance.
May 28 03:13:58.099698 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:13:58.323990 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00032854699975359836 future=<Future at 0x7e4b407c1ac0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:58.324115 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:58.324165 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=12.0754679759998 future=<Future at 0x7e4b781dba40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:58.324237 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=12.075389109999833 future=<Future at 0x7e4b781dba40 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:13:58.324812 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779938023.3235505, 5683aa74-b79d-4dbf-9a99-796cbff0c04d => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:58.325006 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] VM Stopped (Lifecycle Event)
May 28 03:13:58.348670 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:58.350654 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:13:58.359503 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:13:58.359627 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:13:58.359864 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:13:58.360046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:13:58.360286 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:13:58.360548 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:13:58.475166 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:58.475539 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:58.508435 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-92380849-b43b-4029-91ec-aca2bb9a7f9b req-8d1b69dd-2837-495d-b014-5a367a779d54 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-vif-plugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:13:58.508597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-92380849-b43b-4029-91ec-aca2bb9a7f9b req-8d1b69dd-2837-495d-b014-5a367a779d54 service nova] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:13:58.508982 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-92380849-b43b-4029-91ec-aca2bb9a7f9b req-8d1b69dd-2837-495d-b014-5a367a779d54 service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:13:58.509111 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-92380849-b43b-4029-91ec-aca2bb9a7f9b req-8d1b69dd-2837-495d-b014-5a367a779d54 service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:58.509235 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-92380849-b43b-4029-91ec-aca2bb9a7f9b req-8d1b69dd-2837-495d-b014-5a367a779d54 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] No waiting events found dispatching network-vif-plugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:13:58.509411 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-92380849-b43b-4029-91ec-aca2bb9a7f9b req-8d1b69dd-2837-495d-b014-5a367a779d54 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received unexpected event network-vif-plugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b for instance with vm_state building and task_state spawning.
May 28 03:13:58.636029 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:13:58.636252 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:13:58.829966 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0c4c0dba-eb1c-4538-a8e7-ab30c80a74df tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 5683aa74-b79d-4dbf-9a99-796cbff0c04d] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:58.853447 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:13:58.853447 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938038.8532188, 36ec36eb-f71f-4df1-b082-a228b94b6ab2 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:58.853527 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] VM Paused (Lifecycle Event)
May 28 03:13:58.865353 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Took 9.35 seconds to spawn the instance on the hypervisor.
May 28 03:13:58.865462 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:59.139739 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:13:59.358557 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:59.362349 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938039.3621404, 36ec36eb-f71f-4df1-b082-a228b94b6ab2 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:13:59.362451 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] VM Resumed (Lifecycle Event)
May 28 03:13:59.374785 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Took 19.95 seconds to build instance.
May 28 03:13:59.646242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.171s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:13:59.702444 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Deleted allocations for instance 04163091-a678-44e3-9e68-2572090c60c2
May 28 03:13:59.864705 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:13:59.867988 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:13:59.879935 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.483s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:00.710902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f403fc59-ffa0-4ac7-a887-519831e41242 tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Lock "04163091-a678-44e3-9e68-2572090c60c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:00.919677 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:01.173668 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-changed-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:01.173865 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Refreshing instance network info cache due to event network-changed-a09a6cb5-6e93-4e4d-929e-418f2c913c7b. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:14:01.174662 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] Acquiring lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:01.174768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] Acquired lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:01.174886 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Refreshing network info cache for port a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:14:01.677729 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:01.955549 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:02.076387 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Updated VIF entry in instance network info cache for port a09a6cb5-6e93-4e4d-929e-418f2c913c7b. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:14:02.076645 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Updating instance_info_cache with network_info: [{"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:02.578535 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3bae7262-e02a-4b90-bd1d-977916a34149 req-038278a6-ce4b-4000-bb4b-2987f08a688d service nova] Releasing lock "refresh_cache-36ec36eb-f71f-4df1-b082-a228b94b6ab2" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:03.101539 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:04.087139 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:05.892834 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:05.920962 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:05.942471 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:07.518989 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:08.102810 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:09.942924 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:10.286553 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:10.286708 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:10.393629 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:10.401763 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003068830001211609 future=<Future at 0x7e4b781dba40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:10.401763 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:10.401763 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Emitting event <LifecycleEvent: 1779938035.39957, 04163091-a678-44e3-9e68-2572090c60c2 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:10.401763 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] VM Stopped (Lifecycle Event)
May 28 03:14:10.788681 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:14:10.904075 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-988dd911-66c0-4661-93c7-ac04cf2ce4b2 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 04163091-a678-44e3-9e68-2572090c60c2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:10.940807 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:11.354189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:11.354664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:11.358533 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:14:11.358693 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Claim successful on node np0000001589
May 28 03:14:12.415873 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:12.503761 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:12.503958 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:13.006613 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:13.103941 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:13.512767 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.158s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:13.513788 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:14:14.021672 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:14:14.021903 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:14:14.022169 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:14.022501 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:14.131289 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '833c35fdd92b4929b9f3c40ffb29b3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6a1526383440ceb5b3f69f7492d966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:14:14.525781 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:14:14.697498 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Successfully created port: b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:14:15.029266 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:14:15.154998 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Successfully updated port: b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:14:15.199543 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-changed-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:15.199998 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Refreshing instance network info cache due to event network-changed-b4b8a525-ce57-4aeb-a291-a3f999bebb3b. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:14:15.200156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] Acquiring lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:15.200302 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] Acquired lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:15.200527 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Refreshing network info cache for port b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:14:15.656793 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:15.703246 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:15.756900 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:15.884260 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:15.942388 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:16.035043 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:14:16.035843 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:14:16.036069 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Creating image(s)
May 28 03:14:16.036451 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:16.036581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "/opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:16.036994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "/opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:16.037528 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:16.039836 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:16.040990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:16.141326 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:16.149465 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:16.150623 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:16.154336 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:16.154785 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:16.157505 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:16.158436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:16.249354 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:16.250268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:16.321018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk 1073741824" returned: 0 in 0.070s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:16.321842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:16.322281 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:16.389003 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ea8492a1-987d-4ae0-b5d3-7ac06ec51d8c req-bf3800b6-7ee1-4ce1-9a4b-f0ee1cede989 service nova] Releasing lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:16.389371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquired lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:16.389603 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:14:16.419357 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.097s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:16.419764 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:14:16.420018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:16.510925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:16.511290 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Cannot resize image /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:14:16.511795 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:14:16.511951 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Ensure instance console log exists: /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:14:16.512493 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:16.512773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:16.512773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:16.971734 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:17.579459 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:17.594280 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:17.741326 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Updating instance_info_cache with network_info: [{"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:18.106271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:18.244380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Releasing lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:18.244752 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Instance network_info: |[{"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:14:18.246953 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Start _get_guest_xml network_info=[{"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:14:18.251503 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:14:18.253075 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1523192767', uuid='b3f12e09-b318-4eb0-96cd-480a98f33784'), owner=OwnerMeta(userid='833c35fdd92b4929b9f3c40ffb29b3c5', username='tempest-VolumesBackupsTest-1005474821-project-member', projectid='8a6a1526383440ceb5b3f69f7492d966', projectname='tempest-VolumesBackupsTest-1005474821'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938058.2526388) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:14:18.254462 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:14:18.254851 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:14:18.256195 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:14:18.256382 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:14:18.257451 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:14:18.257731 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:14:18.257858 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:14:18.257941 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:14:18.258081 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:14:18.258186 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:14:18.258294 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:14:18.258442 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:14:18.258555 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:14:18.258654 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:14:18.258750 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:14:18.258860 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:14:18.269057 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1523192767',display_name='tempest-VolumesBackupsTest-instance-1523192767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesbackupstest-instance-1523192767',id=58,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1NAY+mgQzyaBhPCNN6ZZWoEkBTpti1QTNI2bm6cwOvD3Z/uo4DOyQBhWf5XfkDJCoee9Kr0I6+uCSh2c2aukLqq70xiJ1HiwcoNARZt6RzqC5xFd793JkcG0tptTAXVw==',key_name='tempest-keypair-1506203207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6a1526383440ceb5b3f69f7492d966',ramdisk_id='',reservation_id='r-q4uem06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1005474821',owner_user_name='tempest-VolumesBackupsTest-1005474821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='833c35fdd92b4929b9f3c40ffb29b3c5',uuid=b3f12e09-b318-4eb0-96cd-480a98f33784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:14:18.269245 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converting VIF {"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:18.269789 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:95:a5,bridge_name='br-int',has_traffic_filtering=True,id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b8a525-ce') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:18.270544 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'pci_devices' on Instance uuid b3f12e09-b318-4eb0-96cd-480a98f33784 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:14:18.773273 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] End _get_guest_xml xml=<domain type="qemu">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <uuid>b3f12e09-b318-4eb0-96cd-480a98f33784</uuid>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <name>instance-0000003a</name>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesBackupsTest-instance-1523192767</nova:name>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:14:18</nova:creationTime>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:user uuid="833c35fdd92b4929b9f3c40ffb29b3c5">tempest-VolumesBackupsTest-1005474821-project-member</nova:user>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:project uuid="8a6a1526383440ceb5b3f69f7492d966">tempest-VolumesBackupsTest-1005474821</nova:project>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         <nova:port uuid="b4b8a525-ce57-4aeb-a291-a3f999bebb3b">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <system>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <entry name="serial">b3f12e09-b318-4eb0-96cd-480a98f33784</entry>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <entry name="uuid">b3f12e09-b318-4eb0-96cd-480a98f33784</entry>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </system>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <os>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   </os>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <features>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   </features>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   <devices>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </disk>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk.config"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </disk>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:64:95:a5"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <target dev="tapb4b8a525-ce"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </interface>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/console.log" append="off"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </serial>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <video>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </video>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </rng>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:   </devices>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]: </domain>
May 28 03:14:18.773273 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:14:18.775185 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Preparing to wait for external event network-vif-plugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:14:18.775185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:18.775185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:18.775185 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:18.775185 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1523192767',display_name='tempest-VolumesBackupsTest-instance-1523192767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesbackupstest-instance-1523192767',id=58,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1NAY+mgQzyaBhPCNN6ZZWoEkBTpti1QTNI2bm6cwOvD3Z/uo4DOyQBhWf5XfkDJCoee9Kr0I6+uCSh2c2aukLqq70xiJ1HiwcoNARZt6RzqC5xFd793JkcG0tptTAXVw==',key_name='tempest-keypair-1506203207',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6a1526383440ceb5b3f69f7492d966',ramdisk_id='',reservation_id='r-q4uem06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1005474821',owner_user_name='tempest-VolumesBackupsTest-1005474821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='833c35fdd92b4929b9f3c40ffb29b3c5',uuid=b3f12e09-b318-4eb0-96cd-480a98f33784,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:14:18.775185 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converting VIF {"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:18.775185 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:95:a5,bridge_name='br-int',has_traffic_filtering=True,id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b8a525-ce') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:18.775510 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:95:a5,bridge_name='br-int',has_traffic_filtering=True,id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b8a525-ce') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:14:18.775710 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:18.776084 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:18.776415 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:14:18.777000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:18.777264 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '785c7657-478b-5771-9741-8f99d9ec905a', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:18.791469 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:18.792744 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:18.794290 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:18.794496 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4b8a525-ce, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:18.794918 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4b8a525-ce, col_values=(('qos', UUID('82168151-a8ce-46c0-b07a-a664e1c90e96')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:18.795112 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4b8a525-ce, col_values=(('external_ids', {'iface-id': 'b4b8a525-ce57-4aeb-a291-a3f999bebb3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:95:a5', 'vm-uuid': 'b3f12e09-b318-4eb0-96cd-480a98f33784'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:18.795968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:18.797507 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:18.801062 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:18.801973 np0000001589 nova-compute[98297]: INFO os_vif [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:95:a5,bridge_name='br-int',has_traffic_filtering=True,id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b8a525-ce')
May 28 03:14:20.315683 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:14:20.316052 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:14:20.316052 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No VIF found with MAC fa:16:3e:64:95:a5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:14:20.316349 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Using config drive
May 28 03:14:20.822393 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:20.946644 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Creating config drive at /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk.config
May 28 03:14:20.950564 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmx73hs7y {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:21.021762 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmx73hs7y" returned: 0 in 0.071s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:21.423272 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.447590 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.451711 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.557263 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.633425 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0d23ef33-f1f1-489b-86d1-60fb10ae91d6 req-dd341ac5-e952-462f-ac22-214b5acc29cf service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-vif-plugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:21.633425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0d23ef33-f1f1-489b-86d1-60fb10ae91d6 req-dd341ac5-e952-462f-ac22-214b5acc29cf service nova] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:21.633425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0d23ef33-f1f1-489b-86d1-60fb10ae91d6 req-dd341ac5-e952-462f-ac22-214b5acc29cf service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:21.633425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0d23ef33-f1f1-489b-86d1-60fb10ae91d6 req-dd341ac5-e952-462f-ac22-214b5acc29cf service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:21.633425 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0d23ef33-f1f1-489b-86d1-60fb10ae91d6 req-dd341ac5-e952-462f-ac22-214b5acc29cf service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Processing event network-vif-plugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:14:21.912488 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.914011 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.918857 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.920813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:21.944599 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:22.257351 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938062.2178025, b3f12e09-b318-4eb0-96cd-480a98f33784 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:22.257351 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] VM Started (Lifecycle Event)
May 28 03:14:22.257351 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:14:22.257351 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:14:22.257351 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Instance spawned successfully.
May 28 03:14:22.257351 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:14:22.721902 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:22.726151 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:14:22.738047 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:22.738220 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:22.738581 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:22.738898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:22.739217 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:22.739543 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:23.107471 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:23.227466 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:14:23.227692 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938063.2275536, b3f12e09-b318-4eb0-96cd-480a98f33784 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:23.227806 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] VM Paused (Lifecycle Event)
May 28 03:14:23.246122 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Took 7.21 seconds to spawn the instance on the hypervisor.
May 28 03:14:23.246356 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:23.708955 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-db714034-50e3-46ac-9936-87fd405de180 req-2c153b01-d6c3-49a0-bc6f-8daa099f7541 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-vif-plugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:23.712782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-db714034-50e3-46ac-9936-87fd405de180 req-2c153b01-d6c3-49a0-bc6f-8daa099f7541 service nova] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:23.712782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-db714034-50e3-46ac-9936-87fd405de180 req-2c153b01-d6c3-49a0-bc6f-8daa099f7541 service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:23.712782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-db714034-50e3-46ac-9936-87fd405de180 req-2c153b01-d6c3-49a0-bc6f-8daa099f7541 service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:23.712782 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-db714034-50e3-46ac-9936-87fd405de180 req-2c153b01-d6c3-49a0-bc6f-8daa099f7541 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] No waiting events found dispatching network-vif-plugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:14:23.712782 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-db714034-50e3-46ac-9936-87fd405de180 req-2c153b01-d6c3-49a0-bc6f-8daa099f7541 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received unexpected event network-vif-plugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b for instance with vm_state active and task_state None.
May 28 03:14:23.731768 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:23.734377 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938063.7341359, b3f12e09-b318-4eb0-96cd-480a98f33784 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:23.734506 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] VM Resumed (Lifecycle Event)
May 28 03:14:23.759747 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Took 12.47 seconds to build instance.
May 28 03:14:23.797332 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:24.238029 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:24.240194 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:14:24.261716 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-515c53ce-66e8-475e-85fc-e2741acc9261 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.975s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:24.945804 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-changed-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:24.946291 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Refreshing instance network info cache due to event network-changed-b4b8a525-ce57-4aeb-a291-a3f999bebb3b. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:14:24.946526 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] Acquiring lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:24.947030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] Acquired lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:24.947030 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Refreshing network info cache for port b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:14:25.450205 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:25.817588 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:25.865044 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:26.042623 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Updated VIF entry in instance network info cache for port b4b8a525-ce57-4aeb-a291-a3f999bebb3b. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:14:26.043097 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Updating instance_info_cache with network_info: [{"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:26.545343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b8b51b8-28dc-4f05-9fc5-8ba77c2d5bbe req-2161183e-62d7-402a-a1d9-b9f67a5af31c service nova] Releasing lock "refresh_cache-b3f12e09-b318-4eb0-96cd-480a98f33784" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:27.621599 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:28.108847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:28.441612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:28.441788 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:28.441958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:28.442105 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:28.442199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:28.444250 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Terminating instance
May 28 03:14:28.798764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:28.947872 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:14:28.968093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:28.970862 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:28.996764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.005965 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.028775 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.029724 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.130936 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7f51f361-62c8-4a87-a5d9-fec537962555 req-97399085-29eb-4848-80fd-c39e2d3307ad service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-vif-unplugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:29.131233 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f51f361-62c8-4a87-a5d9-fec537962555 req-97399085-29eb-4848-80fd-c39e2d3307ad service nova] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:29.131569 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f51f361-62c8-4a87-a5d9-fec537962555 req-97399085-29eb-4848-80fd-c39e2d3307ad service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:29.131827 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7f51f361-62c8-4a87-a5d9-fec537962555 req-97399085-29eb-4848-80fd-c39e2d3307ad service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:29.132072 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7f51f361-62c8-4a87-a5d9-fec537962555 req-97399085-29eb-4848-80fd-c39e2d3307ad service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] No waiting events found dispatching network-vif-unplugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:14:29.132311 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7f51f361-62c8-4a87-a5d9-fec537962555 req-97399085-29eb-4848-80fd-c39e2d3307ad service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-vif-unplugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:14:29.249380 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.255906 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.273585 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99958232400013 future=<Future at 0x7e4b407c3e00 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:29.273924 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99930253499997 future=<Future at 0x7e4b407c3e00 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:29.273986 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999115819000053 future=<Future at 0x7e4b407c3e00 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:29.278406 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Instance destroyed successfully.
May 28 03:14:29.278733 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'resources' on Instance uuid 36ec36eb-f71f-4df1-b082-a228b94b6ab2 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:14:29.781039 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1670598071',display_name='tempest-TestEncryptedCinderVolumes-server-1670598071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-1670598071',id=57,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi3vJNnDIElDEAAwxPUVBXZKn7sMCbEuglEXeMuNQartNpc8N/d1RU1Uw75nYeLhX6jbFMlPSftQ7+doVErlwwXTaS2ozDh0aq8sEOq1mhbuF2kYDA+aAw4tl2xir1Z7w==',key_name='tempest-TestEncryptedCinderVolumes-336152319',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:13:58Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-zyuxoqha',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:13:59Z,user_data=None,user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=36ec36eb-f71f-4df1-b082-a228b94b6ab2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:14:29.781260 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "address": "fa:16:3e:14:78:94", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09a6cb5-6e", "ovs_interfaceid": "a09a6cb5-6e93-4e4d-929e-418f2c913c7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:29.781821 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:78:94,bridge_name='br-int',has_traffic_filtering=True,id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09a6cb5-6e') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:29.782046 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:78:94,bridge_name='br-int',has_traffic_filtering=True,id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09a6cb5-6e') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:14:29.784371 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.784565 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa09a6cb5-6e, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:29.795597 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.798571 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.799517 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.799839 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e20324f-1ce7-4f44-b335-785397a71a9d) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:29.800523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:29.801005 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:29.802943 np0000001589 nova-compute[98297]: INFO os_vif [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:78:94,bridge_name='br-int',has_traffic_filtering=True,id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09a6cb5-6e')
May 28 03:14:29.809665 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:14:29.810142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:14:29.811546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:14:29.811546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:14:29.811546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '01da8d8f-ada6-4078-aae3-3fe231cfc35c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:14:29.811546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:14:29.838575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:14:29.838575 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:14:29.838575 np0000001589 nova-compute[98297]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ffb4225-edca-4fd1-8ec9-34edf95f3d70 (non-flash)
May 28 03:14:29.838575 np0000001589 nova-compute[98297]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e41df014-2754-4f23-abeb-f3658f233909 (non-flash)
May 28 03:14:29.838575 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:14:29.838905 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [152] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:14:29.838905 np0000001589 nova-compute[98297]: tcp: [153] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c (non-flash)
May 28 03:14:29.838905 np0000001589 nova-compute[98297]: tcp: [154] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1ffb4225-edca-4fd1-8ec9-34edf95f3d70 (non-flash)
May 28 03:14:29.838905 np0000001589 nova-compute[98297]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e41df014-2754-4f23-abeb-f3658f233909 (non-flash)
May 28 03:14:29.838905 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:14:29.838905 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '152'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '153'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1ffb4225-edca-4fd1-8ec9-34edf95f3d70', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e41df014-2754-4f23-abeb-f3658f233909', '155')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:14:29.839184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '152')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:14:29.839803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c', '153')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:14:29.840467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40698220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:14:29.840653 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:14:29.840876 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flush multipath device 330000000b69d6386 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:14:29.873155 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:14:29.918905 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:14:29.966590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:14:29.966794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:14:29.967738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:14:29.978505 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:14:29.978796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:14:29.988644 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:30.014849 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 152, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.40.100,3260]
May 28 03:14:30.014849 np0000001589 nova-compute[98297]: Logout of [sid: 152, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.40.100,3260] successful.
May 28 03:14:30.014849 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:30.027018 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:30.036635 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:30.065974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.50.100,3260]
May 28 03:14:30.065974 np0000001589 nova-compute[98297]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-01da8d8f-ada6-4078-aae3-3fe231cfc35c, portal: 192.168.50.100,3260] successful.
May 28 03:14:30.065974 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:30.080557 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:30.084245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:14:30.084245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== disconnect_volume: return (272ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:14:30.084245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:14:30.084245 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Deleting instance files /opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2_del
May 28 03:14:30.084245 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Deletion of /opt/stack/data/nova/instances/36ec36eb-f71f-4df1-b082-a228b94b6ab2_del complete
May 28 03:14:30.353990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:30.354277 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:30.593997 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Took 1.65 seconds to destroy the instance on the hypervisor.
May 28 03:14:30.594571 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:14:30.594835 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:14:30.594936 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:14:30.595180 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:30.650528 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:30.873157 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:14:31.184346 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-vif-unplugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] Acquiring lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] No waiting events found dispatching network-vif-unplugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-vif-unplugged-a09a6cb5-6e93-4e4d-929e-418f2c913c7b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Received event network-vif-deleted-a09a6cb5-6e93-4e4d-929e-418f2c913c7b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Neutron deleted interface a09a6cb5-6e93-4e4d-929e-418f2c913c7b; detaching it from the instance and deleting it from the info cache
May 28 03:14:31.187361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c3e46fc1-417e-41e7-a96d-b404f11d0cbf req-99b5098c-444f-408b-9626-d60631270663 service nova] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Detach interface failed, port_id=a09a6cb5-6e93-4e4d-929e-418f2c913c7b, reason: Instance 36ec36eb-f71f-4df1-b082-a228b94b6ab2 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:14:31.451403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:31.451621 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:31.455299 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:14:31.455472 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Claim successful on node np0000001589
May 28 03:14:31.522311 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:32.025049 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Took 1.43 seconds to deallocate network for instance.
May 28 03:14:32.592810 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Took 0.57 seconds to detach 1 volumes for instance.
May 28 03:14:32.711384 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:32.711593 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:33.097538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:33.109146 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:33.139685 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:33.140092 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:14:33.216391 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:33.724404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.273s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:33.724861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.627s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:33.724994 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:14:33.906193 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:33.906502 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:34.232570 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:14:34.232570 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:14:34.232570 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:34.232570 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:34.308287 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f6feabdd5d64dd197ddca3bc6d05cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb42d7bedf40fdb71a3387ac762d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:14:34.411255 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:34.730638 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Successfully created port: a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:14:34.732647 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:14:34.808699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:34.917997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.193s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:34.976822 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Deleted allocations for instance 36ec36eb-f71f-4df1-b082-a228b94b6ab2
May 28 03:14:35.208980 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Successfully updated port: a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:14:35.235394 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:14:35.249088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-changed-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:35.249088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Refreshing instance network info cache due to event network-changed-a8d48604-789a-45b7-9214-a0222dc78de3. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:14:35.249088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] Acquiring lock "refresh_cache-f9208eec-a8b1-48c4-933d-efca9338c5b4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:35.249636 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] Acquired lock "refresh_cache-f9208eec-a8b1-48c4-933d-efca9338c5b4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:35.251032 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Refreshing network info cache for port a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:14:35.710807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "refresh_cache-f9208eec-a8b1-48c4-933d-efca9338c5b4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:35.757995 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:35.811248 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:35.921335 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:35.985996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d71c06c7-001c-41de-bfeb-171c6564aa48 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "36ec36eb-f71f-4df1-b082-a228b94b6ab2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.544s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:36.242275 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:14:36.243545 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:14:36.243780 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Creating image(s)
May 28 03:14:36.244345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:36.244514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "/opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:36.244988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "/opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:36.245596 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:36.251116 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:36.252082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:36.353976 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.102s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:36.354372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:36.354914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:36.356497 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:36.359112 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:36.359455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:36.423586 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-be2e0fe6-7514-48b6-bec1-fe571ea0f45b req-c4aaa750-4a98-41f7-aa24-fee707b0f7b3 service nova] Releasing lock "refresh_cache-f9208eec-a8b1-48c4-933d-efca9338c5b4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:36.423883 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquired lock "refresh_cache-f9208eec-a8b1-48c4-933d-efca9338c5b4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:36.424207 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:14:36.467632 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.108s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:36.468090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:36.529132 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk 1073741824" returned: 0 in 0.061s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:36.529599 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:36.529937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:36.618844 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:36.619309 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:14:36.619591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:36.707830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:36.708239 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Cannot resize image /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:14:36.708683 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:14:36.708847 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Ensure instance console log exists: /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:14:36.709142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:36.709380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:36.709514 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:36.985046 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:37.138718 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:37.140418 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:37.274020 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Updating instance_info_cache with network_info: [{"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:37.647507 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:37.647729 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:37.647832 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:37.647963 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:14:37.776534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Releasing lock "refresh_cache-f9208eec-a8b1-48c4-933d-efca9338c5b4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:37.776808 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Instance network_info: |[{"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:14:37.778443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Start _get_guest_xml network_info=[{"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:14:37.780613 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:14:37.782140 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-1825435584', uuid='f9208eec-a8b1-48c4-933d-efca9338c5b4'), owner=OwnerMeta(userid='6f6feabdd5d64dd197ddca3bc6d05cf5', username='tempest-VolumesActionsTest-1775431530-project-member', projectid='ebcb42d7bedf40fdb71a3387ac762d16', projectname='tempest-VolumesActionsTest-1775431530'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938077.7814198) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:14:37.785245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:14:37.785245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:14:37.785245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:14:37.785245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:14:37.785245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:14:37.785245 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:14:37.785471 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:14:37.785471 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:14:37.785514 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:14:37.785616 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:14:37.785699 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:14:37.785840 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:14:37.785936 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:14:37.786158 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:14:37.786299 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:14:37.786414 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:14:37.798392 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1825435584',display_name='tempest-VolumesActionsTest-instance-1825435584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-1825435584',id=59,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebcb42d7bedf40fdb71a3387ac762d16',ramdisk_id='',reservation_id='r-omj214wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775431530',owner_user_name='tempest-VolumesActionsTest-1775431530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:35Z,user_data=None,user_id='6f6feabdd5d64dd197ddca3bc6d05cf5',uuid=f9208eec-a8b1-48c4-933d-efca9338c5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:14:37.798568 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converting VIF {"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:37.799496 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cb:64,bridge_name='br-int',has_traffic_filtering=True,id=a8d48604-789a-45b7-9214-a0222dc78de3,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d48604-78') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:37.800126 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lazy-loading 'pci_devices' on Instance uuid f9208eec-a8b1-48c4-933d-efca9338c5b4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:14:38.110484 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.303205 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] End _get_guest_xml xml=<domain type="qemu">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <uuid>f9208eec-a8b1-48c4-933d-efca9338c5b4</uuid>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <name>instance-0000003b</name>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesActionsTest-instance-1825435584</nova:name>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:14:37</nova:creationTime>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:user uuid="6f6feabdd5d64dd197ddca3bc6d05cf5">tempest-VolumesActionsTest-1775431530-project-member</nova:user>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:project uuid="ebcb42d7bedf40fdb71a3387ac762d16">tempest-VolumesActionsTest-1775431530</nova:project>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         <nova:port uuid="a8d48604-789a-45b7-9214-a0222dc78de3">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <system>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <entry name="serial">f9208eec-a8b1-48c4-933d-efca9338c5b4</entry>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <entry name="uuid">f9208eec-a8b1-48c4-933d-efca9338c5b4</entry>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </system>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <os>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   </os>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <features>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   </features>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   <devices>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </disk>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk.config"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </disk>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:41:cb:64"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <target dev="tapa8d48604-78"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </interface>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/console.log" append="off"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </serial>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <video>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </video>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </rng>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:   </devices>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]: </domain>
May 28 03:14:38.303205 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:14:38.305470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Preparing to wait for external event network-vif-plugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:14:38.305470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:38.305470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:38.305470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:38.305470 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1825435584',display_name='tempest-VolumesActionsTest-instance-1825435584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-1825435584',id=59,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebcb42d7bedf40fdb71a3387ac762d16',ramdisk_id='',reservation_id='r-omj214wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775431530',owner_user_name='tempest-VolumesActionsTest-1775431530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:35Z,user_data=None,user_id='6f6feabdd5d64dd197ddca3bc6d05cf5',uuid=f9208eec-a8b1-48c4-933d-efca9338c5b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:14:38.305470 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converting VIF {"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:38.305685 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cb:64,bridge_name='br-int',has_traffic_filtering=True,id=a8d48604-789a-45b7-9214-a0222dc78de3,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d48604-78') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:38.305792 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cb:64,bridge_name='br-int',has_traffic_filtering=True,id=a8d48604-789a-45b7-9214-a0222dc78de3,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d48604-78') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:14:38.306338 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.306649 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:38.306880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:14:38.307533 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.307679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74949bb0-325c-51f1-9395-6f8dc4e24a29', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:38.308457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.309069 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:38.309116 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.310921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.311045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8d48604-78, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:38.311340 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8d48604-78, col_values=(('qos', UUID('e4b9928b-958e-416a-9e54-d183a3be63ee')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:38.311485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8d48604-78, col_values=(('external_ids', {'iface-id': 'a8d48604-789a-45b7-9214-a0222dc78de3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:cb:64', 'vm-uuid': 'f9208eec-a8b1-48c4-933d-efca9338c5b4'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:38.315243 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.316360 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:38.318023 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:38.318810 np0000001589 nova-compute[98297]: INFO os_vif [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cb:64,bridge_name='br-int',has_traffic_filtering=True,id=a8d48604-789a-45b7-9214-a0222dc78de3,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d48604-78')
May 28 03:14:38.675902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:38.768745 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:38.769560 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:38.857489 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:38.862546 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:14:38.864056 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:38.916614 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:38.917430 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13431MB free_disk=73.6658821105957GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:14:38.918807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:38.918807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:39.836518 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:14:39.836904 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:14:39.836904 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] No VIF found with MAC fa:16:3e:41:cb:64, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:14:39.837400 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Using config drive
May 28 03:14:39.969872 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3f12e09-b318-4eb0-96cd-480a98f33784 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:14:39.970013 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance f9208eec-a8b1-48c4-933d-efca9338c5b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:14:39.970250 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:14:39.970419 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:14:38 up 42 min,  2 users,  load average: 5.78, 6.45, 4.82\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_8a6a1526383440ceb5b3f69f7492d966': '1', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_ebcb42d7bedf40fdb71a3387ac762d16': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:14:40.117204 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:40.117423 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:40.342140 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:40.450911 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Creating config drive at /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk.config
May 28 03:14:40.453744 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9bvt29v_ {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:40.508436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9bvt29v_" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:40.621747 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:40.903448 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:40.933980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:40.936012 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:41.015470 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:41.089725 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ecfb16b-f8b8-4596-aa3d-d02df2fc6656 req-bf89ff61-fd23-42d6-b253-3ddc9bc3a6f2 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-vif-plugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:41.090120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ecfb16b-f8b8-4596-aa3d-d02df2fc6656 req-bf89ff61-fd23-42d6-b253-3ddc9bc3a6f2 service nova] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:41.090521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ecfb16b-f8b8-4596-aa3d-d02df2fc6656 req-bf89ff61-fd23-42d6-b253-3ddc9bc3a6f2 service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:41.090760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ecfb16b-f8b8-4596-aa3d-d02df2fc6656 req-bf89ff61-fd23-42d6-b253-3ddc9bc3a6f2 service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:41.091253 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ecfb16b-f8b8-4596-aa3d-d02df2fc6656 req-bf89ff61-fd23-42d6-b253-3ddc9bc3a6f2 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Processing event network-vif-plugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:14:41.135051 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:14:41.138499 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.221s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:41.138816 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:14:41.231899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:41.233727 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:41.240375 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:41.258510 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:41.619377 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938081.6189117, f9208eec-a8b1-48c4-933d-efca9338c5b4 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:41.619537 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] VM Started (Lifecycle Event)
May 28 03:14:41.621147 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:14:41.623777 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:14:41.626289 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Instance spawned successfully.
May 28 03:14:41.626612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:14:42.122426 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:42.124075 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:14:42.131696 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:42.131838 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:42.132121 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:42.132443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:42.132709 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:42.132967 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:14:42.626084 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:14:42.626350 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938082.6261616, f9208eec-a8b1-48c4-933d-efca9338c5b4 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:42.626454 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] VM Paused (Lifecycle Event)
May 28 03:14:42.636989 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Took 6.39 seconds to spawn the instance on the hypervisor.
May 28 03:14:42.637142 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:43.111457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:43.128663 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:43.130711 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938083.1305447, f9208eec-a8b1-48c4-933d-efca9338c5b4 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:43.130826 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] VM Resumed (Lifecycle Event)
May 28 03:14:43.136196 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:43.136619 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:43.136961 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:43.137120 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:14:43.137389 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:14:43.137773 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:43.138038 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:14:43.141412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9b9cd819-5eb6-4d7e-934c-0191717bcf0f req-162fbd82-6951-48e9-a815-830a95cdf5f1 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-vif-plugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:43.141808 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9b9cd819-5eb6-4d7e-934c-0191717bcf0f req-162fbd82-6951-48e9-a815-830a95cdf5f1 service nova] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:43.142000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9b9cd819-5eb6-4d7e-934c-0191717bcf0f req-162fbd82-6951-48e9-a815-830a95cdf5f1 service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:43.142328 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9b9cd819-5eb6-4d7e-934c-0191717bcf0f req-162fbd82-6951-48e9-a815-830a95cdf5f1 service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:43.142483 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9b9cd819-5eb6-4d7e-934c-0191717bcf0f req-162fbd82-6951-48e9-a815-830a95cdf5f1 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] No waiting events found dispatching network-vif-plugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:14:43.142598 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-9b9cd819-5eb6-4d7e-934c-0191717bcf0f req-162fbd82-6951-48e9-a815-830a95cdf5f1 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received unexpected event network-vif-plugged-a8d48604-789a-45b7-9214-a0222dc78de3 for instance with vm_state active and task_state None.
May 28 03:14:43.145454 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Took 11.76 seconds to build instance.
May 28 03:14:43.313024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:43.632923 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:43.635116 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:14:43.646586 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.292s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:44.273483 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00037516900010814425 future=<Future at 0x7e4b407c3e00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:44.273812 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:44.274663 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] Emitting event <LifecycleEvent: 1779938069.2729979, 36ec36eb-f71f-4df1-b082-a228b94b6ab2 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:14:44.274812 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] VM Stopped (Lifecycle Event)
May 28 03:14:44.777091 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5982745b-e82e-433d-942f-c764a314a9cc tempest-TestEncryptedCinderVolumes-781621704 tempest-TestEncryptedCinderVolumes-781621704-project-member] [instance: 36ec36eb-f71f-4df1-b082-a228b94b6ab2] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:14:45.476309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:45.476309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:45.476309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:45.476309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:45.476309 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:45.478136 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Terminating instance
May 28 03:14:45.981889 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:14:46.003464 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.013540 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.033729 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.040118 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.061786 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.063637 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.171000 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-462861d0-95d4-4f19-bbd9-1b6c24c13546 req-aaae04d3-dfd5-480e-8f70-0b22d452dece service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-vif-unplugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:46.171000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-462861d0-95d4-4f19-bbd9-1b6c24c13546 req-aaae04d3-dfd5-480e-8f70-0b22d452dece service nova] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:46.171000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-462861d0-95d4-4f19-bbd9-1b6c24c13546 req-aaae04d3-dfd5-480e-8f70-0b22d452dece service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:46.171000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-462861d0-95d4-4f19-bbd9-1b6c24c13546 req-aaae04d3-dfd5-480e-8f70-0b22d452dece service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:46.171000 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-462861d0-95d4-4f19-bbd9-1b6c24c13546 req-aaae04d3-dfd5-480e-8f70-0b22d452dece service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] No waiting events found dispatching network-vif-unplugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:14:46.171000 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-462861d0-95d4-4f19-bbd9-1b6c24c13546 req-aaae04d3-dfd5-480e-8f70-0b22d452dece service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-vif-unplugged-a8d48604-789a-45b7-9214-a0222dc78de3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:14:46.343245 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999687760000143 future=<Future at 0x7e4b644e9c70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:46.343245 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998596866000298 future=<Future at 0x7e4b644e9c70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:46.343245 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998429386000225 future=<Future at 0x7e4b644e9c70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:14:46.343245 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Instance destroyed successfully.
May 28 03:14:46.343615 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lazy-loading 'resources' on Instance uuid f9208eec-a8b1-48c4-933d-efca9338c5b4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:14:46.846984 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:14:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1825435584',display_name='tempest-VolumesActionsTest-instance-1825435584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-1825435584',id=59,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:14:42Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebcb42d7bedf40fdb71a3387ac762d16',ramdisk_id='',reservation_id='r-omj214wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1775431530',owner_user_name='tempest-VolumesActionsTest-1775431530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:14:43Z,user_data=None,user_id='6f6feabdd5d64dd197ddca3bc6d05cf5',uuid=f9208eec-a8b1-48c4-933d-efca9338c5b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:14:46.847378 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converting VIF {"id": "a8d48604-789a-45b7-9214-a0222dc78de3", "address": "fa:16:3e:41:cb:64", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d48604-78", "ovs_interfaceid": "a8d48604-789a-45b7-9214-a0222dc78de3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:46.848082 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:cb:64,bridge_name='br-int',has_traffic_filtering=True,id=a8d48604-789a-45b7-9214-a0222dc78de3,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d48604-78') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:46.848426 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cb:64,bridge_name='br-int',has_traffic_filtering=True,id=a8d48604-789a-45b7-9214-a0222dc78de3,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d48604-78') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:14:46.849991 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.850256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8d48604-78, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:46.851320 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.852364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:46.852602 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.853357 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.853515 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4b9928b-958e-416a-9e54-d183a3be63ee) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:46.853953 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.854479 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:46.854799 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:46.856426 np0000001589 nova-compute[98297]: INFO os_vif [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:cb:64,bridge_name='br-int',has_traffic_filtering=True,id=a8d48604-789a-45b7-9214-a0222dc78de3,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d48604-78')
May 28 03:14:46.856725 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Deleting instance files /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4_del
May 28 03:14:46.857442 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Deletion of /opt/stack/data/nova/instances/f9208eec-a8b1-48c4-933d-efca9338c5b4_del complete
May 28 03:14:47.303980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:47.363851 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Took 1.38 seconds to destroy the instance on the hypervisor.
May 28 03:14:47.364355 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:14:47.364687 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:14:47.364829 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:14:47.365109 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:47.427758 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:48.112104 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:48.133697 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:48.134095 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:14:48.152169 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:48.227046 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b9089c9-36f1-43bb-9761-10465dc88496 req-122a2d7d-3419-4001-bfca-b33f26a648f0 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-vif-unplugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:48.227158 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b9089c9-36f1-43bb-9761-10465dc88496 req-122a2d7d-3419-4001-bfca-b33f26a648f0 service nova] Acquiring lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:48.227376 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b9089c9-36f1-43bb-9761-10465dc88496 req-122a2d7d-3419-4001-bfca-b33f26a648f0 service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:48.227499 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6b9089c9-36f1-43bb-9761-10465dc88496 req-122a2d7d-3419-4001-bfca-b33f26a648f0 service nova] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:48.227613 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b9089c9-36f1-43bb-9761-10465dc88496 req-122a2d7d-3419-4001-bfca-b33f26a648f0 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] No waiting events found dispatching network-vif-unplugged-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:14:48.227718 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b9089c9-36f1-43bb-9761-10465dc88496 req-122a2d7d-3419-4001-bfca-b33f26a648f0 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-vif-unplugged-a8d48604-789a-45b7-9214-a0222dc78de3 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:14:48.227817 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6b9089c9-36f1-43bb-9761-10465dc88496 req-122a2d7d-3419-4001-bfca-b33f26a648f0 service nova] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Received event network-vif-deleted-a8d48604-789a-45b7-9214-a0222dc78de3 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:48.654214 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Took 1.29 seconds to deallocate network for instance.
May 28 03:14:49.009012 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:49.009169 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:49.137532 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:14:49.137900 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:14:49.159651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:49.159814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:49.330498 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:49.330719 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:49.512216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:14:49.732254 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:49.834483 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:50.058655 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:50.341312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.181s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:50.343443 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.285s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:50.346173 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:14:50.346317 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Claim successful on node np0000001589
May 28 03:14:50.389745 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Deleted allocations for instance f9208eec-a8b1-48c4-933d-efca9338c5b4
May 28 03:14:51.397084 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6ba186e7-c2eb-4268-aeba-42d325485976 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "f9208eec-a8b1-48c4-933d-efca9338c5b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.922s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:51.489205 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:51.490109 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:51.868690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:51.992668 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:52.174563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:52.174812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:52.188558 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:52.498654 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.155s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:52.500199 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:14:52.676992 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:14:53.004401 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:14:53.004662 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:14:53.004982 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:53.007462 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:53.098478 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c083fd5d4f04c58b1c5ecc8cae5ffce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f79d7d10d3654992aab71cc666e52080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:14:53.116034 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:53.228131 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:53.228386 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:53.231681 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:14:53.231945 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Claim successful on node np0000001589
May 28 03:14:53.506219 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:14:53.541389 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Successfully created port: 2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:14:53.756421 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:54.009815 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:14:54.243620 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Successfully updated port: 2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:14:54.286513 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-changed-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:54.286921 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Refreshing instance network info cache due to event network-changed-2d11ea6c-1462-45ed-bcf4-a50ad49582a9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:14:54.287199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] Acquiring lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:54.287357 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] Acquired lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:54.288018 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Refreshing network info cache for port 2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:14:54.399255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:54.399448 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:54.515151 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Booting with volume 566dcaf0-c7fb-4b22-870b-f4642480a9a1 at /dev/vda
May 28 03:14:54.549889 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:14:54.559924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:14:54.582995 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:54.627100 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:14:54.627415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:14:54.636122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:14:54.637327 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe64:95a5', 'fe80::68f8:b7ff:fe71:d00c'] 
May 28 03:14:54.637513 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:14:54.637680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:14:54.637991 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:14:54.638239 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Updating existing volume attachment record: b59b631c-fac5-42e6-8247-65a2f9dc5b84 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:14:54.746115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:54.792641 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:54.821351 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c59a0a09-4bf9-4218-ad0e-b1ab16b73a4f req-4b190bbb-6cb4-47e5-b3f1-20f39f8fc55a service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:54.822217 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c59a0a09-4bf9-4218-ad0e-b1ab16b73a4f req-4b190bbb-6cb4-47e5-b3f1-20f39f8fc55a service nova] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:54.822454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c59a0a09-4bf9-4218-ad0e-b1ab16b73a4f req-4b190bbb-6cb4-47e5-b3f1-20f39f8fc55a service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:54.822608 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c59a0a09-4bf9-4218-ad0e-b1ab16b73a4f req-4b190bbb-6cb4-47e5-b3f1-20f39f8fc55a service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:54.822745 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c59a0a09-4bf9-4218-ad0e-b1ab16b73a4f req-4b190bbb-6cb4-47e5-b3f1-20f39f8fc55a service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] No waiting events found dispatching network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:14:54.822866 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c59a0a09-4bf9-4218-ad0e-b1ab16b73a4f req-4b190bbb-6cb4-47e5-b3f1-20f39f8fc55a service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received unexpected event network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 for instance with vm_state building and task_state block_device_mapping.
May 28 03:14:54.845988 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:54.903807 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:54.961392 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:55.410324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.182s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:55.410690 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:14:55.463005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-7ac476d0-7ce3-4cb5-be2a-8cba630493f2 req-69f1abf8-f713-4158-9531-fbd41c2076c9 service nova] Releasing lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:55.463387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquired lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:55.463504 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:14:55.916499 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:14:55.917688 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:14:55.917688 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:55.917688 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:55.991260 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f6feabdd5d64dd197ddca3bc6d05cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebcb42d7bedf40fdb71a3387ac762d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:14:56.032880 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:56.165052 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:56.296331 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Updating instance_info_cache with network_info: [{"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:56.373587 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Successfully created port: 706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:14:56.419439 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:14:56.425380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:56.425571 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:56.727025 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:14:56.727999 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:14:56.728247 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Creating image(s)
May 28 03:14:56.728536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:14:56.728651 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Ensure instance console log exists: /opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:14:56.728895 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:56.729098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:56.729273 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:56.792289 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Successfully updated port: 706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:14:56.799454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Releasing lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:56.799616 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Instance network_info: |[{"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:14:56.800353 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Start _get_guest_xml network_info=[{"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'b59b631c-fac5-42e6-8247-65a2f9dc5b84', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5cf91eef-3929-48c5-8ff2-4ae1ee6b3623', 'attached_at': '', 'detached_at': '', 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'serial': '566dcaf0-c7fb-4b22-870b-f4642480a9a1'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:14:56.805265 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:14:56.805688 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-816037441', uuid='5cf91eef-3929-48c5-8ff2-4ae1ee6b3623'), owner=OwnerMeta(userid='3c083fd5d4f04c58b1c5ecc8cae5ffce', username='tempest-TestEncryptedCinderVolumes-124411028-project-member', projectid='f79d7d10d3654992aab71cc666e52080', projectname='tempest-TestEncryptedCinderVolumes-124411028'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938096.805378) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:14:56.806707 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:14:56.807027 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:14:56.808036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:14:56.808191 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:14:56.809022 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:14:56.809327 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:14:56.809456 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:14:56.809709 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:14:56.809843 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:14:56.809954 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:14:56.810054 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:14:56.810261 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:14:56.810375 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:14:56.810478 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:14:56.810573 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:14:56.810683 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:14:56.819752 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:14:56.819950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:14:56.820354 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:14:56.820447 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:14:56.820742 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:14:56.832488 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:14:56.833108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:14:56.833556 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:14:56.833750 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:14:56.834250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:14:56.834756 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:14:56.845641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:14:56.845641 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:56.848119 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-changed-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:14:56.848250 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Refreshing instance network info cache due to event network-changed-706b41c4-e466-4821-a9ea-8cb8dbf34302. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:14:56.849181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] Acquiring lock "refresh_cache-95c884f1-098c-4841-b409-9957d9790e81" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:56.849181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] Acquired lock "refresh_cache-95c884f1-098c-4841-b409-9957d9790e81" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:56.849181 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Refreshing network info cache for port 706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:14:56.850950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:14:56.850950 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:56.857273 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1] added
May 28 03:14:56.857273 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:14:56.857273 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:14:56.857273 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:14:56.857273 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:14:56.857273 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:14:56.857273 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:56.857464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:14:56.857555 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:14:56.857685 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:14:56.861960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1] added
May 28 03:14:56.861960 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:14:56.861960 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:14:56.861960 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:14:56.861960 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:14:56.861960 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:14:56.861960 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:56.862135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:14:56.862170 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:14:56.862319 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:14:56.870165 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:56.922351 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:14:56.927720 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:14:57.293985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "refresh_cache-95c884f1-098c-4841-b409-9957d9790e81" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:14:57.351297 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:57.393007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:57.393209 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:57.405760 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:57.468641 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:57.468813 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:57.471415 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:14:57.471502 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Claim successful on node np0000001589
May 28 03:14:57.521830 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:57.858178 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:14:57.862591 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:14:57.869151 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:14:57.869151 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:14:57.874536 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:14:57.874536 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:57.879340 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:57.884939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:57.889910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:14:57.889910 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:14:57.890017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:14:57.890017 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:14:57.890102 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:14:57.890102 np0000001589 nova-compute[98297]: 
May 28 03:14:57.894808 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:14:57.898394 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:14:57.898394 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:14:57.898538 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:14:57.898538 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:14:57.898587 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:14:57.898587 np0000001589 nova-compute[98297]: 
May 28 03:14:57.914133 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.40.100,3260]
May 28 03:14:57.914133 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.40.100,3260] successful.
May 28 03:14:57.914133 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:57.925039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:57.929811 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:14:57.931101 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:14:57.931323 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Creating image(s)
May 28 03:14:57.931746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "/opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:57.931952 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "/opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:57.932342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "/opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:57.932780 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:57.935279 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:57.935808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:14:57.935808 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:14:57.935934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:14:57.935934 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:14:57.936343 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.103s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:14:57.936522 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:14:57.937188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:57.951714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] HCTL ('7', '-', '-', 0) found on session 159 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:14:57.951714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:14:57.965928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching for a device in session 159 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:14:57.965928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:14:58.022353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:58.022745 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:58.023170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:58.023648 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:58.027047 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fd6b8ada-5d27-454e-bdf2-41a003eb6214 req-526e6662-8cdc-49de-88ba-bcb993f8d955 service nova] Releasing lock "refresh_cache-95c884f1-098c-4841-b409-9957d9790e81" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:58.027514 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:14:58.027916 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:58.028322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquired lock "refresh_cache-95c884f1-098c-4841-b409-9957d9790e81" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:14:58.028561 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:14:58.114710 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:58.115199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:58.125582 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:58.172464 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk 1073741824" returned: 0 in 0.057s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:58.172840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.150s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:58.173189 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:58.261707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:58.262316 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:14:58.262644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:14:58.352516 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:14:58.353057 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Cannot resize image /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:14:58.353599 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:14:58.353846 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Ensure instance console log exists: /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:14:58.354215 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:58.354535 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:58.354735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:58.439042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:58.602381 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:14:58.732424 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:14:58.732650 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:14:58.753512 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:14:58.870200 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Updating instance_info_cache with network_info: [{"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:14:58.928417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.50.100,3260]
May 28 03:14:58.928417 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.50.100,3260] successful.
May 28 03:14:58.928417 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:58.939952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:14:58.951301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:14:58.951301 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:14:58.951301 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:14:58.951463 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:14:58.951463 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:14:58.951463 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:14:58.952066 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.118s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:14:58.952066 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:14:58.952494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] HCTL ('8', '-', '-', 0) found on session 160 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:14:58.952615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:14:58.964454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Searching for a device in session 160 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:14:58.964454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:14:59.235971 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:14:59.372066 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Releasing lock "refresh_cache-95c884f1-098c-4841-b409-9957d9790e81" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:14:59.372343 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Instance network_info: |[{"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:14:59.374123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Start _get_guest_xml network_info=[{"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:14:59.376353 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:14:59.377535 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-675092346', uuid='95c884f1-098c-4841-b409-9957d9790e81'), owner=OwnerMeta(userid='6f6feabdd5d64dd197ddca3bc6d05cf5', username='tempest-VolumesActionsTest-1775431530-project-member', projectid='ebcb42d7bedf40fdb71a3387ac762d16', projectname='tempest-VolumesActionsTest-1775431530'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938099.3771727) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:14:59.378458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:14:59.378754 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:14:59.379495 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:14:59.379659 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:14:59.380502 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:14:59.380769 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:14:59.380902 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:14:59.380984 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:14:59.381099 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:14:59.381202 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:14:59.381315 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:14:59.381459 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:14:59.381549 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:14:59.381646 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:14:59.381739 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:14:59.381846 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:14:59.392294 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-675092346',display_name='tempest-VolumesActionsTest-instance-675092346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-675092346',id=61,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebcb42d7bedf40fdb71a3387ac762d16',ramdisk_id='',reservation_id='r-2zvpn38p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775431530',owner_user_name='tempest-VolumesActionsTest-1775431530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:57Z,user_data=None,user_id='6f6feabdd5d64dd197ddca3bc6d05cf5',uuid=95c884f1-098c-4841-b409-9957d9790e81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:14:59.392436 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converting VIF {"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:59.392964 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=706b41c4-e466-4821-a9ea-8cb8dbf34302,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706b41c4-e4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:59.393471 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lazy-loading 'pci_devices' on Instance uuid 95c884f1-098c-4841-b409-9957d9790e81 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:14:59.741762 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.273s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:59.742186 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.303s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:59.742415 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:14:59.746351 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:14:59.746457 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Claim successful on node np0000001589
May 28 03:14:59.848436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Found WWN 3300000001ddf45b2 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:14:59.848697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:14:59.849457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000001ddf45b2', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000001ddf45b2'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:14:59.849577 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001ddf45b2', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000001ddf45b2'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:14:59.874586 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '5cf91eef-3929-48c5-8ff2-4ae1ee6b3623', 'attached_at': '', 'detached_at': '', 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'serial': '566dcaf0-c7fb-4b22-870b-f4642480a9a1'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:14:59.875061 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:14:59.875258 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:14:59.875394 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:14:59.888233 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:14:59.888233 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:14:59.888233 np0000001589 nova-compute[98297]:     <volume>566dcaf0-c7fb-4b22-870b-f4642480a9a1</volume>
May 28 03:14:59.888233 np0000001589 nova-compute[98297]:   </usage>
May 28 03:14:59.888233 np0000001589 nova-compute[98297]: </secret>
May 28 03:14:59.888233 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:14:59.895883 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] End _get_guest_xml xml=<domain type="qemu">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <uuid>95c884f1-098c-4841-b409-9957d9790e81</uuid>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <name>instance-0000003d</name>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesActionsTest-instance-675092346</nova:name>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:14:59</nova:creationTime>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:user uuid="6f6feabdd5d64dd197ddca3bc6d05cf5">tempest-VolumesActionsTest-1775431530-project-member</nova:user>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:project uuid="ebcb42d7bedf40fdb71a3387ac762d16">tempest-VolumesActionsTest-1775431530</nova:project>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         <nova:port uuid="706b41c4-e466-4821-a9ea-8cb8dbf34302">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <system>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <entry name="serial">95c884f1-098c-4841-b409-9957d9790e81</entry>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <entry name="uuid">95c884f1-098c-4841-b409-9957d9790e81</entry>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </system>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <os>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   </os>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <features>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   </features>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   <devices>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </disk>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk.config"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </disk>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:89:be:a8"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <target dev="tap706b41c4-e4"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </interface>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/console.log" append="off"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </serial>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <video>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </video>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </rng>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:   </devices>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]: </domain>
May 28 03:14:59.895883 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:14:59.897980 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Preparing to wait for external event network-vif-plugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:14:59.897980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:14:59.897980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:14:59.897980 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:14:59.897980 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-675092346',display_name='tempest-VolumesActionsTest-instance-675092346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-675092346',id=61,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ebcb42d7bedf40fdb71a3387ac762d16',ramdisk_id='',reservation_id='r-2zvpn38p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1775431530',owner_user_name='tempest-VolumesActionsTest-1775431530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:57Z,user_data=None,user_id='6f6feabdd5d64dd197ddca3bc6d05cf5',uuid=95c884f1-098c-4841-b409-9957d9790e81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:14:59.897980 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converting VIF {"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:14:59.897980 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=706b41c4-e466-4821-a9ea-8cb8dbf34302,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706b41c4-e4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:14:59.898300 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=706b41c4-e466-4821-a9ea-8cb8dbf34302,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706b41c4-e4') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:14:59.898464 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:59.898722 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:59.898988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:14:59.899644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:59.899771 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5276faec-9b1d-5675-a4e0-6e1dfbda017f', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:59.914315 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:59.915528 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:59.917127 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:59.917260 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap706b41c4-e4, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:59.917524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap706b41c4-e4, col_values=(('qos', UUID('5725fd1b-b386-4139-bf04-16ddb540e899')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:59.917670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap706b41c4-e4, col_values=(('external_ids', {'iface-id': '706b41c4-e466-4821-a9ea-8cb8dbf34302', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:be:a8', 'vm-uuid': '95c884f1-098c-4841-b409-9957d9790e81'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:14:59.918811 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:59.920209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:14:59.923745 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:14:59.924479 np0000001589 nova-compute[98297]: INFO os_vif [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=706b41c4-e466-4821-a9ea-8cb8dbf34302,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706b41c4-e4')
May 28 03:15:00.247623 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:15:00.248769 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:15:00.248769 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:00.248769 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:00.309624 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:15:00.395545 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-816037441',display_name='tempest-TestEncryptedCinderVolumes-server-816037441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-816037441',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi3vJNnDIElDEAAwxPUVBXZKn7sMCbEuglEXeMuNQartNpc8N/d1RU1Uw75nYeLhX6jbFMlPSftQ7+doVErlwwXTaS2ozDh0aq8sEOq1mhbuF2kYDA+aAw4tl2xir1Z7w==',key_name='tempest-TestEncryptedCinderVolumes-336152319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-8xjvc4fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:54Z,user_data=None,user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=5cf91eef-3929-48c5-8ff2-4ae1ee6b3623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:15:00.395749 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:00.396188 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:f0:0b,bridge_name='br-int',has_traffic_filtering=True,id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d11ea6c-14') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:00.396978 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:00.637921 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Successfully created port: 8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:15:00.751235 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:15:00.900076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] End _get_guest_xml xml=<domain type="qemu">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <uuid>5cf91eef-3929-48c5-8ff2-4ae1ee6b3623</uuid>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <name>instance-0000003c</name>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-816037441</nova:name>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:14:56</nova:creationTime>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:user uuid="3c083fd5d4f04c58b1c5ecc8cae5ffce">tempest-TestEncryptedCinderVolumes-124411028-project-member</nova:user>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:project uuid="f79d7d10d3654992aab71cc666e52080">tempest-TestEncryptedCinderVolumes-124411028</nova:project>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <nova:port uuid="2d11ea6c-1462-45ed-bcf4-a50ad49582a9">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <system>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <entry name="serial">5cf91eef-3929-48c5-8ff2-4ae1ee6b3623</entry>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <entry name="uuid">5cf91eef-3929-48c5-8ff2-4ae1ee6b3623</entry>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </system>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <os>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   </os>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <features>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   </features>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   <devices>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623/disk.config"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <alias name="ua-566dcaf0-c7fb-4b22-870b-f4642480a9a1"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <serial>566dcaf0-c7fb-4b22-870b-f4642480a9a1</serial>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <encryption format="luks">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:         <secret type="passphrase" uuid="d22ecf94-ca89-414e-87eb-1808ca004de2"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       </encryption>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:43:f0:0b"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <target dev="tap2d11ea6c-14"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </interface>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623/console.log" append="off"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </serial>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <video>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </video>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </rng>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:   </devices>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]: </domain>
May 28 03:15:00.900076 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:15:00.902337 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Preparing to wait for external event network-vif-plugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:15:00.902337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:00.902337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:00.902337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:00.902522 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-816037441',display_name='tempest-TestEncryptedCinderVolumes-server-816037441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-816037441',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi3vJNnDIElDEAAwxPUVBXZKn7sMCbEuglEXeMuNQartNpc8N/d1RU1Uw75nYeLhX6jbFMlPSftQ7+doVErlwwXTaS2ozDh0aq8sEOq1mhbuF2kYDA+aAw4tl2xir1Z7w==',key_name='tempest-TestEncryptedCinderVolumes-336152319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-8xjvc4fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:14:54Z,user_data=None,user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=5cf91eef-3929-48c5-8ff2-4ae1ee6b3623,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:15:00.902698 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:00.903314 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:f0:0b,bridge_name='br-int',has_traffic_filtering=True,id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d11ea6c-14') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:00.903566 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:f0:0b,bridge_name='br-int',has_traffic_filtering=True,id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d11ea6c-14') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:15:00.903852 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:00.904103 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:00.904295 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:15:00.904841 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:00.905003 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d042335-3bd4-509b-a6a9-ba29da23d315', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:00.905884 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:00.906627 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:00.912083 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:00.916407 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:00.916574 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d11ea6c-14, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:00.917281 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d11ea6c-14, col_values=(('qos', UUID('e0ff14f0-3cb1-4683-b67f-4d17608c31b8')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:00.917281 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d11ea6c-14, col_values=(('external_ids', {'iface-id': '2d11ea6c-1462-45ed-bcf4-a50ad49582a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:f0:0b', 'vm-uuid': '5cf91eef-3929-48c5-8ff2-4ae1ee6b3623'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:00.917943 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:00.919007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:00.921889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:00.922045 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:00.928401 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:00.929322 np0000001589 nova-compute[98297]: INFO os_vif [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:f0:0b,bridge_name='br-int',has_traffic_filtering=True,id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d11ea6c-14')
May 28 03:15:00.992964 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:00.993133 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:01.083609 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Successfully updated port: 8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:15:01.130823 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-changed-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:01.131003 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Refreshing instance network info cache due to event network-changed-8624031c-4ab2-4250-a752-4a535fa35794. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:01.131150 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] Acquiring lock "refresh_cache-1ffe68ea-6d03-4cfa-bf87-428a146b4f13" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:01.131265 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] Acquired lock "refresh_cache-1ffe68ea-6d03-4cfa-bf87-428a146b4f13" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:01.131414 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Refreshing network info cache for port 8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:01.256070 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:15:01.341194 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004705009996541776 future=<Future at 0x7e4b644e9c70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:01.341738 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Emitting event <LifecycleEvent: 1779938086.3405306, f9208eec-a8b1-48c4-933d-efca9338c5b4 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:01.341953 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:01.342206 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] VM Stopped (Lifecycle Event)
May 28 03:15:01.425148 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'flavor' on Instance uuid b3f12e09-b318-4eb0-96cd-480a98f33784 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:01.439320 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:01.439465 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:01.439563 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] No VIF found with MAC fa:16:3e:89:be:a8, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:15:01.440016 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Using config drive
May 28 03:15:01.495478 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:01.585567 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-1ffe68ea-6d03-4cfa-bf87-428a146b4f13" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:01.633534 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:01.686673 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:15:01.759734 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Booting with volume 87dd0574-28d3-4410-8a6f-98472c1266d2 at /dev/vda
May 28 03:15:01.794769 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:01.803682 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:01.806434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:15:01.829040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:01.846759 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: f9208eec-a8b1-48c4-933d-efca9338c5b4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:01.878654 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:15:01.878933 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:15:01.887160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:15:01.887984 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe64:95a5', 'fe80::68f8:b7ff:fe71:d00c'] 
May 28 03:15:01.888108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:15:01.888208 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:15:01.888448 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:01.888643 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Updating existing volume attachment record: fd420d89-03c2-43bf-ad6c-998f3c48853a {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:15:01.928382 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Ignoring supplied device name: /dev/vdb
May 28 03:15:01.944845 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:02.002135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.260s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:02.002680 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:15:02.049269 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Creating config drive at /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk.config
May 28 03:15:02.052424 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwf6u30c3 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:02.104285 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwf6u30c3" returned: 0 in 0.052s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:15:02.306170 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-57312f39-16f4-4dc7-be05-4620c26cfd6f req-e75fc7a0-526e-41b8-b19e-04cceee5de03 service nova] Releasing lock "refresh_cache-1ffe68ea-6d03-4cfa-bf87-428a146b4f13" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:02.307709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-1ffe68ea-6d03-4cfa-bf87-428a146b4f13" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:02.307709 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:15:02.432429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:02.444617 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:02.444740 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:02.444799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] No VIF found with MAC fa:16:3e:43:f0:0b, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:15:02.445381 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Using config drive
May 28 03:15:02.489341 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.508685 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:15:02.508981 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:15:02.509879 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:02.509879 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:02.512338 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.588587 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d063f87ec60481180c0c826e6182dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73df2c139e08481d8909936bf4e3fb1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:15:02.600539 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.797043 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.803057 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.805129 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.834045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.841209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:02.865478 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:15:02.953996 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:03.014020 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:15:03.049542 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Successfully created port: 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:15:03.062993 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:03.117415 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:03.146260 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Creating config drive at /opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623/disk.config
May 28 03:15:03.150418 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj5vuott {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:03.186802 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-vif-plugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:03.187412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:03.187881 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:03.188088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:03.188268 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Processing event network-vif-plugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:15:03.188466 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-vif-plugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:03.188592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:03.188748 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:03.188900 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:03.189078 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] No waiting events found dispatching network-vif-plugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:03.189206 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-1583f517-1f33-4ee2-8d6f-16988733bf2c req-86ce540f-baa2-4500-b196-e23b3a7dd81f service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received unexpected event network-vif-plugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 for instance with vm_state building and task_state spawning.
May 28 03:15:03.213264 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmj5vuott" returned: 0 in 0.063s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:15:03.237747 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Updating instance_info_cache with network_info: [{"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:03.245995 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:15:03.246482 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938103.2461827, 95c884f1-098c-4841-b409-9957d9790e81 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:03.246978 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] VM Started (Lifecycle Event)
May 28 03:15:03.248341 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:15:03.252127 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Instance spawned successfully.
May 28 03:15:03.252542 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:15:03.514083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:03.514440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:03.514635 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Attaching volume 35b4309c-191e-40b3-8267-f70adfb18215 to /dev/vdb
May 28 03:15:03.517066 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:15:03.559024 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Successfully updated port: 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:15:03.604285 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:03.619520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:15:03.623698 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:03.624204 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing instance network info cache due to event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:03.624406 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] Acquiring lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:03.624496 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] Acquired lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:03.625249 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:03.644767 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:03.662819 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:03.693066 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:03.696345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:15:03.696740 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:15:03.705218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:15:03.706164 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe64:95a5', 'fe80::68f8:b7ff:fe71:d00c', 'fe80::fc16:3eff:fe89:bea8', 'fe80::1c2f:f6ff:fe72:8fa7', 'fe80::fc16:3eff:fe43:f00b'] 
May 28 03:15:03.706314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:15:03.706410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:15:03.706618 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:03.706935 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Updating existing volume attachment record: 90036c54-c96d-4c37-b80e-e8c135644968 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:15:03.743481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-1ffe68ea-6d03-4cfa-bf87-428a146b4f13" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:03.743481 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Instance network_info: |[{"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:15:03.749479 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:03.762375 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:03.767657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:03.772674 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:03.772674 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:03.772674 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:03.772674 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:03.772674 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:03.777436 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:03.994319 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:15:03.996116 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:15:03.996358 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Creating image(s)
May 28 03:15:03.997724 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:15:03.997866 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Ensure instance console log exists: /opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:15:03.998135 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:04.001218 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:04.001916 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:04.002124 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:04.002258 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:04.002694 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Start _get_guest_xml network_info=[{"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'fd420d89-03c2-43bf-ad6c-998f3c48853a', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1ffe68ea-6d03-4cfa-bf87-428a146b4f13', 'attached_at': '', 'detached_at': '', 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'serial': '87dd0574-28d3-4410-8a6f-98472c1266d2'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:15:04.005795 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:15:04.006740 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1878618183', uuid='1ffe68ea-6d03-4cfa-bf87-428a146b4f13'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938104.0064201) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:15:04.008338 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:15:04.008618 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:15:04.009598 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:15:04.009746 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:15:04.010691 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:15:04.010955 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:15:04.011081 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:15:04.011166 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:15:04.011294 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:15:04.011373 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:15:04.011462 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:15:04.011595 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:15:04.011687 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:15:04.011791 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:15:04.011894 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:15:04.012000 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:15:04.021958 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Booting with volume 63681720-6008-4c2e-b700-0a1b4ca5e56c at /dev/vda
May 28 03:15:04.023893 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:15:04.024201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:04.024391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:04.025482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:04.026242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:15:04.026494 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:04.037428 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:04.037892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:04.038358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:04.038573 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:04.039455 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:04.039601 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:04.052418 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:04.052418 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:04.058919 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:04.058919 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:04.060735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:04.065002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2] added
May 28 03:15:04.065002 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:04.065002 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:04.065002 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:04.065002 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:04.065002 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:04.065002 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:04.065500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:04.065500 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0267(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:04.065500 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:04.070472 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2] added
May 28 03:15:04.070472 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:04.070472 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:04.070472 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:04.070472 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:04.070472 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:04.070472 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:04.071285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:04.071285 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0311(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:04.071285 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:04.076791 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:04.087625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:15:04.106274 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:04.130262 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:04.153887 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:15:04.153887 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:15:04.163708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:15:04.165171 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe64:95a5', 'fe80::68f8:b7ff:fe71:d00c', 'fe80::fc16:3eff:fe89:bea8', 'fe80::1c2f:f6ff:fe72:8fa7', 'fe80::fc16:3eff:fe43:f00b', 'fe80::ac8c:9cff:fe07:8685'] 
May 28 03:15:04.165390 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:15:04.165564 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:15:04.166094 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:04.166184 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating existing volume attachment record: d8178f19-0e0c-4c03-85ca-416d6f64a2e8 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:15:04.212345 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:15:04.261768 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:15:04.262137 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35b4309c-191e-40b3-8267-f70adfb18215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:04.262307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:04.269313 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:15:04.269709 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938104.2694588, 95c884f1-098c-4841-b409-9957d9790e81 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:04.269936 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] VM Paused (Lifecycle Event)
May 28 03:15:04.286288 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Took 6.35 seconds to spawn the instance on the hypervisor.
May 28 03:15:04.286288 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:04.350814 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:04.772414 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:04.776076 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938104.7758136, 95c884f1-098c-4841-b409-9957d9790e81 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:04.776178 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] VM Resumed (Lifecycle Event)
May 28 03:15:04.797979 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Took 11.62 seconds to build instance.
May 28 03:15:04.853394 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5e2671d4-98d2-472f-ad4c-ba35d1645f51 req-e51c9811-c9c3-4401-b994-f5bed1158b2e service nova] Releasing lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:04.853886 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquired lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:04.854058 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:15:05.065948 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:05.071198 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:05.078894 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:05.078894 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:05.083416 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:05.083416 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.089442 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.098726 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.114464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.114464 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.114464 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:05.114581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.114581 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.114581 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:05.115200 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.115200 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.115200 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:05.115387 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.115387 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.115387 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:05.143539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.40.100,3260]
May 28 03:15:05.143539 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.40.100,3260] successful.
May 28 03:15:05.143539 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.152241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.50.100,3260]
May 28 03:15:05.152241 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.50.100,3260] successful.
May 28 03:15:05.152241 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.156436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.162960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:05.171097 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.171097 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.171097 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.171097 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.171097 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:05.171294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.171294 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.171294 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.171294 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.171294 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:05.171505 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:05.171607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:05.172250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('9', '-', '-', 0) found on session 161 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:05.172307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:05.178778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.178778 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.178778 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.178778 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.178778 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:05.178931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.178931 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:05.178931 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.178931 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:05.178931 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:05.179120 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:05.179237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:05.179768 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('10', '-', '-', 0) found on session 162 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:05.179891 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:05.195859 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 161 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:05.195859 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:05.195859 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 162 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:05.195859 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:05.278214 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:05.280603 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:05.299430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-efcfe7ef-0522-4de8-9390-ccae7d7c24df tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.124s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:05.409491 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:15:05.563618 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:05.682590 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-plugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:05.682773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:05.683549 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:05.683549 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:05.683549 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Processing event network-vif-plugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:15:05.683935 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-plugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:05.684025 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:05.684199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:05.684388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:05.684880 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:15:05.685125 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] No waiting events found dispatching network-vif-plugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:05.685125 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-045d5a9c-d859-4d7c-b4e2-b2152113d9e9 req-9ede3983-6b8d-462b-ac83-32ae666dc164 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received unexpected event network-vif-plugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 for instance with vm_state building and task_state spawning.
May 28 03:15:05.691721 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:15:05.694211 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Instance spawned successfully.
May 28 03:15:05.694211 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:15:05.699502 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating instance_info_cache with network_info: [{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:05.783234 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938105.7828748, 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:05.783572 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] VM Started (Lifecycle Event)
May 28 03:15:05.920609 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:06.039069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:15:06.200443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:06.200576 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:06.200979 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:06.201180 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:06.201408 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:06.201624 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:06.204668 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Releasing lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:06.206465 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Instance network_info: |[{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:15:06.274627 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:15:06.275549 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:15:06.275759 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Creating image(s)
May 28 03:15:06.276025 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:15:06.276157 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Ensure instance console log exists: /opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:15:06.276394 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:06.276541 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:06.276700 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:06.277102 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Start _get_guest_xml network_info=[{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'd8178f19-0e0c-4c03-85ca-416d6f64a2e8', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b2c78fb2-5f92-48bf-9fa8-5de1b2185b27', 'attached_at': '', 'detached_at': '', 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'serial': '63681720-6008-4c2e-b700-0a1b4ca5e56c'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:15:06.279260 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:15:06.280126 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-976414582', uuid='b2c78fb2-5f92-48bf-9fa8-5de1b2185b27'), owner=OwnerMeta(userid='0d063f87ec60481180c0c826e6182dfb', username='tempest-TestVolumeBackupRestore-134083432-project-member', projectid='73df2c139e08481d8909936bf4e3fb1e', projectname='tempest-TestVolumeBackupRestore-134083432'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938106.2798214) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:15:06.281395 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:15:06.281459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:15:06.282322 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:15:06.282508 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:15:06.283305 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:15:06.283590 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:15:06.283679 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:15:06.283739 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:15:06.283888 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:15:06.283928 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:15:06.284018 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:15:06.284208 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:15:06.284315 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:15:06.284393 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:15:06.284661 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:15:06.284661 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:15:06.290804 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:06.294462 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:15:06.294575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:06.294689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:06.295132 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:06.706290 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Took 9.98 seconds to spawn the instance on the hypervisor.
May 28 03:15:06.706441 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:06.797429 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:15:06.797738 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938106.7973719, 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:06.797738 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] VM Paused (Lifecycle Event)
May 28 03:15:07.055863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 330000000d8d46a9d for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:15:07.055863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:07.056237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.794s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:07.056437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35b4309c-191e-40b3-8267-f70adfb18215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:15:07.059096 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000d8d46a9d', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000d8d46a9d'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:07.059096 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d8d46a9d', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000d8d46a9d'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:15:07.068627 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:07.069363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:07.069944 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:07.070171 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:07.070592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:07.070805 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:07.082500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:07.082500 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:07.091405 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '1ffe68ea-6d03-4cfa-bf87-428a146b4f13', 'attached_at': '', 'detached_at': '', 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'serial': '87dd0574-28d3-4410-8a6f-98472c1266d2'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:15:07.091892 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:15:07.092134 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:15:07.092350 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:15:07.097712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:07.097712 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:07.106062 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215] added
May 28 03:15:07.106062 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:07.106062 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:07.106062 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:07.106062 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:07.106062 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:07.106062 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:07.106376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:07.106376 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0362(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:07.106648 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:07.109280 np0000001589 nova-compute[98297]: WARNING os_brick.encryptors.luks [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 03:15:07.109563 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:15:07.109696 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:15:07.110237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215] added
May 28 03:15:07.110237 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:07.110237 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:07.110237 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:07.110237 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:07.110237 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:07.110237 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:07.110416 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:15:07.110718 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:07.110902 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:07.111030 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:07.111361 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7e4b407dcb90>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '1ffe68ea-6d03-4cfa-bf87-428a146b4f13', 'attached_at': '', 'detached_at': '', 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'serial': '87dd0574-28d3-4410-8a6f-98472c1266d2'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:15:07.111473 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98297) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 03:15:07.218692 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Took 17.20 seconds to build instance.
May 28 03:15:07.261719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:07.263960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:07.263960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:07.263960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:07.263960 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:07.265877 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Terminating instance
May 28 03:15:07.301069 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:07.306884 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938107.3066149, 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:07.307087 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] VM Resumed (Lifecycle Event)
May 28 03:15:07.718709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6f392bfc-e6bf-4327-9ff3-ae212ee25d79 tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.709s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:07.767951 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:15:07.784552 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:07.786197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:07.807484 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:07.810677 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:07.812268 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:07.814385 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:07.831857 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:07.832995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:07.937325 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-51a5c95a-6555-41d4-8a49-dbaaa187f4bb req-7b88eac9-2aef-408b-be17-b753babb1f52 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-vif-unplugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:07.938078 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-51a5c95a-6555-41d4-8a49-dbaaa187f4bb req-7b88eac9-2aef-408b-be17-b753babb1f52 service nova] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:07.938457 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-51a5c95a-6555-41d4-8a49-dbaaa187f4bb req-7b88eac9-2aef-408b-be17-b753babb1f52 service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:07.938701 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-51a5c95a-6555-41d4-8a49-dbaaa187f4bb req-7b88eac9-2aef-408b-be17-b753babb1f52 service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:07.938979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-51a5c95a-6555-41d4-8a49-dbaaa187f4bb req-7b88eac9-2aef-408b-be17-b753babb1f52 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] No waiting events found dispatching network-vif-unplugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:07.939479 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-51a5c95a-6555-41d4-8a49-dbaaa187f4bb req-7b88eac9-2aef-408b-be17-b753babb1f52 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-vif-unplugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:08.069343 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.074407 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.107353 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Instance destroyed successfully.
May 28 03:15:08.107353 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lazy-loading 'resources' on Instance uuid 95c884f1-098c-4841-b409-9957d9790e81 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:08.107353 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:08.111374 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:08.121060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:08.124917 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:08.124917 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:08.134933 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:08.134933 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.143210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.149201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.161619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.161619 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.161619 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.161619 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.161619 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:08.161895 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.161895 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.161895 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.161895 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.161895 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:08.167143 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.167143 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.167143 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.167143 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.167143 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:08.167388 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.167388 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.167388 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.167388 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.167388 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:08.199126 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.50.100,3260]
May 28 03:15:08.199126 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.50.100,3260] successful.
May 28 03:15:08.199126 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.209114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.40.100,3260]
May 28 03:15:08.209114 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.40.100,3260] successful.
May 28 03:15:08.209114 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.214291 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.221472 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:08.229961 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.229961 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.229961 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.229961 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.229961 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.229961 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.229961 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:08.230328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.230328 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.230328 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.230328 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.230328 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.230328 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.230328 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:08.230520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:08.230520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:08.231177 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] HCTL ('11', '-', '-', 0) found on session 163 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:08.231285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:08.242576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.242576 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.242576 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.242576 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.242576 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.242576 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.242576 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:08.242920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.242920 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:08.242920 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.242920 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:08.242920 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.242920 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:08.242920 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:08.242920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:08.243468 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:08.244608 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] HCTL ('12', '-', '-', 0) found on session 164 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:08.244608 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:08.251916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching for a device in session 163 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:08.252088 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '35b4309c-191e-40b3-8267-f70adfb18215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:08.262370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching for a device in session 164 and hctl ['12', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:08.316600 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999722365000252 future=<Future at 0x7e4b644eca70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:08.320617 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.997819364999941 future=<Future at 0x7e4b644eca70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:08.320617 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.997637736999877 future=<Future at 0x7e4b644eca70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:08.487190 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-changed-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:08.487562 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Refreshing instance network info cache due to event network-changed-2d11ea6c-1462-45ed-bcf4-a50ad49582a9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:08.487720 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] Acquiring lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:08.487874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] Acquired lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:08.488027 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Refreshing network info cache for port 2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:08.607980 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:14:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-675092346',display_name='tempest-VolumesActionsTest-instance-675092346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesactionstest-instance-675092346',id=61,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:15:04Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ebcb42d7bedf40fdb71a3387ac762d16',ramdisk_id='',reservation_id='r-2zvpn38p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1775431530',owner_user_name='tempest-VolumesActionsTest-1775431530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:15:04Z,user_data=None,user_id='6f6feabdd5d64dd197ddca3bc6d05cf5',uuid=95c884f1-098c-4841-b409-9957d9790e81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:15:08.608206 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converting VIF {"id": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "address": "fa:16:3e:89:be:a8", "network": {"id": "b5696762-861d-4dce-964f-258ec2081a09", "bridge": "br-int", "label": "tempest-VolumesActionsTest-250026168-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ebcb42d7bedf40fdb71a3387ac762d16", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap706b41c4-e4", "ovs_interfaceid": "706b41c4-e466-4821-a9ea-8cb8dbf34302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:08.608759 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=706b41c4-e466-4821-a9ea-8cb8dbf34302,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706b41c4-e4') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:08.609088 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=706b41c4-e466-4821-a9ea-8cb8dbf34302,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706b41c4-e4') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:15:08.611271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.612070 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap706b41c4-e4, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:08.614468 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.614468 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:08.617506 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.617664 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5725fd1b-b386-4139-bf04-16ddb540e899) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:08.618268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.619062 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:08.619125 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:08.621044 np0000001589 nova-compute[98297]: INFO os_vif [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:be:a8,bridge_name='br-int',has_traffic_filtering=True,id=706b41c4-e466-4821-a9ea-8cb8dbf34302,network=Network(b5696762-861d-4dce-964f-258ec2081a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap706b41c4-e4')
May 28 03:15:08.621514 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Deleting instance files /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81_del
May 28 03:15:08.622356 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Deletion of /opt/stack/data/nova/instances/95c884f1-098c-4841-b409-9957d9790e81_del complete
May 28 03:15:08.995291 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:09.128638 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 03:15:09.129243 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:15:09.129526 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:15:09.129614 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 95c884f1-098c-4841-b409-9957d9790e81] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:15:09.129829 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:09.202800 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:09.259985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching for a device in session 164 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:09.260142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35b4309c-191e-40b3-8267-f70adfb18215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:09.328971 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:09.459528 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Updated VIF entry in instance network info cache for port 2d11ea6c-1462-45ed-bcf4-a50ad49582a9. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:15:09.460000 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Updating instance_info_cache with network_info: [{"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:09.930783 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:09.962996 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cf664506-1f8a-439a-b28c-af8de4e35fb8 req-89bf0237-3086-40f2-bb9a-883e644590e9 service nova] Releasing lock "refresh_cache-5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:09.990933 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82f69dc6-6af4-4982-9399-dc6357691b25 req-6f525358-a554-4a7b-a2ea-f25cf876dd15 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-vif-unplugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:09.991316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82f69dc6-6af4-4982-9399-dc6357691b25 req-6f525358-a554-4a7b-a2ea-f25cf876dd15 service nova] Acquiring lock "95c884f1-098c-4841-b409-9957d9790e81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:09.991487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82f69dc6-6af4-4982-9399-dc6357691b25 req-6f525358-a554-4a7b-a2ea-f25cf876dd15 service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:09.991619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-82f69dc6-6af4-4982-9399-dc6357691b25 req-6f525358-a554-4a7b-a2ea-f25cf876dd15 service nova] Lock "95c884f1-098c-4841-b409-9957d9790e81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:09.991751 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82f69dc6-6af4-4982-9399-dc6357691b25 req-6f525358-a554-4a7b-a2ea-f25cf876dd15 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] No waiting events found dispatching network-vif-unplugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:09.991900 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82f69dc6-6af4-4982-9399-dc6357691b25 req-6f525358-a554-4a7b-a2ea-f25cf876dd15 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-vif-unplugged-706b41c4-e466-4821-a9ea-8cb8dbf34302 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:09.992027 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-82f69dc6-6af4-4982-9399-dc6357691b25 req-6f525358-a554-4a7b-a2ea-f25cf876dd15 service nova] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Received event network-vif-deleted-706b41c4-e466-4821-a9ea-8cb8dbf34302 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:10.085618 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Found WWN 3300000004f1d2149 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:15:10.086024 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:10.086024 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] <== connect_volume: return (5823ms) {'type': 'block', 'scsi_wwn': '3300000004f1d2149', 'path': '/dev/dm-2', 'multipath_id': '3300000004f1d2149'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:10.086160 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004f1d2149', 'path': '/dev/dm-2', 'multipath_id': '3300000004f1d2149'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:15:10.086670 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.792s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:10.086897 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:15:10.091025 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'flavor' on Instance uuid b3f12e09-b318-4eb0-96cd-480a98f33784 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:10.099079 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:10.099602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:10.100081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:10.100271 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:10.101491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:10.101491 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:10.113597 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:10.113597 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:10.114907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:10.114907 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:10.124641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c] added
May 28 03:15:10.124641 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:10.124641 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:10.124641 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:10.124641 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:10.124641 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:10.124641 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:10.124808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:10.124902 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0246(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:10.125023 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c] added
May 28 03:15:10.129643 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:10.129643 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:10.129643 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:10.432592 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Took 1.30 seconds to deallocate network for instance.
May 28 03:15:10.596362 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Attempting to attach volume 35b4309c-191e-40b3-8267-f70adfb18215 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:15:10.597631 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:15:10.597631 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:15:10.597631 np0000001589 nova-compute[98297]:   <alias name="ua-35b4309c-191e-40b3-8267-f70adfb18215"/>
May 28 03:15:10.597631 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:15:10.597631 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:15:10.597631 np0000001589 nova-compute[98297]:   <serial>35b4309c-191e-40b3-8267-f70adfb18215</serial>
May 28 03:15:10.597631 np0000001589 nova-compute[98297]: </disk>
May 28 03:15:10.597631 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:15:10.938883 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:10.939062 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:11.028371 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:15:11.028371 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:15:11.028371 np0000001589 nova-compute[98297]:     <volume>87dd0574-28d3-4410-8a6f-98472c1266d2</volume>
May 28 03:15:11.028371 np0000001589 nova-compute[98297]:   </usage>
May 28 03:15:11.028371 np0000001589 nova-compute[98297]: </secret>
May 28 03:15:11.028371 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:15:11.125367 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:11.129980 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:11.136910 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:11.136910 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:11.142885 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:11.142885 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.149408 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.154118 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.163701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.163701 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.163701 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.163701 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.163701 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.163701 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.163701 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:11.163993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.163993 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.163993 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.163993 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.163993 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.163993 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.163993 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.170474 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:11.197193 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:11.197401 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:11.199292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.40.100,3260]
May 28 03:15:11.199292 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.40.100,3260] successful.
May 28 03:15:11.199292 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.211123 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.234682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.50.100,3260]
May 28 03:15:11.234682 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.50.100,3260] successful.
May 28 03:15:11.234682 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.239107 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] HCTL ('13', '-', '-', 0) found on session 165 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:11.239107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:11.246834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:11.252055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Searching for a device in session 165 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:11.252234 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:11.263266 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:11.263266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:11.263687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] HCTL ('14', '-', '-', 0) found on session 166 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:11.263687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:11.277240 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Searching for a device in session 166 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:11.277240 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:11.537622 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1878618183',display_name='tempest-TestVolumeBootPattern-server-1878618183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1878618183',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-ck2ch2wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:15:01Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=1ffe68ea-6d03-4cfa-bf87-428a146b4f13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:15:11.537818 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:11.538480 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ad:fd,bridge_name='br-int',has_traffic_filtering=True,id=8624031c-4ab2-4250-a752-4a535fa35794,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624031c-4a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:11.539687 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ffe68ea-6d03-4cfa-bf87-428a146b4f13 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:11.699753 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:12.045735 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] End _get_guest_xml xml=<domain type="qemu">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <uuid>1ffe68ea-6d03-4cfa-bf87-428a146b4f13</uuid>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <name>instance-0000003e</name>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-1878618183</nova:name>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:15:04</nova:creationTime>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:properties/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <nova:port uuid="8624031c-4ab2-4250-a752-4a535fa35794">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <system>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <entry name="serial">1ffe68ea-6d03-4cfa-bf87-428a146b4f13</entry>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <entry name="uuid">1ffe68ea-6d03-4cfa-bf87-428a146b4f13</entry>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </system>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <os>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   </os>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <features>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   </features>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   <devices>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13/disk.config"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <alias name="ua-87dd0574-28d3-4410-8a6f-98472c1266d2"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <serial>87dd0574-28d3-4410-8a6f-98472c1266d2</serial>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <encryption format="luks">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:         <secret type="passphrase" uuid="64170877-c7c9-45eb-8145-8c7c1bc70eab"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       </encryption>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:f1:ad:fd"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <target dev="tap8624031c-4a"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </interface>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13/console.log" append="off"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </serial>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <video>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </video>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </rng>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:   </devices>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]: </domain>
May 28 03:15:12.045735 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:15:12.047657 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Preparing to wait for external event network-vif-plugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:15:12.047657 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:12.047657 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:12.047657 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:12.047657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1878618183',display_name='tempest-TestVolumeBootPattern-server-1878618183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1878618183',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-ck2ch2wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:15:01Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=1ffe68ea-6d03-4cfa-bf87-428a146b4f13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:15:12.047657 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:12.048053 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ad:fd,bridge_name='br-int',has_traffic_filtering=True,id=8624031c-4ab2-4250-a752-4a535fa35794,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624031c-4a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:12.048287 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ad:fd,bridge_name='br-int',has_traffic_filtering=True,id=8624031c-4ab2-4250-a752-4a535fa35794,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624031c-4a') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:15:12.048519 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:12.048695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:12.048881 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:15:12.051781 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:12.051920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c2dcf1c3-139b-5682-a1c1-5bb14b9e380a', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:12.052674 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:12.053375 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:12.056241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:12.057662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:12.057771 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8624031c-4a, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:12.058011 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8624031c-4a, col_values=(('qos', UUID('6fd1b8e9-a810-4294-8ebe-caa033c2c89a')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:12.058149 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8624031c-4a, col_values=(('external_ids', {'iface-id': '8624031c-4ab2-4250-a752-4a535fa35794', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:ad:fd', 'vm-uuid': '1ffe68ea-6d03-4cfa-bf87-428a146b4f13'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:12.058877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:12.059716 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:12.064176 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:12.064516 np0000001589 nova-compute[98297]: INFO os_vif [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ad:fd,bridge_name='br-int',has_traffic_filtering=True,id=8624031c-4ab2-4250-a752-4a535fa35794,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624031c-4a')
May 28 03:15:12.101345 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:15:12.205730 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.267s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:12.246725 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Deleted allocations for instance 95c884f1-098c-4841-b409-9957d9790e81
May 28 03:15:12.262131 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:12.262259 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:12.262361 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:12.262452 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No VIF found with MAC fa:16:3e:64:95:a5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:15:13.115795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Found WWN 33000000058432922 for multipath device dm-3 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:15:13.115987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:13.116123 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] <== connect_volume: return (6821ms) {'type': 'block', 'scsi_wwn': '33000000058432922', 'path': '/dev/dm-3', 'multipath_id': '33000000058432922'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:13.116235 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000058432922', 'path': '/dev/dm-3', 'multipath_id': '33000000058432922'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:15:13.123134 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:13.253830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ed2ce126-3cdc-495e-8e40-797633371e98 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Lock "95c884f1-098c-4841-b409-9957d9790e81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.992s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:13.579796 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:13.579936 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:13.580043 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:f1:ad:fd, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:15:13.580483 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Using config drive
May 28 03:15:13.620330 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-976414582',display_name='tempest-TestVolumeBackupRestore-server-976414582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebackuprestore-server-976414582',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA948i9d6mjwa3n1s0B1LeP5YhllD0GTD3vDPYyK6tvNFM2wbDATTvLzE2wmUZxQDOxClnTd/LNwG9r4Un4NkkWsxydNuBE84OhCWNR9evjpGlIRnBghqNW9bvKvNVHGDw==',key_name='tempest-TestVolumeBackupRestore-215190599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73df2c139e08481d8909936bf4e3fb1e',ramdisk_id='',reservation_id='r-4yctb773',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-134083432',owner_user_name='tempest-TestVolumeBackupRestore-134083432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:15:04Z,user_data=None,user_id='0d063f87ec60481180c0c826e6182dfb',uuid=b2c78fb2-5f92-48bf-9fa8-5de1b2185b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:15:13.620585 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Converting VIF {"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:13.620980 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a,network=Network(61e086c2-037f-4889-9f4e-49b5f32257f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cbf8f78-83') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:13.621672 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c78fb2-5f92-48bf-9fa8-5de1b2185b27 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:13.807530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7ad99d52-1816-43f1-92e3-31c785820885 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.293s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:14.089612 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:14.124304 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] End _get_guest_xml xml=<domain type="qemu">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <uuid>b2c78fb2-5f92-48bf-9fa8-5de1b2185b27</uuid>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <name>instance-0000003f</name>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBackupRestore-server-976414582</nova:name>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:15:06</nova:creationTime>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:user uuid="0d063f87ec60481180c0c826e6182dfb">tempest-TestVolumeBackupRestore-134083432-project-member</nova:user>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:project uuid="73df2c139e08481d8909936bf4e3fb1e">tempest-TestVolumeBackupRestore-134083432</nova:project>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         <nova:port uuid="5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <system>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <entry name="serial">b2c78fb2-5f92-48bf-9fa8-5de1b2185b27</entry>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <entry name="uuid">b2c78fb2-5f92-48bf-9fa8-5de1b2185b27</entry>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </system>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <os>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   </os>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <features>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   </features>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   <devices>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27/disk.config"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <alias name="ua-63681720-6008-4c2e-b700-0a1b4ca5e56c"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-3"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <serial>63681720-6008-4c2e-b700-0a1b4ca5e56c</serial>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:92:02:33"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <target dev="tap5cbf8f78-83"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </interface>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27/console.log" append="off"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </serial>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <video>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </video>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </rng>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:   </devices>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]: </domain>
May 28 03:15:14.124304 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:15:14.126262 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Preparing to wait for external event network-vif-plugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:15:14.126262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:14.126262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:14.126262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:14.126262 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-976414582',display_name='tempest-TestVolumeBackupRestore-server-976414582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebackuprestore-server-976414582',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA948i9d6mjwa3n1s0B1LeP5YhllD0GTD3vDPYyK6tvNFM2wbDATTvLzE2wmUZxQDOxClnTd/LNwG9r4Un4NkkWsxydNuBE84OhCWNR9evjpGlIRnBghqNW9bvKvNVHGDw==',key_name='tempest-TestVolumeBackupRestore-215190599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='73df2c139e08481d8909936bf4e3fb1e',ramdisk_id='',reservation_id='r-4yctb773',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-134083432',owner_user_name='tempest-TestVolumeBackupRestore-134083432-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:15:04Z,user_data=None,user_id='0d063f87ec60481180c0c826e6182dfb',uuid=b2c78fb2-5f92-48bf-9fa8-5de1b2185b27,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:15:14.126262 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Converting VIF {"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:14.126262 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a,network=Network(61e086c2-037f-4889-9f4e-49b5f32257f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cbf8f78-83') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:14.126583 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a,network=Network(61e086c2-037f-4889-9f4e-49b5f32257f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cbf8f78-83') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:15:14.126798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.127109 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:14.127378 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:15:14.128053 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.128268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7b5626c-1575-5e18-b865-83efb1c13be1', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:14.129064 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.129493 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:14.134988 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.136859 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.137004 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cbf8f78-83, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:14.137317 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cbf8f78-83, col_values=(('qos', UUID('98ca4124-6e06-479e-b04b-6d2160657969')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:14.137469 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cbf8f78-83, col_values=(('external_ids', {'iface-id': '5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:02:33', 'vm-uuid': 'b2c78fb2-5f92-48bf-9fa8-5de1b2185b27'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:14.138271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.139502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:14.149101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.149199 np0000001589 nova-compute[98297]: INFO os_vif [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a,network=Network(61e086c2-037f-4889-9f4e-49b5f32257f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cbf8f78-83')
May 28 03:15:14.240885 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Creating config drive at /opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13/disk.config
May 28 03:15:14.244011 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpolnppzi_ {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:14.298348 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpolnppzi_" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:15:14.711551 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.746296 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.747514 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.830461 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:14.950034 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75c659eb-b8e4-472f-ba34-38aec98feccd req-0b40ac3f-b0a7-46d9-8baf-9593e29fb34f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-vif-plugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:14.950375 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75c659eb-b8e4-472f-ba34-38aec98feccd req-0b40ac3f-b0a7-46d9-8baf-9593e29fb34f service nova] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:14.950910 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75c659eb-b8e4-472f-ba34-38aec98feccd req-0b40ac3f-b0a7-46d9-8baf-9593e29fb34f service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:14.951092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75c659eb-b8e4-472f-ba34-38aec98feccd req-0b40ac3f-b0a7-46d9-8baf-9593e29fb34f service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:14.951239 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75c659eb-b8e4-472f-ba34-38aec98feccd req-0b40ac3f-b0a7-46d9-8baf-9593e29fb34f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Processing event network-vif-plugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:15:14.994137 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:15.031572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:15.037763 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:15.039414 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:15.062448 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:15.063135 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:15.675374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:15.675676 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:15.675676 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] No VIF found with MAC fa:16:3e:92:02:33, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:15:15.676067 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Using config drive
May 28 03:15:16.184044 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:16.288257 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Creating config drive at /opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27/disk.config
May 28 03:15:16.291058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfylvbgwx {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:16.344731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfylvbgwx" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:15:16.367310 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:15:16.368733 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938116.3675606, 1ffe68ea-6d03-4cfa-bf87-428a146b4f13 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:16.368733 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] VM Started (Lifecycle Event)
May 28 03:15:16.374503 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:15:16.379699 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Instance spawned successfully.
May 28 03:15:16.380159 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:15:16.734120 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:16.763799 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:16.854384 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:16.877381 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:16.881657 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:16.887719 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:16.887931 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:16.888277 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:16.888553 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:16.889163 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:16.889556 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:17.019353 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-vif-plugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:17.019894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:17.021410 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:17.021556 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:17.021699 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] No waiting events found dispatching network-vif-plugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:17.022039 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received unexpected event network-vif-plugged-8624031c-4ab2-4250-a752-4a535fa35794 for instance with vm_state building and task_state spawning.
May 28 03:15:17.022208 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-vif-plugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:17.022351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:17.022478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:17.022590 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:17.022697 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-591debd0-0021-46f4-bfdc-dd44b468702f req-10a410f0-a54b-4198-8a27-b69b3c814210 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Processing event network-vif-plugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:15:17.104874 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:17.108537 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:17.132921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:17.389265 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:15:17.389400 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938117.3892646, 1ffe68ea-6d03-4cfa-bf87-428a146b4f13 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:17.389504 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] VM Paused (Lifecycle Event)
May 28 03:15:17.393750 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Took 13.40 seconds to spawn the instance on the hypervisor.
May 28 03:15:17.393963 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:17.513234 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:15:17.516586 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:15:17.518825 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Instance spawned successfully.
May 28 03:15:17.519167 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:15:17.901343 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:17.901343 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938117.89535, 1ffe68ea-6d03-4cfa-bf87-428a146b4f13 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:17.901343 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] VM Resumed (Lifecycle Event)
May 28 03:15:17.906829 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Took 20.48 seconds to build instance.
May 28 03:15:18.028608 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:18.028788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:18.029087 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:18.029304 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:18.029571 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:18.029811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:15:18.123558 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:18.400083 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:18.402574 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:18.408698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.983s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:18.535072 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Took 12.26 seconds to spawn the instance on the hypervisor.
May 28 03:15:18.535216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:18.907991 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938118.90769, b2c78fb2-5f92-48bf-9fa8-5de1b2185b27 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:18.910274 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] VM Started (Lifecycle Event)
May 28 03:15:19.044386 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Took 20.64 seconds to build instance.
May 28 03:15:19.089164 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-192138c7-c501-44ec-8446-842b92824f09 req-41897137-232a-4a24-8bcc-ea921ff58435 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-vif-plugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:19.089341 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-192138c7-c501-44ec-8446-842b92824f09 req-41897137-232a-4a24-8bcc-ea921ff58435 service nova] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:19.089511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-192138c7-c501-44ec-8446-842b92824f09 req-41897137-232a-4a24-8bcc-ea921ff58435 service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:19.089614 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-192138c7-c501-44ec-8446-842b92824f09 req-41897137-232a-4a24-8bcc-ea921ff58435 service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:19.089733 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-192138c7-c501-44ec-8446-842b92824f09 req-41897137-232a-4a24-8bcc-ea921ff58435 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] No waiting events found dispatching network-vif-plugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:19.089885 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-192138c7-c501-44ec-8446-842b92824f09 req-41897137-232a-4a24-8bcc-ea921ff58435 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received unexpected event network-vif-plugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a for instance with vm_state active and task_state None.
May 28 03:15:19.139539 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:19.211239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:19.211436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:19.211617 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:19.211771 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:19.211883 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:19.213927 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Terminating instance
May 28 03:15:19.410397 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:19.413036 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:19.546141 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-faf915fa-d117-4724-b19d-e1504238bded tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.153s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:19.716946 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:15:19.738665 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:19.741062 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:19.766128 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:19.769974 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:19.796466 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:19.797049 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:19.915760 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938119.9154954, b2c78fb2-5f92-48bf-9fa8-5de1b2185b27 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:19.916185 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] VM Paused (Lifecycle Event)
May 28 03:15:20.029803 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:20.039599 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:20.068656 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Instance destroyed successfully.
May 28 03:15:20.070051 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid 1ffe68ea-6d03-4cfa-bf87-428a146b4f13 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:20.291800 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:20.292095 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing instance network info cache due to event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:20.292627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] Acquiring lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:20.292819 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] Acquired lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:20.293055 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:20.418217 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:20.421708 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938120.4214833, b2c78fb2-5f92-48bf-9fa8-5de1b2185b27 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:20.421854 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] VM Resumed (Lifecycle Event)
May 28 03:15:20.575251 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:14:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1878618183',display_name='tempest-TestVolumeBootPattern-server-1878618183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1878618183',id=62,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:15:17Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-ck2ch2wm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:15:17Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=1ffe68ea-6d03-4cfa-bf87-428a146b4f13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:15:20.575582 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "8624031c-4ab2-4250-a752-4a535fa35794", "address": "fa:16:3e:f1:ad:fd", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8624031c-4a", "ovs_interfaceid": "8624031c-4ab2-4250-a752-4a535fa35794", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:20.576452 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ad:fd,bridge_name='br-int',has_traffic_filtering=True,id=8624031c-4ab2-4250-a752-4a535fa35794,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624031c-4a') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:20.576809 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ad:fd,bridge_name='br-int',has_traffic_filtering=True,id=8624031c-4ab2-4250-a752-4a535fa35794,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624031c-4a') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:15:20.579765 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:20.579765 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8624031c-4a, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:20.579765 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:20.581014 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:20.581579 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:20.581793 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fd1b8e9-a810-4294-8ebe-caa033c2c89a) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:20.582374 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:20.583025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:20.584262 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:20.587441 np0000001589 nova-compute[98297]: INFO os_vif [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ad:fd,bridge_name='br-int',has_traffic_filtering=True,id=8624031c-4ab2-4250-a752-4a535fa35794,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8624031c-4a')
May 28 03:15:20.589659 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:15:20.590083 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:20.590302 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:20.590743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:20.591178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '87dd0574-28d3-4410-8a6f-98472c1266d2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:15:20.591828 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f202d2da-13f9-4dc0-a66b-3a08a5609ff7 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:20.621378 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [162] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [167] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f202d2da-13f9-4dc0-a66b-3a08a5609ff7 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [168] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: tcp: [169] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:20.622160 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', '161'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f202d2da-13f9-4dc0-a66b-3a08a5609ff7', '167'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34', '168'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34', '169')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:15:20.622160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', '161')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:20.623067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2', '162')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:20.623794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b800a4b80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:15:20.623996 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:15:20.624281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 330000000d8d46a9d {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:15:20.660937 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:20.720967 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:20.770211 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:15:20.770211 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:15:20.773159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:15:20.787070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:15:20.787070 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:15:20.797458 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:20.809176 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:20.849145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.40.100,3260]
May 28 03:15:20.849145 np0000001589 nova-compute[98297]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.40.100,3260] successful.
May 28 03:15:20.849145 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:20.875658 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:20.895704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:20.926708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:20.932122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.50.100,3260]
May 28 03:15:20.932122 np0000001589 nova-compute[98297]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-87dd0574-28d3-4410-8a6f-98472c1266d2, portal: 192.168.50.100,3260] successful.
May 28 03:15:20.932122 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:20.932122 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:20.955620 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:20.956358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:20.958256 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (365ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:20.958256 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:15:20.958256 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Deleting instance files /opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13_del
May 28 03:15:20.958256 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Deletion of /opt/stack/data/nova/instances/1ffe68ea-6d03-4cfa-bf87-428a146b4f13_del complete
May 28 03:15:21.089331 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:21.089868 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing instance network info cache due to event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:21.089868 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] Acquiring lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:21.153982 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-vif-unplugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:21.154211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:21.154675 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:21.154910 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:21.154979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] No waiting events found dispatching network-vif-unplugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:21.155125 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-vif-unplugged-8624031c-4ab2-4250-a752-4a535fa35794 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:21.155408 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-vif-unplugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:21.155608 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] Acquiring lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:21.155818 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:21.155956 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:21.156104 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] No waiting events found dispatching network-vif-unplugged-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:21.156284 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8ef5a7cf-1550-41c6-9187-d646db8d8367 req-22d58814-5f24-41b8-92bd-6a49e8cf056f service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-vif-unplugged-8624031c-4ab2-4250-a752-4a535fa35794 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:21.214947 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:21.375603 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updated VIF entry in instance network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:15:21.375924 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating instance_info_cache with network_info: [{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:21.437680 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999744135000128 future=<Future at 0x7e4b4055dca0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:21.466365 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Took 1.75 seconds to destroy the instance on the hypervisor.
May 28 03:15:21.466848 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:15:21.467077 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:15:21.467192 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:15:21.467447 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:21.545463 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:21.878848 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72d8e066-e46e-4ef4-9124-b14f2a4682e5 req-d79e8008-99b5-43e5-9358-71206860a66d service nova] Releasing lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:21.879369 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] Acquired lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:21.881445 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:22.314388 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:22.382902 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:22.727751 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:22.818304 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Took 1.35 seconds to deallocate network for instance.
May 28 03:15:22.883765 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updated VIF entry in instance network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:15:22.884044 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating instance_info_cache with network_info: [{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:23.126956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:23.155477 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:23.156692 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing instance network info cache due to event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:23.156906 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] Acquiring lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:23.316650 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00033103799978562165 future=<Future at 0x7e4b644eca70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:23.317156 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:23.317156 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=13.120492438999918 future=<Future at 0x7e4b4055dca0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:23.317156 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=13.120428160000301 future=<Future at 0x7e4b4055dca0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:23.317156 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938108.3162017, 95c884f1-098c-4841-b409-9957d9790e81 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:23.317316 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] VM Stopped (Lifecycle Event)
May 28 03:15:23.378917 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Took 0.56 seconds to detach 1 volumes for instance.
May 28 03:15:23.387575 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23626dfe-0c19-4e82-98f6-3c4c4be87dbe req-801d9ff6-c60c-4573-bb7b-ebda5ebd52fb service nova] Releasing lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:23.388515 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] Acquired lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:23.388691 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:23.822350 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-246aa8a6-5cba-4789-b086-9a03c41ed9b1 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 95c884f1-098c-4841-b409-9957d9790e81] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:23.886828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:23.887008 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:23.891256 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:24.223271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:24.223271 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:24.332948 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:24.462308 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updated VIF entry in instance network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:15:24.462308 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating instance_info_cache with network_info: [{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:24.725190 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:24.963423 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] Releasing lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:24.964081 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0ab62bc5-9a83-4378-932e-02b22179f985 req-18637d74-32bb-4ff2-9e12-37569712a1e8 service nova] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Received event network-vif-deleted-8624031c-4ab2-4250-a752-4a535fa35794 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:25.232399 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.345s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:25.302872 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance 1ffe68ea-6d03-4cfa-bf87-428a146b4f13
May 28 03:15:25.584525 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:26.313461 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0361b9f0-4e89-4da6-9ccf-15efba4e27cc tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "1ffe68ea-6d03-4cfa-bf87-428a146b4f13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.102s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:28.127360 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:30.327855 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:30.328435 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:30.585283 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:30.830664 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:15:31.379708 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:31.379708 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:31.382403 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:15:31.382654 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Claim successful on node np0000001589
May 28 03:15:32.632983 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:32.633351 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:33.128475 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:33.135492 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:33.642439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.263s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:33.642826 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:15:34.137833 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:34.138353 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:34.150014 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:15:34.150202 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:15:34.150444 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:34.150641 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:34.242071 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:15:34.645913 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Successfully created port: 48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:15:34.657724 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:15:35.060165 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Successfully updated port: 48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:15:35.120256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:35.120256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:35.139588 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-changed-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:35.139709 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Refreshing instance network info cache due to event network-changed-48103813-f1cf-4dbe-842b-1621e6d75f00. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:35.139878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] Acquiring lock "refresh_cache-61e40109-5291-419e-9dfb-5e53e679a121" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:35.139990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] Acquired lock "refresh_cache-61e40109-5291-419e-9dfb-5e53e679a121" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:35.140121 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Refreshing network info cache for port 48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:35.162189 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:15:35.562023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-61e40109-5291-419e-9dfb-5e53e679a121" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:35.586753 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:35.619842 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Detaching volume 35b4309c-191e-40b3-8267-f70adfb18215
May 28 03:15:35.643170 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:35.663571 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Attempting to driver detach volume 35b4309c-191e-40b3-8267-f70adfb18215 from mountpoint /dev/vdb
May 28 03:15:35.668109 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Booting with volume 8ae0a8f2-8c00-466d-932b-657f19ea0b12 at /dev/vda
May 28 03:15:35.670036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Found disk vdb by alias ua-35b4309c-191e-40b3-8267-f70adfb18215 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:15:35.671314 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Found disk vdb by alias ua-35b4309c-191e-40b3-8267-f70adfb18215 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:15:35.671466 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Attempting to detach device vdb from instance b3f12e09-b318-4eb0-96cd-480a98f33784 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:15:35.671784 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:15:35.671784 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:15:35.671784 np0000001589 nova-compute[98297]:   <alias name="ua-35b4309c-191e-40b3-8267-f70adfb18215"/>
May 28 03:15:35.671784 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:15:35.671784 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:15:35.671784 np0000001589 nova-compute[98297]:   <serial>35b4309c-191e-40b3-8267-f70adfb18215</serial>
May 28 03:15:35.671784 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:15:35.671784 np0000001589 nova-compute[98297]: </disk>
May 28 03:15:35.671784 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:15:35.677892 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully detached device vdb from instance b3f12e09-b318-4eb0-96cd-480a98f33784 from the persistent domain config.
May 28 03:15:35.678271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] (1/8): Attempting to detach device vdb with device alias ua-35b4309c-191e-40b3-8267-f70adfb18215 from instance b3f12e09-b318-4eb0-96cd-480a98f33784 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:15:35.678570 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:15:35.678570 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:15:35.678570 np0000001589 nova-compute[98297]:   <alias name="ua-35b4309c-191e-40b3-8267-f70adfb18215"/>
May 28 03:15:35.678570 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:15:35.678570 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:15:35.678570 np0000001589 nova-compute[98297]:   <serial>35b4309c-191e-40b3-8267-f70adfb18215</serial>
May 28 03:15:35.678570 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:15:35.678570 np0000001589 nova-compute[98297]: </disk>
May 28 03:15:35.678570 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:15:35.722624 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:15:35.725094 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:35.736910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:15:35.758320 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:35.799613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:15:35.800706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:15:35.813254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:15:35.813254 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe64:95a5', 'fe80::68f8:b7ff:fe71:d00c', 'fe80::fc16:3eff:fe43:f00b', 'fe80::ac8c:9cff:fe07:8685', 'fe80::fc16:3eff:fe92:233', 'fe80::5056:39ff:fe08:97fc'] 
May 28 03:15:35.813254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:15:35.813254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:15:35.813254 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:35.813254 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Updating existing volume attachment record: 3d6553de-3d36-4f53-ae69-6296cf435d21 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:15:35.873751 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:36.135414 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938136.1350188, b3f12e09-b318-4eb0-96cd-480a98f33784 => ua-35b4309c-191e-40b3-8267-f70adfb18215> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:15:36.135853 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-35b4309c-191e-40b3-8267-f70adfb18215 for instance b3f12e09-b318-4eb0-96cd-480a98f33784 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:15:36.138415 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully detached device vdb from instance b3f12e09-b318-4eb0-96cd-480a98f33784 from the live domain config.
May 28 03:15:36.139409 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:15:36.139822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35b4309c-191e-40b3-8267-f70adfb18215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:36.139965 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:36.140383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:36.140714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35b4309c-191e-40b3-8267-f70adfb18215', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:15:36.140857 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:36.164480 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215 (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:36.164785 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:36.164785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', '164'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34', '170'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34', '171')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:15:36.165012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', '164')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:36.166207 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215', '163')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:36.166957 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646d1f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215'): ({'sdf'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:15:36.167156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Removing multipathed devices sdf, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:15:36.167414 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Flush multipath device 3300000004f1d2149 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:15:36.199363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:36.235811 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:36.290653 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:15:36.290891 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:15:36.293406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:15:36.303985 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:15:36.304171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:15:36.315102 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:36.346396 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 164, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.40.100,3260]
May 28 03:15:36.346396 np0000001589 nova-compute[98297]: Logout of [sid: 164, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.40.100,3260] successful.
May 28 03:15:36.346396 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:36.362192 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:36.373972 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:36.376914 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-313d6143-e4c0-493c-8a3c-44a09d26d8e4 req-4c0bf547-75db-4bc3-8172-d687478e30cc service nova] Releasing lock "refresh_cache-61e40109-5291-419e-9dfb-5e53e679a121" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:36.377440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-61e40109-5291-419e-9dfb-5e53e679a121" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:36.377596 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:15:36.406044 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.50.100,3260]
May 28 03:15:36.406044 np0000001589 nova-compute[98297]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-35b4309c-191e-40b3-8267-f70adfb18215, portal: 192.168.50.100,3260] successful.
May 28 03:15:36.406044 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:36.421992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:36.422208 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:36.422361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] <== disconnect_volume: return (282ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:36.422496 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:15:36.437976 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00033856199979709345 future=<Future at 0x7e4b4055dca0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:36.437976 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:36.438717 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] Emitting event <LifecycleEvent: 1779938121.4372058, 1ffe68ea-6d03-4cfa-bf87-428a146b4f13 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:36.438900 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] VM Stopped (Lifecycle Event)
May 28 03:15:36.945239 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-b054a734-e244-4694-8f48-32180c4b3189 tempest-VolumesActionsTest-1775431530 tempest-VolumesActionsTest-1775431530-project-member] [instance: 1ffe68ea-6d03-4cfa-bf87-428a146b4f13] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:36.972610 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:15:36.976065 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'flavor' on Instance uuid b3f12e09-b318-4eb0-96cd-480a98f33784 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:37.134053 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:37.270701 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Updating instance_info_cache with network_info: [{"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:37.774240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-61e40109-5291-419e-9dfb-5e53e679a121" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:37.774541 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Instance network_info: |[{"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:15:37.985965 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae89e47b-b6e4-40f1-a316-2ea7b44fff7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.868s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:38.001015 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:15:38.002188 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:15:38.002440 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Creating image(s)
May 28 03:15:38.003049 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:15:38.003049 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Ensure instance console log exists: /opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:15:38.003200 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:38.003326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:38.003445 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:38.003887 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Start _get_guest_xml network_info=[{"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '3d6553de-3d36-4f53-ae69-6296cf435d21', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '61e40109-5291-419e-9dfb-5e53e679a121', 'attached_at': '', 'detached_at': '', 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'serial': '8ae0a8f2-8c00-466d-932b-657f19ea0b12'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:15:38.007724 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:15:38.008877 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1919344336', uuid='61e40109-5291-419e-9dfb-5e53e679a121'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938138.0084643) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:15:38.010041 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:15:38.010387 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:15:38.011354 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:15:38.011473 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:15:38.013186 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:15:38.013477 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:15:38.013619 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:15:38.013725 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:15:38.013838 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:15:38.013920 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:15:38.014043 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:15:38.014199 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:15:38.014316 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:15:38.014419 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:15:38.014519 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:15:38.014650 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:15:38.023953 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:15:38.024212 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:38.024333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:38.024902 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:38.025071 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:15:38.036810 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:38.037266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:38.037795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:38.038003 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:38.038391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:38.038621 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:38.050560 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:38.050560 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:38.056366 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:15:38.056366 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:38.062615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12] added
May 28 03:15:38.062615 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:38.062615 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:38.062615 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:38.062615 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:38.062615 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:38.062615 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:38.062615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:38.063003 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0248(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:38.063003 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12] added
May 28 03:15:38.071425 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:15:38.071425 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:15:38.071425 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:15:38.129822 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:38.359111 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:38.359245 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:38.359353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:38.359475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:38.359578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:38.362906 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Terminating instance
May 28 03:15:38.867159 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:15:38.885304 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:38.887381 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:38.906021 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:38.908208 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:38.925843 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:38.931295 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:39.020492 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5838459c-86f5-4d91-897c-62acc9fd86b3 req-be3c2cf3-76bb-4924-926b-d6609347d921 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-vif-unplugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:39.020988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5838459c-86f5-4d91-897c-62acc9fd86b3 req-be3c2cf3-76bb-4924-926b-d6609347d921 service nova] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:39.020988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5838459c-86f5-4d91-897c-62acc9fd86b3 req-be3c2cf3-76bb-4924-926b-d6609347d921 service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:39.020988 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5838459c-86f5-4d91-897c-62acc9fd86b3 req-be3c2cf3-76bb-4924-926b-d6609347d921 service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:39.021084 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5838459c-86f5-4d91-897c-62acc9fd86b3 req-be3c2cf3-76bb-4924-926b-d6609347d921 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] No waiting events found dispatching network-vif-unplugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:39.021179 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5838459c-86f5-4d91-897c-62acc9fd86b3 req-be3c2cf3-76bb-4924-926b-d6609347d921 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-vif-unplugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:39.063338 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:15:39.071856 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:39.081326 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:39.081326 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:15:39.090181 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:15:39.090181 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.101706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.109134 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.118865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.118865 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.118865 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.118865 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.118865 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.118865 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.118865 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:39.119027 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.119027 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.119027 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.119027 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.119027 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.119027 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.119027 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:39.127379 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.127379 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.127379 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.127379 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.127379 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.127379 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.127379 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:39.127672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.127672 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.127672 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.127672 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.127672 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.127672 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.127672 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:39.137989 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:39.163795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.40.100,3260]
May 28 03:15:39.163795 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.40.100,3260] successful.
May 28 03:15:39.163795 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.176496 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.181793 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.50.100,3260]
May 28 03:15:39.181793 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.50.100,3260] successful.
May 28 03:15:39.181793 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.194872 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.195489 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.196029 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:39.196202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:39.196202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:39.197119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('11', '-', '-', 0) found on session 172 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:39.197237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:39.203269 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999830686000223 future=<Future at 0x7e4b406c6bd0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:39.203414 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999647275999905 future=<Future at 0x7e4b406c6bd0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:39.203414 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999551408000116 future=<Future at 0x7e4b406c6bd0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:39.204283 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Instance destroyed successfully.
May 28 03:15:39.205429 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'resources' on Instance uuid b3f12e09-b318-4eb0-96cd-480a98f33784 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [170] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [171] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-60235308-bb4a-4f35-9d41-0f98d0202d34 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:39.213135 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 172 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:39.213135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:39.214052 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('12', '-', '-', 0) found on session 173 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:15:39.214052 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:15:39.229339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 173 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:15:39.229339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:15:39.649929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:39.650238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:39.650448 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:39.650665 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:15:39.707746 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1523192767',display_name='tempest-VolumesBackupsTest-instance-1523192767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesbackupstest-instance-1523192767',id=58,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1NAY+mgQzyaBhPCNN6ZZWoEkBTpti1QTNI2bm6cwOvD3Z/uo4DOyQBhWf5XfkDJCoee9Kr0I6+uCSh2c2aukLqq70xiJ1HiwcoNARZt6RzqC5xFd793JkcG0tptTAXVw==',key_name='tempest-keypair-1506203207',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:14:23Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6a1526383440ceb5b3f69f7492d966',ramdisk_id='',reservation_id='r-q4uem06s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1005474821',owner_user_name='tempest-VolumesBackupsTest-1005474821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='833c35fdd92b4929b9f3c40ffb29b3c5',uuid=b3f12e09-b318-4eb0-96cd-480a98f33784,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:15:39.707953 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converting VIF {"id": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "address": "fa:16:3e:64:95:a5", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4b8a525-ce", "ovs_interfaceid": "b4b8a525-ce57-4aeb-a291-a3f999bebb3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:39.708563 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:95:a5,bridge_name='br-int',has_traffic_filtering=True,id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b8a525-ce') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:39.708797 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:95:a5,bridge_name='br-int',has_traffic_filtering=True,id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b8a525-ce') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:15:39.710079 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:39.710324 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4b8a525-ce, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:39.711384 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:39.712084 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:39.712762 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:39.712894 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=82168151-a8ce-46c0-b07a-a664e1c90e96) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:39.713286 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:39.713712 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:39.713821 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:39.715217 np0000001589 nova-compute[98297]: INFO os_vif [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:95:a5,bridge_name='br-int',has_traffic_filtering=True,id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4b8a525-ce')
May 28 03:15:39.715476 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Deleting instance files /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784_del
May 28 03:15:39.716159 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Deletion of /opt/stack/data/nova/instances/b3f12e09-b318-4eb0-96cd-480a98f33784_del complete
May 28 03:15:40.038409 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:15:40.221654 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:15:40.222957 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:15:40.223117 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:15:40.223184 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:15:40.223399 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:40.329349 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:40.672083 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:15:40.672902 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Error from libvirt while getting description of instance-0000003a: [Error Code 42] Domain not found: no domain with matching uuid 'b3f12e09-b318-4eb0-96cd-480a98f33784' (instance-0000003a): libvirt.libvirtError: Domain not found: no domain with matching uuid 'b3f12e09-b318-4eb0-96cd-480a98f33784' (instance-0000003a)
May 28 03:15:40.674209 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:15:40.675665 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:15:40.676363 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:40.694595 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-27a03011-1ced-4fbc-bbc1-0b0e10a80c07 req-f0f2efaa-76b3-4748-82f7-372b3b03dad4 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-vif-deleted-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:40.695032 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-27a03011-1ced-4fbc-bbc1-0b0e10a80c07 req-f0f2efaa-76b3-4748-82f7-372b3b03dad4 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Neutron deleted interface b4b8a525-ce57-4aeb-a291-a3f999bebb3b; detaching it from the instance and deleting it from the info cache
May 28 03:15:40.700668 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-27a03011-1ced-4fbc-bbc1-0b0e10a80c07 req-f0f2efaa-76b3-4748-82f7-372b3b03dad4 service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Detach interface failed, port_id=b4b8a525-ce57-4aeb-a291-a3f999bebb3b, reason: Instance b3f12e09-b318-4eb0-96cd-480a98f33784 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:15:40.723380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:15:40.723701 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=12998MB free_disk=72.79269409179688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:15:40.723844 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:40.724034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:41.052351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 3300000007f58060e for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:15:41.052788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:41.053988 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000007f58060e', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '3300000007f58060e'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:41.054127 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f58060e', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '3300000007f58060e'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:15:41.073016 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c73b091-f7d3-49e4-a45e-799e84b0841f req-c982f596-3271-4e91-be84-42f2dcfe38fb service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-vif-unplugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:41.073239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c73b091-f7d3-49e4-a45e-799e84b0841f req-c982f596-3271-4e91-be84-42f2dcfe38fb service nova] Acquiring lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:41.073443 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c73b091-f7d3-49e4-a45e-799e84b0841f req-c982f596-3271-4e91-be84-42f2dcfe38fb service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:41.073589 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c73b091-f7d3-49e4-a45e-799e84b0841f req-c982f596-3271-4e91-be84-42f2dcfe38fb service nova] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:41.073725 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c73b091-f7d3-49e4-a45e-799e84b0841f req-c982f596-3271-4e91-be84-42f2dcfe38fb service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] No waiting events found dispatching network-vif-unplugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:41.073843 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c73b091-f7d3-49e4-a45e-799e84b0841f req-c982f596-3271-4e91-be84-42f2dcfe38fb service nova] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Received event network-vif-unplugged-b4b8a525-ce57-4aeb-a291-a3f999bebb3b for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:41.081512 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '61e40109-5291-419e-9dfb-5e53e679a121', 'attached_at': '', 'detached_at': '', 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'serial': '8ae0a8f2-8c00-466d-932b-657f19ea0b12'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:15:41.082084 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:15:41.082282 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:15:41.082417 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:15:41.083137 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7e4b40576630>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '61e40109-5291-419e-9dfb-5e53e679a121', 'attached_at': '', 'detached_at': '', 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'serial': '8ae0a8f2-8c00-466d-932b-657f19ea0b12'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:15:41.083304 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98297) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 28 03:15:41.083415 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] opening encrypted volume /dev/dm-2 {{(pid=98297) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 03:15:41.110166 np0000001589 nova-compute[98297]: WARNING os_brick.encryptors.luks [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 03:15:41.110314 np0000001589 nova-compute[98297]: INFO os_brick.encryptors.luks [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] /dev/dm-2 is not a valid LUKS device; formatting device for first use
May 28 03:15:41.110411 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] formatting encrypted volume /dev/dm-2 {{(pid=98297) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 03:15:41.142201 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:41.644079 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Took 1.42 seconds to deallocate network for instance.
May 28 03:15:41.772119 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b3f12e09-b318-4eb0-96cd-480a98f33784 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:15:41.772235 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:15:41.772342 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b2c78fb2-5f92-48bf-9fa8-5de1b2185b27 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:15:41.772431 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 61e40109-5291-419e-9dfb-5e53e679a121 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:15:41.772581 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:15:41.772704 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:15:40 up 43 min,  2 users,  load average: 6.08, 6.38, 4.90\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_f79d7d10d3654992aab71cc666e52080': '1', 'io_workload': '1', 'num_proj_73df2c139e08481d8909936bf4e3fb1e': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_26deda1c00a84355951239b1a62997e8': '1', 'num_task_deleting': '1', 'num_proj_8a6a1526383440ceb5b3f69f7492d966': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:15:42.010483 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:42.010634 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:42.150651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:42.515860 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:43.028386 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:15:43.028537 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.304s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:43.028931 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:43.031923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.881s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:43.134033 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:43.261248 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:43.261248 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:43.767019 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:44.028704 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:44.029012 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:44.029312 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:44.029464 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:15:44.029702 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:44.138040 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:44.138541 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:44.274047 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.241s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:44.364863 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Deleted allocations for instance b3f12e09-b318-4eb0-96cd-480a98f33784
May 28 03:15:44.733343 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:44.847057 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:45.368905 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:45.369382 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:45.369382 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:45.369382 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:45.369535 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:45.383776 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Terminating instance
May 28 03:15:45.413931 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6fac4043-6081-46a6-95f4-60796962d3be tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "b3f12e09-b318-4eb0-96cd-480a98f33784" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.055s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:45.910254 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:15:45.949778 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:45.951788 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:45.975462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:45.975462 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:45.999074 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:46.134803 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:46.137833 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:46.190558 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b0c46ef3-55c8-403c-98e1-dd1828240afe req-5b8fe418-7a56-45bc-8874-5acc0c3f4986 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:46.190844 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b0c46ef3-55c8-403c-98e1-dd1828240afe req-5b8fe418-7a56-45bc-8874-5acc0c3f4986 service nova] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:46.190984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b0c46ef3-55c8-403c-98e1-dd1828240afe req-5b8fe418-7a56-45bc-8874-5acc0c3f4986 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:46.191416 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b0c46ef3-55c8-403c-98e1-dd1828240afe req-5b8fe418-7a56-45bc-8874-5acc0c3f4986 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:46.191564 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b0c46ef3-55c8-403c-98e1-dd1828240afe req-5b8fe418-7a56-45bc-8874-5acc0c3f4986 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] No waiting events found dispatching network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:46.191713 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b0c46ef3-55c8-403c-98e1-dd1828240afe req-5b8fe418-7a56-45bc-8874-5acc0c3f4986 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:46.299811 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999694683000143 future=<Future at 0x7e4b40552540 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:46.302068 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Instance destroyed successfully.
May 28 03:15:46.304484 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lazy-loading 'resources' on Instance uuid 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:46.806933 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-816037441',display_name='tempest-TestEncryptedCinderVolumes-server-816037441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testencryptedcindervolumes-server-816037441',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNi3vJNnDIElDEAAwxPUVBXZKn7sMCbEuglEXeMuNQartNpc8N/d1RU1Uw75nYeLhX6jbFMlPSftQ7+doVErlwwXTaS2ozDh0aq8sEOq1mhbuF2kYDA+aAw4tl2xir1Z7w==',key_name='tempest-TestEncryptedCinderVolumes-336152319',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:15:06Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f79d7d10d3654992aab71cc666e52080',ramdisk_id='',reservation_id='r-8xjvc4fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-124411028',owner_user_name='tempest-TestEncryptedCinderVolumes-124411028-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:15:07Z,user_data=None,user_id='3c083fd5d4f04c58b1c5ecc8cae5ffce',uuid=5cf91eef-3929-48c5-8ff2-4ae1ee6b3623,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:15:46.807379 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converting VIF {"id": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "address": "fa:16:3e:43:f0:0b", "network": {"id": "4df6cdb0-4dbf-45d4-b19a-a91c2a22c997", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1057815226-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f79d7d10d3654992aab71cc666e52080", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d11ea6c-14", "ovs_interfaceid": "2d11ea6c-1462-45ed-bcf4-a50ad49582a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:46.807925 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:f0:0b,bridge_name='br-int',has_traffic_filtering=True,id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d11ea6c-14') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:46.808297 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:f0:0b,bridge_name='br-int',has_traffic_filtering=True,id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d11ea6c-14') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:15:46.809971 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:46.810246 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d11ea6c-14, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:46.811372 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:46.812137 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:46.812851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:46.812987 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0ff14f0-3cb1-4683-b67f-4d17608c31b8) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:46.813418 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:46.813923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:46.815615 np0000001589 nova-compute[98297]: INFO os_vif [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:f0:0b,bridge_name='br-int',has_traffic_filtering=True,id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9,network=Network(4df6cdb0-4dbf-45d4-b19a-a91c2a22c997),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d11ea6c-14')
May 28 03:15:46.818703 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:15:46.819080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:46.819336 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:46.819871 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:46.820218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '566dcaf0-c7fb-4b22-870b-f4642480a9a1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:15:46.820397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:15:46.845217 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:46.845217 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:46.845217 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:46.845217 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:46.845217 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:46.845217 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:46.845217 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsi session list stdout=tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1 (non-flash)
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:46.845615 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '173')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:15:46.845615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '159')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:46.846414 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1', '160')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:46.847101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64452520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:15:46.847293 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:15:46.847562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Flush multipath device 3300000001ddf45b2 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:15:46.887484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:46.935053 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:46.977664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:15:46.977664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:15:46.977664 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:15:46.989244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:15:46.989624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:15:46.999709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:47.033123 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 159, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.40.100,3260]
May 28 03:15:47.033123 np0000001589 nova-compute[98297]: Logout of [sid: 159, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.40.100,3260] successful.
May 28 03:15:47.033123 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:47.047636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:47.057784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:47.083245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.50.100,3260]
May 28 03:15:47.083245 np0000001589 nova-compute[98297]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-566dcaf0-c7fb-4b22-870b-f4642480a9a1, portal: 192.168.50.100,3260] successful.
May 28 03:15:47.083245 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:47.096632 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:47.099993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:47.099993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] <== disconnect_volume: return (277ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:47.099993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:15:47.099993 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Deleting instance files /opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623_del
May 28 03:15:47.099993 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Deletion of /opt/stack/data/nova/instances/5cf91eef-3929-48c5-8ff2-4ae1ee6b3623_del complete
May 28 03:15:47.605143 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Took 1.70 seconds to destroy the instance on the hypervisor.
May 28 03:15:47.605864 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:15:47.606235 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:15:47.606347 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:15:47.606886 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:47.674271 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:48.133388 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:48.232377 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0c3e6766-61e0-4458-8957-941d0072a0a6 req-c5f22997-4b4d-48e2-a0dc-1b09616f0735 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-deleted-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:48.232755 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-0c3e6766-61e0-4458-8957-941d0072a0a6 req-c5f22997-4b4d-48e2-a0dc-1b09616f0735 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Neutron deleted interface 2d11ea6c-1462-45ed-bcf4-a50ad49582a9; detaching it from the instance and deleting it from the info cache
May 28 03:15:48.234609 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0c3e6766-61e0-4458-8957-941d0072a0a6 req-c5f22997-4b4d-48e2-a0dc-1b09616f0735 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Detach interface failed, port_id=2d11ea6c-1462-45ed-bcf4-a50ad49582a9, reason: Instance 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:15:48.268057 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72b1475e-80fe-4d01-b077-8bb50da90c8a req-341c540b-b661-42bb-961e-b7a77e834431 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:48.271629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72b1475e-80fe-4d01-b077-8bb50da90c8a req-341c540b-b661-42bb-961e-b7a77e834431 service nova] Acquiring lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:48.271629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72b1475e-80fe-4d01-b077-8bb50da90c8a req-341c540b-b661-42bb-961e-b7a77e834431 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:48.271629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72b1475e-80fe-4d01-b077-8bb50da90c8a req-341c540b-b661-42bb-961e-b7a77e834431 service nova] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:48.271629 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72b1475e-80fe-4d01-b077-8bb50da90c8a req-341c540b-b661-42bb-961e-b7a77e834431 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] No waiting events found dispatching network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:48.271629 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72b1475e-80fe-4d01-b077-8bb50da90c8a req-341c540b-b661-42bb-961e-b7a77e834431 service nova] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Received event network-vif-unplugged-2d11ea6c-1462-45ed-bcf4-a50ad49582a9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:48.667304 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:48.750951 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] opening encrypted volume /dev/dm-2 {{(pid=98297) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 28 03:15:49.138868 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:49.138868 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:49.169370 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Took 1.56 seconds to deallocate network for instance.
May 28 03:15:49.719249 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Took 0.55 seconds to detach 1 volumes for instance.
May 28 03:15:49.770248 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:49.771875 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing instance network info cache due to event network-changed-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:15:49.772342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] Acquiring lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:15:49.772342 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] Acquired lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:15:49.772342 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Refreshing network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:15:50.137607 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:15:50.140242 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:50.228676 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:50.228894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:50.281692 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:50.302607 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:50.302842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:50.303054 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:50.303236 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:50.303350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:50.307673 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Terminating instance
May 28 03:15:50.440010 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:50.440257 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:50.622574 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:50.760107 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updated VIF entry in instance network info cache for port 5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:15:50.760661 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating instance_info_cache with network_info: [{"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:50.814404 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:15:50.834406 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:50.853175 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:50.857040 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:50.877970 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:50.942898 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:50.973785 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af49b9dd-e486-4082-b3fc-36ee80071dfa req-7c6fcd39-7f98-40bc-b919-7b3ab0158cae service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-vif-unplugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:50.973982 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af49b9dd-e486-4082-b3fc-36ee80071dfa req-7c6fcd39-7f98-40bc-b919-7b3ab0158cae service nova] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:50.974167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af49b9dd-e486-4082-b3fc-36ee80071dfa req-7c6fcd39-7f98-40bc-b919-7b3ab0158cae service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:50.974291 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-af49b9dd-e486-4082-b3fc-36ee80071dfa req-7c6fcd39-7f98-40bc-b919-7b3ab0158cae service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:50.974588 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af49b9dd-e486-4082-b3fc-36ee80071dfa req-7c6fcd39-7f98-40bc-b919-7b3ab0158cae service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] No waiting events found dispatching network-vif-unplugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:50.974828 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-af49b9dd-e486-4082-b3fc-36ee80071dfa req-7c6fcd39-7f98-40bc-b919-7b3ab0158cae service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-vif-unplugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:51.104524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.127336 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999234370000067 future=<Future at 0x7e4b40652ba0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:51.130851 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Instance destroyed successfully.
May 28 03:15:51.132053 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lazy-loading 'resources' on Instance uuid b2c78fb2-5f92-48bf-9fa8-5de1b2185b27 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:51.263449 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ae0ff9c0-ef1b-4919-8788-7e7e3299d039 req-b9c7a5df-ba4f-4b27-b2b6-59c0f115e7cd service nova] Releasing lock "refresh_cache-b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:15:51.372902 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1919344336',display_name='tempest-TestVolumeBootPattern-server-1919344336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1919344336',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-o080d0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:15:35Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=61e40109-5291-419e-9dfb-5e53e679a121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:15:51.373079 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:51.373611 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=48103813-f1cf-4dbe-842b-1621e6d75f00,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48103813-f1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:51.374490 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid 61e40109-5291-419e-9dfb-5e53e679a121 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:15:51.455002 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.226s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:51.497785 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Deleted allocations for instance 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623
May 28 03:15:51.634692 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:14:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-976414582',display_name='tempest-TestVolumeBackupRestore-server-976414582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebackuprestore-server-976414582',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA948i9d6mjwa3n1s0B1LeP5YhllD0GTD3vDPYyK6tvNFM2wbDATTvLzE2wmUZxQDOxClnTd/LNwG9r4Un4NkkWsxydNuBE84OhCWNR9evjpGlIRnBghqNW9bvKvNVHGDw==',key_name='tempest-TestVolumeBackupRestore-215190599',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:15:18Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='73df2c139e08481d8909936bf4e3fb1e',ramdisk_id='',reservation_id='r-4yctb773',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-134083432',owner_user_name='tempest-TestVolumeBackupRestore-134083432-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:15:19Z,user_data=None,user_id='0d063f87ec60481180c0c826e6182dfb',uuid=b2c78fb2-5f92-48bf-9fa8-5de1b2185b27,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:15:51.634910 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Converting VIF {"id": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "address": "fa:16:3e:92:02:33", "network": {"id": "61e086c2-037f-4889-9f4e-49b5f32257f0", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-782862117-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "73df2c139e08481d8909936bf4e3fb1e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cbf8f78-83", "ovs_interfaceid": "5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:51.635373 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a,network=Network(61e086c2-037f-4889-9f4e-49b5f32257f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cbf8f78-83') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:51.635591 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a,network=Network(61e086c2-037f-4889-9f4e-49b5f32257f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cbf8f78-83') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:15:51.636454 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.636721 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cbf8f78-83, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:51.637560 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.638298 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:51.638849 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.639472 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.639651 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98ca4124-6e06-479e-b04b-6d2160657969) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:51.640121 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.640638 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:51.642156 np0000001589 nova-compute[98297]: INFO os_vif [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a,network=Network(61e086c2-037f-4889-9f4e-49b5f32257f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cbf8f78-83')
May 28 03:15:51.643442 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:15:51.643693 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:15:51.643796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:15:51.772254 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:15:51.876860 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] End _get_guest_xml xml=<domain type="qemu">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <uuid>61e40109-5291-419e-9dfb-5e53e679a121</uuid>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <name>instance-00000040</name>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-1919344336</nova:name>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:15:38</nova:creationTime>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:properties/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         <nova:port uuid="48103813-f1cf-4dbe-842b-1621e6d75f00">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <system>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <entry name="serial">61e40109-5291-419e-9dfb-5e53e679a121</entry>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <entry name="uuid">61e40109-5291-419e-9dfb-5e53e679a121</entry>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </system>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <os>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   </os>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <features>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   </features>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   <devices>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121/disk.config"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <alias name="ua-8ae0a8f2-8c00-466d-932b-657f19ea0b12"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <serial>8ae0a8f2-8c00-466d-932b-657f19ea0b12</serial>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </disk>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:1a:5b:00"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <target dev="tap48103813-f1"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </interface>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121/console.log" append="off"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </serial>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <video>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </video>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </rng>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:   </devices>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]: </domain>
May 28 03:15:51.876860 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Preparing to wait for external event network-vif-plugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1919344336',display_name='tempest-TestVolumeBootPattern-server-1919344336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1919344336',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-o080d0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:15:35Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=61e40109-5291-419e-9dfb-5e53e679a121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=48103813-f1cf-4dbe-842b-1621e6d75f00,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48103813-f1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:15:51.878953 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=48103813-f1cf-4dbe-842b-1621e6d75f00,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48103813-f1') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:15:51.879304 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.879304 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:51.879356 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:15:51.879780 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.879901 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '114fcf67-3ec4-54ae-ac14-72086529c5fb', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:51.880507 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.881117 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:51.881662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.882682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.882794 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48103813-f1, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:51.883011 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48103813-f1, col_values=(('qos', UUID('b0fd0f7f-94df-451a-a825-c73433663689')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:51.883142 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48103813-f1, col_values=(('external_ids', {'iface-id': '48103813-f1cf-4dbe-842b-1621e6d75f00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:5b:00', 'vm-uuid': '61e40109-5291-419e-9dfb-5e53e679a121'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:15:51.883791 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.885022 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:15:51.888725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:51.889298 np0000001589 nova-compute[98297]: INFO os_vif [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=48103813-f1cf-4dbe-842b-1621e6d75f00,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48103813-f1')
May 28 03:15:52.095344 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.451s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:15:52.095740 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '63681720-6008-4c2e-b700-0a1b4ca5e56c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:15:52.095904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:15:52.122744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:52.122744 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:52.122744 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:52.122744 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:52.122744 np0000001589 nova-compute[98297]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ec981a9-9f03-456c-a31e-226e9a01cb27 (non-flash)
May 28 03:15:52.122744 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:15:52.122957 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsi session list stdout=tcp: [165] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:52.122957 np0000001589 nova-compute[98297]: tcp: [166] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c (non-flash)
May 28 03:15:52.122957 np0000001589 nova-compute[98297]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:52.122957 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:15:52.122957 np0000001589 nova-compute[98297]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5ec981a9-9f03-456c-a31e-226e9a01cb27 (non-flash)
May 28 03:15:52.122957 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:15:52.123082 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '165'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '166'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5ec981a9-9f03-456c-a31e-226e9a01cb27', '174')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:15:52.123150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '165')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:52.123939 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c', '166')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:15:52.124614 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b645f0f40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'): ({'sdi'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:15:52.124833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Removing multipathed devices sdi, sdh {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:15:52.125050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Flush multipath device 33000000058432922 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:15:52.181511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:52.230968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:15:52.282787 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:15:52.283069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:15:52.283780 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:15:52.295294 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:15:52.295566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:15:52.311138 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:52.361907 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 165, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.40.100,3260]
May 28 03:15:52.361907 np0000001589 nova-compute[98297]: Logout of [sid: 165, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.40.100,3260] successful.
May 28 03:15:52.361907 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:52.385978 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:52.389715 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:52.398566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:52.432030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.50.100,3260]
May 28 03:15:52.432030 np0000001589 nova-compute[98297]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-63681720-6008-4c2e-b700-0a1b4ca5e56c, portal: 192.168.50.100,3260] successful.
May 28 03:15:52.432030 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:52.446461 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:15:52.446707 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:15:52.446821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] <== disconnect_volume: return (803ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:15:52.446928 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:15:52.447147 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Deleting instance files /opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27_del
May 28 03:15:52.447654 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Deletion of /opt/stack/data/nova/instances/b2c78fb2-5f92-48bf-9fa8-5de1b2185b27_del complete
May 28 03:15:52.507120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-218c1502-3977-4671-bf55-e148b238bc2b tempest-TestEncryptedCinderVolumes-124411028 tempest-TestEncryptedCinderVolumes-124411028-project-member] Lock "5cf91eef-3929-48c5-8ff2-4ae1ee6b3623" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:52.954114 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Took 2.14 seconds to destroy the instance on the hypervisor.
May 28 03:15:52.954646 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:15:52.954844 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:15:52.954916 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:15:52.955149 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:53.131944 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:53.404567 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:53.404844 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:15:53.404844 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:1a:5b:00, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:15:53.405082 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Using config drive
May 28 03:15:53.473089 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-20d1c7ae-18a6-49e1-97e9-25a3e613a1d6 req-5a66b4ee-ccc7-4cf2-a332-3814afd7c97e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-vif-unplugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:53.473297 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-20d1c7ae-18a6-49e1-97e9-25a3e613a1d6 req-5a66b4ee-ccc7-4cf2-a332-3814afd7c97e service nova] Acquiring lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:53.473422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-20d1c7ae-18a6-49e1-97e9-25a3e613a1d6 req-5a66b4ee-ccc7-4cf2-a332-3814afd7c97e service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:53.473538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-20d1c7ae-18a6-49e1-97e9-25a3e613a1d6 req-5a66b4ee-ccc7-4cf2-a332-3814afd7c97e service nova] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:53.473841 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-20d1c7ae-18a6-49e1-97e9-25a3e613a1d6 req-5a66b4ee-ccc7-4cf2-a332-3814afd7c97e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] No waiting events found dispatching network-vif-unplugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:15:53.474034 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-20d1c7ae-18a6-49e1-97e9-25a3e613a1d6 req-5a66b4ee-ccc7-4cf2-a332-3814afd7c97e service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-vif-unplugged-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:15:53.543627 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:53.911770 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:15:54.028418 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Creating config drive at /opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121/disk.config
May 28 03:15:54.031512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptaaz7zi3 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:15:54.084807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmptaaz7zi3" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:15:54.203536 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004766110000673507 future=<Future at 0x7e4b406c6bd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:54.204198 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938139.2029219, b3f12e09-b318-4eb0-96cd-480a98f33784 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:54.204473 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:54.204791 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] VM Stopped (Lifecycle Event)
May 28 03:15:54.206540 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.092963008999959 future=<Future at 0x7e4b40552540 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:54.206802 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.092685725000138 future=<Future at 0x7e4b40552540 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:15:54.427174 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:15:54.514244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.520305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.541319 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.597663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.709089 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: b3f12e09-b318-4eb0-96cd-480a98f33784] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:54.858339 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.860038 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.861796 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.881682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:54.930661 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Took 1.98 seconds to deallocate network for instance.
May 28 03:15:55.250811 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938155.250055, 61e40109-5291-419e-9dfb-5e53e679a121 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:55.250811 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] VM Started (Lifecycle Event)
May 28 03:15:55.551079 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Took 0.62 seconds to detach 1 volumes for instance.
May 28 03:15:55.564978 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0af4cc36-99a4-46f4-a6b0-f8ace6358d31 req-10f941df-8fa8-4f5f-aecd-e46066a98f84 service nova] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Received event network-vif-deleted-5cbf8f78-83a7-4b2c-b2e8-f2e8350b172a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:15:55.754442 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:55.760180 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938155.7598872, 61e40109-5291-419e-9dfb-5e53e679a121 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:15:55.760369 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] VM Paused (Lifecycle Event)
May 28 03:15:56.063480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:15:56.066145 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:15:56.207828 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:15:56.207943 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:15:56.262913 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:15:56.267561 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:15:56.711719 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:15:56.750802 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:56.770447 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:15:56.884275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:57.137907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:57.218446 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.153s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:57.263461 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Deleted allocations for instance b2c78fb2-5f92-48bf-9fa8-5de1b2185b27
May 28 03:15:58.136756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:58.277199 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-71738cee-479c-4380-a9a3-4f7e6d1fb9f6 tempest-TestVolumeBackupRestore-134083432 tempest-TestVolumeBackupRestore-134083432-project-member] Lock "b2c78fb2-5f92-48bf-9fa8-5de1b2185b27" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.974s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:15:59.068159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:15:59.239537 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:01.071935 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:01.299961 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003951720000259229 future=<Future at 0x7e4b40552540 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:01.300091 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:01.300135 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.825907875000212 future=<Future at 0x7e4b40652ba0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:01.300278 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=4.825825632000033 future=<Future at 0x7e4b40652ba0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:01.300651 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938146.2994096, 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:01.301693 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] VM Stopped (Lifecycle Event)
May 28 03:16:01.462420 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dab82198-e6d0-4747-b853-6e51ffca450a req-80cbdb72-3956-4557-853d-dc4c42e0e231 service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-vif-plugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:01.462926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dab82198-e6d0-4747-b853-6e51ffca450a req-80cbdb72-3956-4557-853d-dc4c42e0e231 service nova] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:01.463140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dab82198-e6d0-4747-b853-6e51ffca450a req-80cbdb72-3956-4557-853d-dc4c42e0e231 service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:01.463332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-dab82198-e6d0-4747-b853-6e51ffca450a req-80cbdb72-3956-4557-853d-dc4c42e0e231 service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:01.463520 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-dab82198-e6d0-4747-b853-6e51ffca450a req-80cbdb72-3956-4557-853d-dc4c42e0e231 service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Processing event network-vif-plugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:16:01.463960 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:16:01.468155 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938161.467881, 61e40109-5291-419e-9dfb-5e53e679a121 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:01.468320 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] VM Resumed (Lifecycle Event)
May 28 03:16:01.471104 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:16:01.477943 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Instance spawned successfully.
May 28 03:16:01.478354 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:16:01.805381 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 5cf91eef-3929-48c5-8ff2-4ae1ee6b3623] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:01.887018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:01.974512 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:01.976491 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:16:01.987099 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:01.987249 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:01.987456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:01.989286 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:01.989286 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:01.989286 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:02.479902 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:16:02.492996 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Took 24.49 seconds to spawn the instance on the hypervisor.
May 28 03:16:02.494666 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:02.801738 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:03.007896 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Took 31.67 seconds to build instance.
May 28 03:16:03.135154 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:03.510381 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.182s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:03.524615 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ad1a7f3-6c99-47f6-8b93-44a6d15e287e req-7196c8de-98c9-4166-b495-9b8c1322836a service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-vif-plugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:03.524913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ad1a7f3-6c99-47f6-8b93-44a6d15e287e req-7196c8de-98c9-4166-b495-9b8c1322836a service nova] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:03.525098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ad1a7f3-6c99-47f6-8b93-44a6d15e287e req-7196c8de-98c9-4166-b495-9b8c1322836a service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:03.525430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1ad1a7f3-6c99-47f6-8b93-44a6d15e287e req-7196c8de-98c9-4166-b495-9b8c1322836a service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:03.525483 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1ad1a7f3-6c99-47f6-8b93-44a6d15e287e req-7196c8de-98c9-4166-b495-9b8c1322836a service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] No waiting events found dispatching network-vif-plugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:16:03.526179 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-1ad1a7f3-6c99-47f6-8b93-44a6d15e287e req-7196c8de-98c9-4166-b495-9b8c1322836a service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received unexpected event network-vif-plugged-48103813-f1cf-4dbe-842b-1621e6d75f00 for instance with vm_state active and task_state None.
May 28 03:16:04.520806 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:04.522985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:04.522985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:04.522985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:04.522985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:04.525096 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Terminating instance
May 28 03:16:05.028250 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:16:05.042006 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.043667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.058251 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.061045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.077312 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.082375 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.342738 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999730990999979 future=<Future at 0x7e4b645b7e90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:05.345291 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Instance destroyed successfully.
May 28 03:16:05.345812 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid 61e40109-5291-419e-9dfb-5e53e679a121 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:16:05.575858 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-vif-unplugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:05.576219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:05.576219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:05.576417 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:05.576477 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] No waiting events found dispatching network-vif-unplugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:16:05.576594 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-vif-unplugged-48103813-f1cf-4dbe-842b-1621e6d75f00 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:16:05.576676 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-vif-unplugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:05.576837 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] Acquiring lock "61e40109-5291-419e-9dfb-5e53e679a121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:05.577140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:05.577214 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] Lock "61e40109-5291-419e-9dfb-5e53e679a121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:05.577339 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] No waiting events found dispatching network-vif-unplugged-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:16:05.577455 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fafe593f-b143-4097-b3cf-fe166e7b39ac req-f2916734-7ab4-461a-b2b7-2071089f9c9e service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-vif-unplugged-48103813-f1cf-4dbe-842b-1621e6d75f00 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:16:05.848283 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:15:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1919344336',display_name='tempest-TestVolumeBootPattern-server-1919344336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1919344336',id=64,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:16:02Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-o080d0ah',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:16:03Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=61e40109-5291-419e-9dfb-5e53e679a121,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:16:05.848283 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "48103813-f1cf-4dbe-842b-1621e6d75f00", "address": "fa:16:3e:1a:5b:00", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48103813-f1", "ovs_interfaceid": "48103813-f1cf-4dbe-842b-1621e6d75f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:16:05.848685 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=48103813-f1cf-4dbe-842b-1621e6d75f00,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48103813-f1') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:16:05.848894 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=48103813-f1cf-4dbe-842b-1621e6d75f00,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48103813-f1') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:16:05.850367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.850367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48103813-f1, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:05.850950 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.851656 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:16:05.852081 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.852634 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.852804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0fd0f7f-94df-451a-a825-c73433663689) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:05.853159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.853593 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:16:05.853885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:05.855284 np0000001589 nova-compute[98297]: INFO os_vif [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:5b:00,bridge_name='br-int',has_traffic_filtering=True,id=48103813-f1cf-4dbe-842b-1621e6d75f00,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48103813-f1')
May 28 03:16:05.881102 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '61e40109-5291-419e-9dfb-5e53e679a121', 'attached_at': '', 'detached_at': '', 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'serial': '8ae0a8f2-8c00-466d-932b-657f19ea0b12'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:16:05.881668 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:16:05.881889 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:16:05.882052 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:16:05.882626 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7e4b4052ee10>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '61e40109-5291-419e-9dfb-5e53e679a121', 'attached_at': '', 'detached_at': '', 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'serial': '8ae0a8f2-8c00-466d-932b-657f19ea0b12'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:16:05.882744 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] closing encrypted volume /dev/dm-0 {{(pid=98297) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 28 03:16:05.907342 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:16:05.907682 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:16:05.907868 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:06.126608 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004654760000448732 future=<Future at 0x7e4b40652ba0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:06.126608 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:06.126798 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.215725916999872 future=<Future at 0x7e4b645b7e90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:06.126798 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.215659322999727 future=<Future at 0x7e4b645b7e90 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:06.127593 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938151.1259422, b2c78fb2-5f92-48bf-9fa8-5de1b2185b27 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:06.127593 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] VM Stopped (Lifecycle Event)
May 28 03:16:06.629717 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-5edc4011-0ee2-441a-8466-a8deb9596256 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: b2c78fb2-5f92-48bf-9fa8-5de1b2185b27] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:07.460696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.553s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:07.461072 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8ae0a8f2-8c00-466d-932b-657f19ea0b12', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:16:07.461282 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:16:07.481967 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:16:07.481967 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:16:07.481967 np0000001589 nova-compute[98297]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:07.481967 np0000001589 nova-compute[98297]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:07.481967 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:07.482196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:16:07.482196 np0000001589 nova-compute[98297]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12 (non-flash)
May 28 03:16:07.482196 np0000001589 nova-compute[98297]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:07.482196 np0000001589 nova-compute[98297]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:07.482196 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:07.482196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '176')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:16:07.482404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '172')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:16:07.483056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12', '173')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:16:07.483720 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4051c220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'): ({'sdg'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:16:07.483892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdf, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:16:07.484118 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 3300000007f58060e {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:16:07.516496 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:16:07.562742 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:16:07.601536 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:16:07.601698 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:16:07.602467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:16:07.611610 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:16:07.611789 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:16:07.620509 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:07.650338 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.40.100,3260]
May 28 03:16:07.650338 np0000001589 nova-compute[98297]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.40.100,3260] successful.
May 28 03:16:07.650338 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:07.662216 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:07.672106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:07.705280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.50.100,3260]
May 28 03:16:07.705280 np0000001589 nova-compute[98297]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-8ae0a8f2-8c00-466d-932b-657f19ea0b12, portal: 192.168.50.100,3260] successful.
May 28 03:16:07.705280 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:07.715929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:07.716667 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:07.716781 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (1809ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:16:07.716908 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:16:07.717239 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Deleting instance files /opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121_del
May 28 03:16:07.717808 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Deletion of /opt/stack/data/nova/instances/61e40109-5291-419e-9dfb-5e53e679a121_del complete
May 28 03:16:08.136080 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:08.222920 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Took 3.19 seconds to destroy the instance on the hypervisor.
May 28 03:16:08.223464 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:16:08.223632 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:16:08.223711 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:16:08.224221 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:08.310269 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:08.534654 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b24d748-31a5-44fc-b3ce-8b5f5214270a req-6ca05253-b074-47c1-886a-c09d9d9a28d6 service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Received event network-vif-deleted-48103813-f1cf-4dbe-842b-1621e6d75f00 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:08.534733 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-7b24d748-31a5-44fc-b3ce-8b5f5214270a req-6ca05253-b074-47c1-886a-c09d9d9a28d6 service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Neutron deleted interface 48103813-f1cf-4dbe-842b-1621e6d75f00; detaching it from the instance and deleting it from the info cache
May 28 03:16:08.536509 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7b24d748-31a5-44fc-b3ce-8b5f5214270a req-6ca05253-b074-47c1-886a-c09d9d9a28d6 service nova] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Detach interface failed, port_id=48103813-f1cf-4dbe-842b-1621e6d75f00, reason: Instance 61e40109-5291-419e-9dfb-5e53e679a121 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:16:08.994158 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:09.496846 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Took 1.27 seconds to deallocate network for instance.
May 28 03:16:10.037251 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:16:10.542120 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:10.542366 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:10.637513 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:16:10.637721 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:16:10.853967 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:11.140133 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:16:11.528968 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:11.529169 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:11.647237 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.105s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:11.690597 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance 61e40109-5291-419e-9dfb-5e53e679a121
May 28 03:16:12.030889 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:16:12.570932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:12.571217 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:12.574195 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:16:12.574339 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Claim successful on node np0000001589
May 28 03:16:12.698768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4d034307-0733-44c3-af0c-62b24f82fdda tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "61e40109-5291-419e-9dfb-5e53e679a121" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.177s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:13.137061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:13.667951 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:16:13.668358 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:16:14.170568 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:16:14.676842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.106s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:14.677251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:16:15.182459 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:16:15.182721 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:16:15.183217 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:15.183217 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:15.258075 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '612418cc12484e51924169c654bb3718', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '484e5bbfdebb46c5842b9b94cfa69f81', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:16:15.622241 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Successfully created port: 167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:16:15.685477 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:16:15.854625 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:16.034309 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:16.085993 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Successfully updated port: 167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:16:16.140193 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:16.140549 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing instance network info cache due to event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:16:16.140762 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] Acquiring lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:16:16.140871 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] Acquired lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:16:16.141063 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:16:16.189530 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:16:16.587783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:16:16.643166 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:16.695602 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Booting with volume 579b9ef1-4500-4573-8d85-da54e846c2b9 at /dev/vda
May 28 03:16:16.729637 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:16:16.732808 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:16:16.745482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:16:16.765149 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:16:16.820321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:16:16.820921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:16:16.832243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:16:16.833005 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40'] 
May 28 03:16:16.833128 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:16:16.833238 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:16:16.833480 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:16:16.833672 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating existing volume attachment record: c4e2aaa0-5b10-42be-b82f-2afbc1bf7bf9 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:16:16.906878 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:17.409711 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-01060354-25f1-4f0f-a789-1c6394ea072f req-84caebfa-b6c1-4ea9-853c-bf5785443a7f service nova] Releasing lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:16:17.410080 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquired lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:16:17.410243 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:16:17.800998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:17.801422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:17.967664 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:16:18.104686 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:18.225519 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating instance_info_cache with network_info: [{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:18.303213 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:16:18.730235 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Releasing lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:16:18.730464 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Instance network_info: |[{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:16:18.851242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:18.851242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:18.854910 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:16:18.855154 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Claim successful on node np0000001589
May 28 03:16:18.924174 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:16:18.925380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:16:18.926243 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Creating image(s)
May 28 03:16:18.926243 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:16:18.926243 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Ensure instance console log exists: /opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:16:18.926684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:18.926921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:18.927142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:18.928430 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Start _get_guest_xml network_info=[{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'c4e2aaa0-5b10-42be-b82f-2afbc1bf7bf9', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d7d956c-368d-4986-8fa4-18980377f24e', 'attached_at': '', 'detached_at': '', 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'serial': '579b9ef1-4500-4573-8d85-da54e846c2b9'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:16:18.930179 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:16:18.931131 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-1689439183', uuid='1d7d956c-368d-4986-8fa4-18980377f24e'), owner=OwnerMeta(userid='612418cc12484e51924169c654bb3718', username='tempest-TestInstancesWithCinderVolumes-208839827-project-member', projectid='484e5bbfdebb46c5842b9b94cfa69f81', projectname='tempest-TestInstancesWithCinderVolumes-208839827'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938178.9308662) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:16:18.932302 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:16:18.932701 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:16:18.937241 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:16:18.945144 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:16:18.945567 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:16:18.945864 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:20.014524 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:16:20.014945 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:16:20.342879 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00039851200017437804 future=<Future at 0x7e4b645b7e90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:20.343411 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Emitting event <LifecycleEvent: 1779938165.3423772, 61e40109-5291-419e-9dfb-5e53e679a121 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:20.343583 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:16:20.343720 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] VM Stopped (Lifecycle Event)
May 28 03:16:20.519248 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:16:20.846088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 61e40109-5291-419e-9dfb-5e53e679a121] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:20.856997 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:21.026468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.176s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:21.026888 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:16:21.201139 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.255s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:21.201357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:16:21.211978 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:21.212460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:21.213048 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:21.213326 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:16:21.213634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:21.213816 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:16:21.224413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:16:21.224413 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:21.228624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:16:21.228624 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:21.234913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9] added
May 28 03:16:21.234913 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:16:21.234913 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:21.234913 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:21.234913 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:21.234913 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:21.234913 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:21.235058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:16:21.235277 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:16:21.235874 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:16:21.238268 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9] added
May 28 03:16:21.238268 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:16:21.238268 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:21.238268 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:21.238268 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:21.238268 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:21.238268 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:21.238268 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:16:21.238268 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:16:21.238546 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:16:21.532038 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:16:21.532418 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:16:21.532686 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:21.532854 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:21.590712 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:16:21.931624 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Successfully created port: 8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:16:22.034802 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:16:22.236280 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:16:22.238982 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:16:22.247615 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:16:22.247615 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:16:22.253217 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:16:22.253217 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.259137 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.263951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.270532 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.270532 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.270532 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.270532 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:22.270684 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.270684 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.270684 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.270684 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:22.275898 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.275898 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.275898 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.275898 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:22.276014 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.276014 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.276014 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.276014 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:22.302755 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.50.100,3260]
May 28 03:16:22.302755 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.50.100,3260] successful.
May 28 03:16:22.302755 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.308132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.40.100,3260]
May 28 03:16:22.308132 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.40.100,3260] successful.
May 28 03:16:22.308132 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.314716 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.320458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:22.327927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.327927 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.327927 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.327927 np0000001589 nova-compute[98297]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.327927 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.327927 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:22.328061 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.328061 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.328061 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.328061 np0000001589 nova-compute[98297]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.328061 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.328061 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:22.328285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.115s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:22.328415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:16:22.329003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] HCTL ('10', '-', '-', 0) found on session 180 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:16:22.329099 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:16:22.334977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.334977 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.334977 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.334977 np0000001589 nova-compute[98297]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.334977 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.334977 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:22.335215 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-556cbedf-7ef1-4926-b405-acd08b74388f (non-flash)
May 28 03:16:22.335215 np0000001589 nova-compute[98297]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.335215 np0000001589 nova-compute[98297]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4010f77b-c99c-4448-a4fd-d472552c379e (non-flash)
May 28 03:16:22.335215 np0000001589 nova-compute[98297]: tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.335215 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:22.335215 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:22.335369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:22.335369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:16:22.335919 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] HCTL ('11', '-', '-', 0) found on session 181 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:16:22.335995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:16:22.342822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 180 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:16:22.342822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:16:22.348127 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Successfully updated port: 8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:16:22.351837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 181 and hctl ['11', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:16:22.410973 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received event network-changed-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:22.410973 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Refreshing instance network info cache due to event network-changed-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:16:22.410973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] Acquiring lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:16:22.410973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] Acquired lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:16:22.410973 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Refreshing network info cache for port 8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:16:22.540502 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:16:22.850391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:16:22.911104 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:22.968904 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:16:23.048737 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Booting with volume c62d9daf-e8d1-4c17-aec3-50055fda7278 at /dev/vda
May 28 03:16:23.088258 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:16:23.095666 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:23.103276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:16:23.121560 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:16:23.163300 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:16:23.163595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:16:23.171485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:16:23.172236 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40'] 
May 28 03:16:23.172372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:16:23.172465 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:16:23.172679 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:16:23.172874 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Updating existing volume attachment record: 5373217b-48b0-4d33-991a-24511bab829c {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:16:23.352699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 181 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:16:23.352821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:16:23.599013 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-362d3b38-d21a-4051-9fc0-7c75356d4374 req-d0df5b11-281f-47a8-882c-2d6e1d632aa6 service nova] Releasing lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:16:23.599570 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:16:23.599758 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:16:24.158531 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:16:24.229753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Found WWN 330000000d434a514 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:16:24.230121 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:24.230340 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== connect_volume: return (5284ms) {'type': 'block', 'scsi_wwn': '330000000d434a514', 'path': '/dev/dm-1', 'multipath_id': '330000000d434a514'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:16:24.230503 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d434a514', 'path': '/dev/dm-1', 'multipath_id': '330000000d434a514'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:16:24.293013 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:24.405078 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Updating instance_info_cache with network_info: [{"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:24.738290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1689439183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testinstanceswithcindervolumes-server-1689439183',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkryvmQI7PQ8tbkZXxV9qoprD6Pj21nE9OedAg5DyBJddw0mSO+zDgsZAwvwyo6sU8Qqa4euAMsfMFN2TKhtd9gqdNAgjJ3Vs9y9+Pgapwtc+FkJwCgs8VpQOZH7gAVqw==',key_name='tempest-TestInstancesWithCinderVolumes-1899106639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='484e5bbfdebb46c5842b9b94cfa69f81',ramdisk_id='',reservation_id='r-l611yl10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-208839827',owner_user_name='tempest-TestInstancesWithCinderVolumes-208839827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:16:16Z,user_data=None,user_id='612418cc12484e51924169c654bb3718',uuid=1d7d956c-368d-4986-8fa4-18980377f24e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:16:24.738476 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Converting VIF {"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:16:24.739060 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:49:be,bridge_name='br-int',has_traffic_filtering=True,id=167983c1-b75b-4cca-9cfc-4f774644dd96,network=Network(aac22404-980a-4ddc-ab35-bf930d0974d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap167983c1-b7') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:16:24.740021 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:16:24.906909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:16:24.907145 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Instance network_info: |[{"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:16:25.242643 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] End _get_guest_xml xml=<domain type="qemu">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <uuid>1d7d956c-368d-4986-8fa4-18980377f24e</uuid>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <name>instance-00000041</name>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-1689439183</nova:name>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:16:18</nova:creationTime>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:properties/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:user uuid="612418cc12484e51924169c654bb3718">tempest-TestInstancesWithCinderVolumes-208839827-project-member</nova:user>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:project uuid="484e5bbfdebb46c5842b9b94cfa69f81">tempest-TestInstancesWithCinderVolumes-208839827</nova:project>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         <nova:port uuid="167983c1-b75b-4cca-9cfc-4f774644dd96">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <system>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <entry name="serial">1d7d956c-368d-4986-8fa4-18980377f24e</entry>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <entry name="uuid">1d7d956c-368d-4986-8fa4-18980377f24e</entry>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </system>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <os>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   </os>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <features>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   </features>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   <devices>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e/disk.config"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </disk>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <alias name="ua-579b9ef1-4500-4573-8d85-da54e846c2b9"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-1"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <serial>579b9ef1-4500-4573-8d85-da54e846c2b9</serial>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </disk>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:9d:49:be"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <target dev="tap167983c1-b7"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </interface>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e/console.log" append="off"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </serial>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <video>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </video>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </rng>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:   </devices>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]: </domain>
May 28 03:16:25.242643 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Preparing to wait for external event network-vif-plugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1689439183',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testinstanceswithcindervolumes-server-1689439183',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkryvmQI7PQ8tbkZXxV9qoprD6Pj21nE9OedAg5DyBJddw0mSO+zDgsZAwvwyo6sU8Qqa4euAMsfMFN2TKhtd9gqdNAgjJ3Vs9y9+Pgapwtc+FkJwCgs8VpQOZH7gAVqw==',key_name='tempest-TestInstancesWithCinderVolumes-1899106639',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='484e5bbfdebb46c5842b9b94cfa69f81',ramdisk_id='',reservation_id='r-l611yl10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-208839827',owner_user_name='tempest-TestInstancesWithCinderVolumes-208839827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:16:16Z,user_data=None,user_id='612418cc12484e51924169c654bb3718',uuid=1d7d956c-368d-4986-8fa4-18980377f24e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Converting VIF {"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:49:be,bridge_name='br-int',has_traffic_filtering=True,id=167983c1-b75b-4cca-9cfc-4f774644dd96,network=Network(aac22404-980a-4ddc-ab35-bf930d0974d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap167983c1-b7') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:49:be,bridge_name='br-int',has_traffic_filtering=True,id=167983c1-b75b-4cca-9cfc-4f774644dd96,network=Network(aac22404-980a-4ddc-ab35-bf930d0974d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap167983c1-b7') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:25.245951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:16:25.246637 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:25.246834 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '416ffc40-5904-56d9-857e-82d6f78f9138', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:25.248465 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:25.249393 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:16:25.251250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:25.251412 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap167983c1-b7, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:25.251719 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap167983c1-b7, col_values=(('qos', UUID('282d7ac8-e820-42cc-bb15-2d3b0589d0e5')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:25.251881 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap167983c1-b7, col_values=(('external_ids', {'iface-id': '167983c1-b75b-4cca-9cfc-4f774644dd96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:49:be', 'vm-uuid': '1d7d956c-368d-4986-8fa4-18980377f24e'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:25.252541 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:25.253836 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:16:25.257651 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:16:25.258790 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:25.259534 np0000001589 nova-compute[98297]: INFO os_vif [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:49:be,bridge_name='br-int',has_traffic_filtering=True,id=167983c1-b75b-4cca-9cfc-4f774644dd96,network=Network(aac22404-980a-4ddc-ab35-bf930d0974d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap167983c1-b7')
May 28 03:16:25.259953 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:16:25.260188 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Creating image(s)
May 28 03:16:25.260514 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:16:25.260626 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Ensure instance console log exists: /opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:16:25.260851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:25.260997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:25.261114 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:25.261561 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Start _get_guest_xml network_info=[{"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '5373217b-48b0-4d33-991a-24511bab829c', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '8cc063c9-471c-4e9b-830d-c74323a1447e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'serial': 'c62d9daf-e8d1-4c17-aec3-50055fda7278'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:16:25.264751 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:16:25.265685 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-715680181', uuid='8cc063c9-471c-4e9b-830d-c74323a1447e'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938185.2653916) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:16:25.267742 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:16:25.268011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:16:25.269017 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:16:25.269164 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:16:25.269947 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:16:25.270198 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:16:25.270349 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:16:25.270427 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:16:25.270539 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:16:25.270612 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:16:25.270696 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:16:25.270834 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:16:25.270918 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:16:25.271010 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:16:25.271099 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:16:25.271199 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:16:25.281065 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:16:25.281398 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:16:25.281512 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:25.281805 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:25.281968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:16:25.292843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:25.293372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:25.293880 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:25.294067 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:16:25.294443 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:25.294704 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:16:25.304859 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:16:25.304859 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:25.309181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:16:25.309181 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:25.315687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278] added
May 28 03:16:25.315687 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:16:25.315687 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:25.315687 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:25.315687 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:25.315687 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:25.315687 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:25.315879 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:16:25.315987 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:16:25.316154 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:16:25.319456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278] added
May 28 03:16:25.319456 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:16:25.319456 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:25.319456 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:25.319456 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:25.319456 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:25.319456 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:25.319625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:16:25.319678 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.025(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:16:25.319821 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:16:26.316628 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:16:26.320445 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:16:26.328540 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:16:26.328540 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:16:26.335148 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:16:26.335148 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.341117 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.346427 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.353766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.353766 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.353766 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:26.353908 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.353908 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.353908 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:26.358804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.358804 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.358804 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:26.358910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.358910 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.358910 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:26.381474 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.40.100,3260]
May 28 03:16:26.381474 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.40.100,3260] successful.
May 28 03:16:26.381474 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.392332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.396523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.50.100,3260]
May 28 03:16:26.396523 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.50.100,3260] successful.
May 28 03:16:26.396523 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.404721 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.404721 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.404721 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.404721 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.404721 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:26.404856 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.404856 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.404856 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.404856 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.404856 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:26.405057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.111s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:26.405159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:16:26.405704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('7', '-', '-', 0) found on session 182 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:16:26.405800 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:16:26.410602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:26.419618 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 182 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:16:26.419618 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:16:26.424728 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.424728 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.424728 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.424728 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.424728 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:26.424903 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.424903 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:26.424903 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.424903 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:26.424903 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:26.425114 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:26.425293 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:16:26.425821 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('8', '-', '-', 0) found on session 183 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:16:26.425946 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:16:26.437590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 183 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:16:26.437590 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:16:26.773651 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:16:26.773820 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:16:26.773963 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No VIF found with MAC fa:16:3e:9d:49:be, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:16:26.774419 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Using config drive
May 28 03:16:27.279463 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:27.294814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:16:27.392668 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Creating config drive at /opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e/disk.config
May 28 03:16:27.396027 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp38ed1497 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:16:27.448848 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp38ed1497" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:16:27.839335 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:27.860317 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:27.936257 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:27.944442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:28.006022 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8635e453-1193-45b9-bed6-4cbb5610fb49 req-10461bea-c886-4914-a092-8ce9f2282c6d service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-vif-plugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:28.006123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8635e453-1193-45b9-bed6-4cbb5610fb49 req-10461bea-c886-4914-a092-8ce9f2282c6d service nova] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:28.006412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8635e453-1193-45b9-bed6-4cbb5610fb49 req-10461bea-c886-4914-a092-8ce9f2282c6d service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:28.006602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8635e453-1193-45b9-bed6-4cbb5610fb49 req-10461bea-c886-4914-a092-8ce9f2282c6d service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:28.006764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8635e453-1193-45b9-bed6-4cbb5610fb49 req-10461bea-c886-4914-a092-8ce9f2282c6d service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Processing event network-vif-plugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:16:28.140258 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:28.158182 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:28.160064 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:28.182432 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:28.310304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 33000000047da9fa7 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:16:28.310665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:28.310860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '33000000047da9fa7', 'path': '/dev/dm-0', 'multipath_id': '33000000047da9fa7'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:16:28.311043 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000047da9fa7', 'path': '/dev/dm-0', 'multipath_id': '33000000047da9fa7'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:16:28.558023 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938188.5576303, 1d7d956c-368d-4986-8fa4-18980377f24e => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:28.558684 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:16:28.558851 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] VM Started (Lifecycle Event)
May 28 03:16:28.561312 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:16:28.563876 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Instance spawned successfully.
May 28 03:16:28.564349 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:16:28.818397 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:16:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-715680181',display_name='tempest-TestVolumeBootPattern-server-715680181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-715680181',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdIbxqY2Uz7rKN3HuBgf0GYxZTRkdgE6AsBFWTINI18+zdSXe2uwyVWCkt8pPRcxqw4xUVX5jKI4E4PJeAAOCGSf+CaXOeAOdqDadi0qZ3movmDOnlkz563H7d4r7rrpQ==',key_name='tempest-keypair-203515736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-nr92uh3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=8cc063c9-471c-4e9b-830d-c74323a1447e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:16:28.818592 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:16:28.819197 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:41:c5,bridge_name='br-int',has_traffic_filtering=True,id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ebb0bba-50') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:16:28.819873 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cc063c9-471c-4e9b-830d-c74323a1447e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:16:29.061313 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:29.063390 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:16:29.074661 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:29.074819 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:29.075069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:29.075296 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:29.075581 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:29.075810 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:29.324181 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] End _get_guest_xml xml=<domain type="qemu">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <uuid>8cc063c9-471c-4e9b-830d-c74323a1447e</uuid>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <name>instance-00000042</name>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-715680181</nova:name>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:16:25</nova:creationTime>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         <nova:port uuid="8ebb0bba-50fd-47a2-b6ad-0d0e7c315691">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <system>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <entry name="serial">8cc063c9-471c-4e9b-830d-c74323a1447e</entry>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <entry name="uuid">8cc063c9-471c-4e9b-830d-c74323a1447e</entry>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </system>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <os>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   </os>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <features>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   </features>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   <devices>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e/disk.config"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </disk>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <alias name="ua-c62d9daf-e8d1-4c17-aec3-50055fda7278"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <serial>c62d9daf-e8d1-4c17-aec3-50055fda7278</serial>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </disk>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:b5:41:c5"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <target dev="tap8ebb0bba-50"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </interface>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e/console.log" append="off"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </serial>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <video>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </video>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </rng>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:   </devices>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]: </domain>
May 28 03:16:29.324181 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Preparing to wait for external event network-vif-plugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:16:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-715680181',display_name='tempest-TestVolumeBootPattern-server-715680181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-715680181',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdIbxqY2Uz7rKN3HuBgf0GYxZTRkdgE6AsBFWTINI18+zdSXe2uwyVWCkt8pPRcxqw4xUVX5jKI4E4PJeAAOCGSf+CaXOeAOdqDadi0qZ3movmDOnlkz563H7d4r7rrpQ==',key_name='tempest-keypair-203515736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-nr92uh3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=8cc063c9-471c-4e9b-830d-c74323a1447e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:41:c5,bridge_name='br-int',has_traffic_filtering=True,id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ebb0bba-50') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:16:29.327337 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:41:c5,bridge_name='br-int',has_traffic_filtering=True,id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ebb0bba-50') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:16:29.328480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:29.328480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:29.328480 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:16:29.329063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:29.329063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '42e9ba8d-2071-5b1f-a959-ab8ea3b8da7b', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:29.329882 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:29.331072 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:16:29.332570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:29.333502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ebb0bba-50, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:29.333502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ebb0bba-50, col_values=(('qos', UUID('02a876e3-b57a-494d-8d6c-aa81fb31fd76')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:29.333502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ebb0bba-50, col_values=(('external_ids', {'iface-id': '8ebb0bba-50fd-47a2-b6ad-0d0e7c315691', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:41:c5', 'vm-uuid': '8cc063c9-471c-4e9b-830d-c74323a1447e'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:16:29.335475 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:29.335475 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:16:29.338703 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:29.339649 np0000001589 nova-compute[98297]: INFO os_vif [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:41:c5,bridge_name='br-int',has_traffic_filtering=True,id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ebb0bba-50')
May 28 03:16:29.565627 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:16:29.565985 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938189.5657, 1d7d956c-368d-4986-8fa4-18980377f24e => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:29.565985 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] VM Paused (Lifecycle Event)
May 28 03:16:29.580989 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Took 10.66 seconds to spawn the instance on the hypervisor.
May 28 03:16:29.581385 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:30.060979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e7906649-6178-45a7-bd16-da209f4a11cc req-08f1a1a0-53e4-48a4-8ba7-5e3580c4de7a service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-vif-plugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:30.061059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e7906649-6178-45a7-bd16-da209f4a11cc req-08f1a1a0-53e4-48a4-8ba7-5e3580c4de7a service nova] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:30.061222 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e7906649-6178-45a7-bd16-da209f4a11cc req-08f1a1a0-53e4-48a4-8ba7-5e3580c4de7a service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:30.061343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e7906649-6178-45a7-bd16-da209f4a11cc req-08f1a1a0-53e4-48a4-8ba7-5e3580c4de7a service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:30.061470 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e7906649-6178-45a7-bd16-da209f4a11cc req-08f1a1a0-53e4-48a4-8ba7-5e3580c4de7a service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] No waiting events found dispatching network-vif-plugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:16:30.061588 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e7906649-6178-45a7-bd16-da209f4a11cc req-08f1a1a0-53e4-48a4-8ba7-5e3580c4de7a service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received unexpected event network-vif-plugged-167983c1-b75b-4cca-9cfc-4f774644dd96 for instance with vm_state active and task_state None.
May 28 03:16:30.068090 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:30.070705 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938190.0703955, 1d7d956c-368d-4986-8fa4-18980377f24e => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:30.070830 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] VM Resumed (Lifecycle Event)
May 28 03:16:30.092664 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Took 17.56 seconds to build instance.
May 28 03:16:30.573376 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:30.575013 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:16:30.594720 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2e80c2a3-a4aa-4261-a469-b51d230a531d tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.065s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:30.858901 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:16:30.859052 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:16:30.859182 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:b5:41:c5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:16:30.859632 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Using config drive
May 28 03:16:30.878905 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:30.878905 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing instance network info cache due to event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:16:30.878905 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] Acquiring lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:16:30.879671 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] Acquired lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:16:30.879873 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:16:31.366529 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:31.398390 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:31.537453 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Creating config drive at /opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e/disk.config
May 28 03:16:31.545412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphexwz2h3 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:16:31.616220 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphexwz2h3" returned: 0 in 0.071s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:16:31.745640 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:31.896560 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updated VIF entry in instance network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:16:31.896988 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating instance_info_cache with network_info: [{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:32.012587 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.043452 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.129427 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.186907 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d22c868d-1dde-4dac-8ba6-799c77063ba9 req-1c3bc1ed-122a-4ce8-ad67-727eb5e999d8 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received event network-vif-plugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:32.187172 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d22c868d-1dde-4dac-8ba6-799c77063ba9 req-1c3bc1ed-122a-4ce8-ad67-727eb5e999d8 service nova] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:32.187430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d22c868d-1dde-4dac-8ba6-799c77063ba9 req-1c3bc1ed-122a-4ce8-ad67-727eb5e999d8 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:32.187571 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d22c868d-1dde-4dac-8ba6-799c77063ba9 req-1c3bc1ed-122a-4ce8-ad67-727eb5e999d8 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:32.187729 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d22c868d-1dde-4dac-8ba6-799c77063ba9 req-1c3bc1ed-122a-4ce8-ad67-727eb5e999d8 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Processing event network-vif-plugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:16:32.370852 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.375081 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.381720 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.383793 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.397237 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:32.398184 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing instance network info cache due to event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:16:32.398444 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] Acquiring lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:16:32.399754 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2be6a5e9-d8d0-4762-b89b-a83c8718a685 req-b4b9f9b3-4304-4c32-837f-d3361338f7a6 service nova] Releasing lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:16:32.400332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] Acquired lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:16:32.400511 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:16:32.404871 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:32.783738 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938192.783376, 8cc063c9-471c-4e9b-830d-c74323a1447e => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:32.786075 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:16:32.786075 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] VM Started (Lifecycle Event)
May 28 03:16:32.786165 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:16:32.789411 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Instance spawned successfully.
May 28 03:16:32.789811 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:16:32.905871 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:33.141534 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:33.213152 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:33.288443 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:33.290679 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:16:33.298799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:33.298988 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:33.299382 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:33.299671 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:33.299980 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:33.300313 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:16:33.342451 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updated VIF entry in instance network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:16:33.342700 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating instance_info_cache with network_info: [{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:33.796283 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:16:33.796283 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938193.7960222, 8cc063c9-471c-4e9b-830d-c74323a1447e => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:33.797703 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] VM Paused (Lifecycle Event)
May 28 03:16:33.806358 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Took 8.55 seconds to spawn the instance on the hypervisor.
May 28 03:16:33.806452 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:33.846581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a72e3ba2-167a-4b32-a422-4f241ef6a313 req-18535b14-f009-42f6-a0d9-70320de7ab59 service nova] Releasing lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:16:34.236671 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cb2f6dc3-c835-4c72-9f36-4f66d6307ef3 req-2aa9ad05-2235-4671-adb0-efd327d621e6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received event network-vif-plugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:34.237379 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cb2f6dc3-c835-4c72-9f36-4f66d6307ef3 req-2aa9ad05-2235-4671-adb0-efd327d621e6 service nova] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:34.237544 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cb2f6dc3-c835-4c72-9f36-4f66d6307ef3 req-2aa9ad05-2235-4671-adb0-efd327d621e6 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:34.237654 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cb2f6dc3-c835-4c72-9f36-4f66d6307ef3 req-2aa9ad05-2235-4671-adb0-efd327d621e6 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:34.237765 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cb2f6dc3-c835-4c72-9f36-4f66d6307ef3 req-2aa9ad05-2235-4671-adb0-efd327d621e6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] No waiting events found dispatching network-vif-plugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:16:34.238039 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-cb2f6dc3-c835-4c72-9f36-4f66d6307ef3 req-2aa9ad05-2235-4671-adb0-efd327d621e6 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received unexpected event network-vif-plugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 for instance with vm_state active and task_state None.
May 28 03:16:34.299885 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:34.301552 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938194.3013105, 8cc063c9-471c-4e9b-830d-c74323a1447e => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:16:34.301896 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] VM Resumed (Lifecycle Event)
May 28 03:16:34.314543 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Took 15.51 seconds to build instance.
May 28 03:16:34.335063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:34.805212 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:16:34.807523 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:16:34.816061 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.015s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:35.137777 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:35.138170 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:16:35.381395 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received event network-changed-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:16:35.381540 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Refreshing instance network info cache due to event network-changed-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:16:35.381729 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] Acquiring lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:16:35.381803 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] Acquired lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:16:35.381944 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Refreshing network info cache for port 8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:16:35.884122 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:36.216415 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:16:36.326195 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Updated VIF entry in instance network info cache for port 8ebb0bba-50fd-47a2-b6ad-0d0e7c315691. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:16:36.326463 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Updating instance_info_cache with network_info: [{"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:16:36.828783 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aa354947-aedd-403c-ab2a-62b8d883e0a3 req-c21f410f-7c35-4918-8f39-d86099072d12 service nova] Releasing lock "refresh_cache-8cc063c9-471c-4e9b-830d-c74323a1447e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:16:38.143759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:39.142259 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:39.337045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:39.656655 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:39.656828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:39.656947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:39.657072 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:16:40.681998 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:16:40.684191 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:16:40.686714 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:16:40.687736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:16:40.740907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:16:40.741582 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13170MB free_disk=72.76858139038086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:16:40.741707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:40.744348 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:41.793873 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1d7d956c-368d-4986-8fa4-18980377f24e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:16:41.794321 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 8cc063c9-471c-4e9b-830d-c74323a1447e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:16:41.794321 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:16:41.794471 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:16:40 up 44 min,  2 users,  load average: 4.79, 6.04, 4.88\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_484e5bbfdebb46c5842b9b94cfa69f81': '1', 'io_workload': '0', 'num_proj_26deda1c00a84355951239b1a62997e8': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:16:41.922858 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:16:41.923247 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:16:42.426787 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:16:42.935508 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:16:42.935508 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.194s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:42.935508 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:16:43.145473 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:43.933373 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:43.933936 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:43.934692 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:16:43.934692 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.20 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:16:44.138073 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:44.138972 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:16:44.339844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:45.138581 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:45.138873 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:16:48.146735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:49.133869 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:49.134275 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:16:49.341220 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:51.137809 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:16:51.138625 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:16:53.148384 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:54.343816 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:55.467119 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:55.467454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:55.973348 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'flavor' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:16:56.652809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:56.977778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:16:58.134864 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:16:58.135241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:16:58.135241 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attaching volume ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 to /dev/vdb
May 28 03:16:58.149659 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:58.167691 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:16:58.177772 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:16:58.197933 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:16:58.239785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:16:58.240001 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:16:58.248392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:16:58.249340 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe9d:49be', 'fe80::f0da:32ff:fe23:fffb', 'fe80::fc16:3eff:feb5:41c5', 'fe80::f861:80ff:fe4e:b461'] 
May 28 03:16:58.249454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:16:58.249567 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:16:58.249767 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:16:58.249998 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating existing volume attachment record: 97335c8f-a9da-4abf-9b43-7995e39602a5 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:16:58.795510 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:16:58.795850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:16:58.796000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:58.796571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:58.796747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:16:58.807100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:58.807796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:16:58.809370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:58.809619 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:16:58.810016 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:16:58.810314 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:16:58.820316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:16:58.820316 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:58.824137 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:16:58.824137 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:58.831049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41] added
May 28 03:16:58.831049 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:16:58.831049 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:58.831049 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:58.831049 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:58.831049 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:58.831049 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:58.831302 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:16:58.831494 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:16:58.831674 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:16:58.834746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41] added
May 28 03:16:58.834746 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:16:58.834746 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:58.834746 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:58.834746 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:16:58.834746 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:16:58.834746 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:58.834938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:16:58.835139 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:16:58.835355 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:16:59.344043 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:16:59.832040 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:16:59.835794 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:16:59.843376 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:16:59.843376 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:16:59.850156 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:16:59.850156 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.857838 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.862794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.871153 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:59.876020 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.876020 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.876020 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.876020 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.876020 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.876020 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:59.876176 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.876176 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.876176 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.876176 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.876176 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.876176 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:59.901397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.40.100,3260]
May 28 03:16:59.901397 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.40.100,3260] successful.
May 28 03:16:59.901397 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.910422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.50.100,3260]
May 28 03:16:59.910422 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.50.100,3260] successful.
May 28 03:16:59.910422 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.915169 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.922106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.931719 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] HCTL ('12', '-', '-', 0) found on session 190 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:16:59.931719 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:16:59.937380 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.937380 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.937380 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.937380 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.937380 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.937380 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.937380 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.937380 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:16:59.937552 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.937552 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:16:59.937552 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.937552 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:16:59.937552 np0000001589 nova-compute[98297]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1af982fb-4a2e-4443-ad60-3cb5ea1dcf9e (non-flash)
May 28 03:16:59.937552 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.937552 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:16:59.937552 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:16:59.937808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:16:59.937865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:16:59.938563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] HCTL ('13', '-', '-', 0) found on session 191 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:16:59.938683 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:16:59.947206 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 190 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:16:59.947206 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:16:59.954324 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 191 and hctl ['13', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:00.954523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 191 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:00.955263 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:17:01.733186 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:01.733430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:01.733587 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:01.735784 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98297) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 03:17:01.736427 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'flavor' on Instance uuid 8cc063c9-471c-4e9b-830d-c74323a1447e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:01.825607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Found WWN 3300000003852ab65 for multipath device dm-6 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:17:01.825837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:01.825974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000003852ab65', 'path': '/dev/dm-6', 'multipath_id': '3300000003852ab65'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:01.826099 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003852ab65', 'path': '/dev/dm-6', 'multipath_id': '3300000003852ab65'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:17:01.828443 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'flavor' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:02.330976 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attempting to attach volume ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:17:02.332536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:17:02.332536 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:02.332536 np0000001589 nova-compute[98297]:   <alias name="ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41"/>
May 28 03:17:02.332536 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-6"/>
May 28 03:17:02.332536 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:17:02.332536 np0000001589 nova-compute[98297]:   <serial>ba6d6bf2-860a-4a3c-a822-1c2607bb7b41</serial>
May 28 03:17:02.332536 np0000001589 nova-compute[98297]: </disk>
May 28 03:17:02.332536 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:17:02.767024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:02.768904 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:02.789920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:02.793597 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:02.812677 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:02.818032 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:02.906580 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-394e4399-aa38-42a9-9bf0-1064bf6a8d29 req-6d8efe1d-1b45-4822-82cc-3949ade95586 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received event network-vif-unplugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:02.906997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-394e4399-aa38-42a9-9bf0-1064bf6a8d29 req-6d8efe1d-1b45-4822-82cc-3949ade95586 service nova] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:02.907176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-394e4399-aa38-42a9-9bf0-1064bf6a8d29 req-6d8efe1d-1b45-4822-82cc-3949ade95586 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:02.907328 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-394e4399-aa38-42a9-9bf0-1064bf6a8d29 req-6d8efe1d-1b45-4822-82cc-3949ade95586 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:02.907451 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-394e4399-aa38-42a9-9bf0-1064bf6a8d29 req-6d8efe1d-1b45-4822-82cc-3949ade95586 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] No waiting events found dispatching network-vif-unplugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:17:02.907570 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-394e4399-aa38-42a9-9bf0-1064bf6a8d29 req-6d8efe1d-1b45-4822-82cc-3949ade95586 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received unexpected event network-vif-unplugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 for instance with vm_state active and task_state powering-off.
May 28 03:17:03.024884 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:03.030968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:03.046219 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999674876999961 future=<Future at 0x7e4b407dc2f0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:03.046604 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999247193999963 future=<Future at 0x7e4b407dc2f0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:03.046727 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999121170999842 future=<Future at 0x7e4b407dc2f0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:03.048420 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Instance destroyed successfully.
May 28 03:17:03.048857 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cc063c9-471c-4e9b-830d-c74323a1447e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:03.150586 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:03.550374 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Object Instance<8cc063c9-471c-4e9b-830d-c74323a1447e> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:17:03.550849 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:03.959814 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:03.959926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:03.959926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:03.960027 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No VIF found with MAC fa:16:3e:9d:49:be, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:17:04.056799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d2134f8a-06cc-423f-9e9f-d41de3cb1cca tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.323s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:04.345806 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:04.969091 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f47d44f7-0f5e-4977-ab9d-456d072fdbc7 req-6b15aae1-4638-4533-9b5a-f219caf3f1a0 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received event network-vif-unplugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:04.970262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f47d44f7-0f5e-4977-ab9d-456d072fdbc7 req-6b15aae1-4638-4533-9b5a-f219caf3f1a0 service nova] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:04.970262 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f47d44f7-0f5e-4977-ab9d-456d072fdbc7 req-6b15aae1-4638-4533-9b5a-f219caf3f1a0 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:04.970433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f47d44f7-0f5e-4977-ab9d-456d072fdbc7 req-6b15aae1-4638-4533-9b5a-f219caf3f1a0 service nova] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:04.970514 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f47d44f7-0f5e-4977-ab9d-456d072fdbc7 req-6b15aae1-4638-4533-9b5a-f219caf3f1a0 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] No waiting events found dispatching network-vif-unplugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:17:04.970613 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-f47d44f7-0f5e-4977-ab9d-456d072fdbc7 req-6b15aae1-4638-4533-9b5a-f219caf3f1a0 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received unexpected event network-vif-unplugged-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 for instance with vm_state stopped and task_state None.
May 28 03:17:05.507380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8b53a36f-2b8e-4d69-9cd8-07bff8b76585 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.372s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:06.044731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:06.045136 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:06.548271 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'flavor' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:07.553061 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:07.618109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:07.618304 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:07.618507 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:07.618639 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:07.618746 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:07.620663 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Terminating instance
May 28 03:17:08.123715 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:17:08.127950 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Instance destroyed successfully.
May 28 03:17:08.128387 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid 8cc063c9-471c-4e9b-830d-c74323a1447e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:08.152428 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:08.615069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:08.615498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:08.615498 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attaching volume a059eab6-e30b-4c06-85b1-d9b8a0a025e6 to /dev/vdc
May 28 03:17:08.630311 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:16:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-715680181',display_name='tempest-TestVolumeBootPattern-server-715680181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-715680181',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdIbxqY2Uz7rKN3HuBgf0GYxZTRkdgE6AsBFWTINI18+zdSXe2uwyVWCkt8pPRcxqw4xUVX5jKI4E4PJeAAOCGSf+CaXOeAOdqDadi0qZ3movmDOnlkz563H7d4r7rrpQ==',key_name='tempest-keypair-203515736',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:16:33Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-nr92uh3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:17:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=8cc063c9-471c-4e9b-830d-c74323a1447e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:17:08.630510 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "address": "fa:16:3e:b5:41:c5", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ebb0bba-50", "ovs_interfaceid": "8ebb0bba-50fd-47a2-b6ad-0d0e7c315691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:17:08.631109 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:41:c5,bridge_name='br-int',has_traffic_filtering=True,id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ebb0bba-50') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:17:08.631355 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:41:c5,bridge_name='br-int',has_traffic_filtering=True,id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ebb0bba-50') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:17:08.633335 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:08.633547 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ebb0bba-50, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:08.634376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:08.635241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:17:08.635955 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:08.636756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:08.636892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02a876e3-b57a-494d-8d6c-aa81fb31fd76) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:08.637344 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:08.637910 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:17:08.638100 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:08.640195 np0000001589 nova-compute[98297]: INFO os_vif [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:41:c5,bridge_name='br-int',has_traffic_filtering=True,id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ebb0bba-50')
May 28 03:17:08.641855 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:17:08.642160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:08.642318 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:08.642615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:08.642910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c62d9daf-e8d1-4c17-aec3-50055fda7278', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:17:08.643072 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:17:08.656925 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:08.666276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:08.666276 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:08.666276 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:17:08.666276 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:17:08.666276 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:08.666276 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:08.666276 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:08.666580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:08.666580 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:08.666580 np0000001589 nova-compute[98297]: tcp: [182] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:17:08.666580 np0000001589 nova-compute[98297]: tcp: [183] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278 (non-flash)
May 28 03:17:08.666580 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:08.666580 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:08.666580 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:08.666828 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', '182'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', '183'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', '191')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:17:08.666828 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', '182')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:08.668051 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278', '183')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:08.668958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:17:08.669375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64452a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:17:08.669554 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:17:08.669738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 33000000047da9fa7 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:17:08.692285 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:08.734065 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:08.742673 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:17:08.742966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:17:08.751921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:17:08.752788 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe9d:49be', 'fe80::f0da:32ff:fe23:fffb'] 
May 28 03:17:08.752916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:17:08.753031 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:17:08.753392 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:08.754631 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating existing volume attachment record: 9610a213-1a9c-43ad-88cf-44c6413e88bc {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:17:08.789650 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:08.846450 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:17:08.846693 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:17:08.847751 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:17:08.858731 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:17:08.858959 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:17:08.869115 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:08.903561 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 182, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.40.100,3260]
May 28 03:17:08.903561 np0000001589 nova-compute[98297]: Logout of [sid: 182, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.40.100,3260] successful.
May 28 03:17:08.903561 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:08.918165 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:08.928283 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:08.965500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.50.100,3260]
May 28 03:17:08.965500 np0000001589 nova-compute[98297]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-c62d9daf-e8d1-4c17-aec3-50055fda7278, portal: 192.168.50.100,3260] successful.
May 28 03:17:08.965500 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:08.979264 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:08.979388 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:08.979511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (336ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:08.979748 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:17:08.980129 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Deleting instance files /opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e_del
May 28 03:17:08.980613 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Deletion of /opt/stack/data/nova/instances/8cc063c9-471c-4e9b-830d-c74323a1447e_del complete
May 28 03:17:09.302084 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:17:09.302442 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:09.302591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:09.303057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:09.303272 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:17:09.314490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:09.315131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:09.315680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:09.315873 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:17:09.316384 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:09.316590 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:17:09.327047 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:17:09.327047 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:09.331811 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:17:09.331811 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:09.339505 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6] added
May 28 03:17:09.339505 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:17:09.339505 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:09.339505 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:09.339505 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:09.339505 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:09.339505 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:09.339807 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:17:09.339881 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.024(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:17:09.340076 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:17:09.342669 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6] added
May 28 03:17:09.342669 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:17:09.342669 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:09.342669 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:09.342669 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:09.342669 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:09.342669 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:09.342926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:17:09.342981 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:17:09.343111 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:17:09.487661 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Took 1.36 seconds to destroy the instance on the hypervisor.
May 28 03:17:09.488322 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:17:09.488715 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:17:09.488864 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:17:09.489216 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:09.579408 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:09.909178 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6e54fd33-279d-438f-8acf-f873ddfd935e req-aeb92e0e-0a20-4a0f-8b39-7804a418e821 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Received event network-vif-deleted-8ebb0bba-50fd-47a2-b6ad-0d0e7c315691 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:09.909531 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-6e54fd33-279d-438f-8acf-f873ddfd935e req-aeb92e0e-0a20-4a0f-8b39-7804a418e821 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Neutron deleted interface 8ebb0bba-50fd-47a2-b6ad-0d0e7c315691; detaching it from the instance and deleting it from the info cache
May 28 03:17:09.910903 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6e54fd33-279d-438f-8acf-f873ddfd935e req-aeb92e0e-0a20-4a0f-8b39-7804a418e821 service nova] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Detach interface failed, port_id=8ebb0bba-50fd-47a2-b6ad-0d0e7c315691, reason: Instance 8cc063c9-471c-4e9b-830d-c74323a1447e could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:17:10.088941 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:10.089166 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:10.340522 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:17:10.343449 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:17:10.353569 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:17:10.353569 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:17:10.358470 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:17:10.358470 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.364310 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.369934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.372780 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:10.377979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.377979 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.377979 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.377979 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.377979 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:10.378212 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.378212 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.378212 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.378212 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.378212 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:10.385330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.385330 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.385330 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.385330 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.385330 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:10.385541 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.385541 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.385541 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.385541 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.385541 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:10.421654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.40.100,3260]
May 28 03:17:10.421654 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.40.100,3260] successful.
May 28 03:17:10.421654 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.431958 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.442619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.50.100,3260]
May 28 03:17:10.442619 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.50.100,3260] successful.
May 28 03:17:10.442619 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.448252 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:10.448578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:10.448578 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:17:10.449163 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] HCTL ('7', '-', '-', 0) found on session 192 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:17:10.449284 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:17:10.455674 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:10.463943 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 192 and hctl ['7', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:10.469397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.469397 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.469397 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.469397 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.469397 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.469397 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.469397 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:10.469626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.469626 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:10.469626 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.469626 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:10.469626 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.469626 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:10.469626 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:10.469802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:10.469928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:17:10.470807 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] HCTL ('8', '-', '-', 0) found on session 193 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:17:10.470950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:17:10.484023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 193 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:10.590979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:17:10.874706 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Took 1.39 seconds to deallocate network for instance.
May 28 03:17:11.142327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:11.142687 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:11.145501 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:17:11.145635 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Claim successful on node np0000001589
May 28 03:17:11.413365 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:17:11.463934 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 192 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:11.464105 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:17:11.483858 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Searching for a device in session 193 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:11.483987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:17:11.918009 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:12.304204 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:17:12.304560 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:17:12.316280 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:17:12.806842 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:17:13.312517 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.170s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:13.313205 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.395s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:13.313381 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:17:13.335714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Found WWN 330000000bd55b3bd for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:17:13.335978 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:13.336140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== connect_volume: return (4033ms) {'type': 'block', 'scsi_wwn': '330000000bd55b3bd', 'path': '/dev/dm-0', 'multipath_id': '330000000bd55b3bd'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:13.336269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bd55b3bd', 'path': '/dev/dm-0', 'multipath_id': '330000000bd55b3bd'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:17:13.338868 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'flavor' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:13.486732 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:17:13.486948 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:17:13.637764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:13.820700 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:17:13.820897 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:17:13.821148 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:13.821394 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:13.841598 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attempting to attach volume a059eab6-e30b-4c06-85b1-d9b8a0a025e6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:17:13.842995 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:17:13.842995 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:13.842995 np0000001589 nova-compute[98297]:   <alias name="ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6"/>
May 28 03:17:13.842995 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:17:13.842995 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:17:13.842995 np0000001589 nova-compute[98297]:   <serial>a059eab6-e30b-4c06-85b1-d9b8a0a025e6</serial>
May 28 03:17:13.842995 np0000001589 nova-compute[98297]: </disk>
May 28 03:17:13.842995 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:17:13.883759 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '833c35fdd92b4929b9f3c40ffb29b3c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a6a1526383440ceb5b3f69f7492d966', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:17:13.989126 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:17:14.290267 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Successfully created port: 802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:17:14.323600 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:17:14.495609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.183s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:14.539533 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance 8cc063c9-471c-4e9b-830d-c74323a1447e
May 28 03:17:14.691397 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Successfully updated port: 802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:17:14.736562 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-changed-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:14.736716 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Refreshing instance network info cache due to event network-changed-802aca06-883d-486e-9b79-c6e583147611. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:17:14.737061 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] Acquiring lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:14.737161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] Acquired lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:14.737304 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Refreshing network info cache for port 802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:17:14.826480 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:17:15.193076 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:15.239071 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:15.292921 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:17:15.405910 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:15.486748 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:15.486934 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:15.487065 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:15.487211 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:15.487373 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] No VIF found with MAC fa:16:3e:9d:49:be, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:17:15.546197 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c2542c9f-12c9-4394-b73b-298744c6e48f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "8cc063c9-471c-4e9b-830d-c74323a1447e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.928s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:15.903774 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:17:15.913913 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0af310fc-d896-4784-be54-4f7750278c6b req-8f6f3732-52f6-40d4-a885-ceb836aa5545 service nova] Releasing lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:15.914350 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:17:15.914718 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquired lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:15.914942 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:17:15.915672 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Creating image(s)
May 28 03:17:15.916372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "/opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:15.916632 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "/opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:15.917260 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "/opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:15.917883 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:17:15.920129 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:17:15.921124 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:16.008644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:16.009409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:16.009721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:16.010204 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:17:16.012728 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:17:16.013036 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:16.101947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:16.102391 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:16.161818 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk 1073741824" returned: 0 in 0.059s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:16.162294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:16.162624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:16.250630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:16.251073 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:17:16.251327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:16.338624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:16.339178 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Cannot resize image /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:17:16.339569 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:17:16.339731 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Ensure instance console log exists: /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:17:16.340033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:16.340267 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:16.340410 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:16.476273 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:17:16.626558 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:16.745072 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Updating instance_info_cache with network_info: [{"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:17.035608 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-dcb10cc4-c5a3-4c35-aa10-8780f239a284 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.420s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:17.247207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Releasing lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:17.247207 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Instance network_info: |[{"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:17:17.249123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Start _get_guest_xml network_info=[{"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:17:17.253397 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:17:17.254496 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-2011356735', uuid='275118e5-8f9a-4cc6-abab-e7ff17154aee'), owner=OwnerMeta(userid='833c35fdd92b4929b9f3c40ffb29b3c5', username='tempest-VolumesBackupsTest-1005474821-project-member', projectid='8a6a1526383440ceb5b3f69f7492d966', projectname='tempest-VolumesBackupsTest-1005474821'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938237.2541776) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:17:17.255458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:17:17.255747 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:17:17.256664 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:17:17.256823 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:17:17.257635 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:17:17.257904 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:17:17.258046 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:17:17.258138 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:17:17.258263 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:17:17.258346 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:17:17.258428 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:17:17.258573 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:17:17.258663 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:17:17.258768 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:17:17.258880 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:17:17.259001 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:17:17.268564 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2011356735',display_name='tempest-VolumesBackupsTest-instance-2011356735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesbackupstest-instance-2011356735',id=67,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7TNZT7lIq0IlUWfC5e2GgcLkCiz+vEiHj6xCz+1ihxzeghfOUDsLo7oeowPh3W7drh4lsqoq/4WqWj6bNE47uBCxVREr+2WHN40Zp4n9dgfWIMqEzmmUULMqRIZzD3QQ==',key_name='tempest-keypair-473449176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6a1526383440ceb5b3f69f7492d966',ramdisk_id='',reservation_id='r-i4sprbl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1005474821',owner_user_name='tempest-VolumesBackupsTest-1005474821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='833c35fdd92b4929b9f3c40ffb29b3c5',uuid=275118e5-8f9a-4cc6-abab-e7ff17154aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:17:17.268714 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converting VIF {"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:17:17.269219 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:62:78,bridge_name='br-int',has_traffic_filtering=True,id=802aca06-883d-486e-9b79-c6e583147611,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802aca06-88') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:17:17.269697 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'pci_devices' on Instance uuid 275118e5-8f9a-4cc6-abab-e7ff17154aee {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:17.772524 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] End _get_guest_xml xml=<domain type="qemu">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <uuid>275118e5-8f9a-4cc6-abab-e7ff17154aee</uuid>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <name>instance-00000043</name>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumesBackupsTest-instance-2011356735</nova:name>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:17:17</nova:creationTime>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:user uuid="833c35fdd92b4929b9f3c40ffb29b3c5">tempest-VolumesBackupsTest-1005474821-project-member</nova:user>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:project uuid="8a6a1526383440ceb5b3f69f7492d966">tempest-VolumesBackupsTest-1005474821</nova:project>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         <nova:port uuid="802aca06-883d-486e-9b79-c6e583147611">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <system>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <entry name="serial">275118e5-8f9a-4cc6-abab-e7ff17154aee</entry>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <entry name="uuid">275118e5-8f9a-4cc6-abab-e7ff17154aee</entry>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </system>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <os>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   </os>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <features>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   </features>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   <devices>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </disk>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk.config"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </disk>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:ac:62:78"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <target dev="tap802aca06-88"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </interface>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/console.log" append="off"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </serial>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <video>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </video>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </rng>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:   </devices>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]: </domain>
May 28 03:17:17.772524 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:17:17.774690 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Preparing to wait for external event network-vif-plugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:17:17.774690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:17.774690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:17.774690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:17.774690 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2011356735',display_name='tempest-VolumesBackupsTest-instance-2011356735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesbackupstest-instance-2011356735',id=67,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7TNZT7lIq0IlUWfC5e2GgcLkCiz+vEiHj6xCz+1ihxzeghfOUDsLo7oeowPh3W7drh4lsqoq/4WqWj6bNE47uBCxVREr+2WHN40Zp4n9dgfWIMqEzmmUULMqRIZzD3QQ==',key_name='tempest-keypair-473449176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a6a1526383440ceb5b3f69f7492d966',ramdisk_id='',reservation_id='r-i4sprbl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-1005474821',owner_user_name='tempest-VolumesBackupsTest-1005474821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='833c35fdd92b4929b9f3c40ffb29b3c5',uuid=275118e5-8f9a-4cc6-abab-e7ff17154aee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:17:17.774690 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converting VIF {"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:17:17.775293 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:62:78,bridge_name='br-int',has_traffic_filtering=True,id=802aca06-883d-486e-9b79-c6e583147611,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802aca06-88') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:17:17.775622 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:62:78,bridge_name='br-int',has_traffic_filtering=True,id=802aca06-883d-486e-9b79-c6e583147611,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802aca06-88') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:17:17.776000 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:17.776326 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:17.776584 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:17:17.777219 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:17.777402 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7e6181f-57b4-563c-be21-c86a17502031', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:17.791753 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:17.793152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:17:17.795021 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:17.795205 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap802aca06-88, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:17.795622 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap802aca06-88, col_values=(('qos', UUID('6d410c06-b928-489b-b519-2b3dbc8cde56')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:17.795834 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap802aca06-88, col_values=(('external_ids', {'iface-id': '802aca06-883d-486e-9b79-c6e583147611', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:62:78', 'vm-uuid': '275118e5-8f9a-4cc6-abab-e7ff17154aee'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:17.796604 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:17.798060 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:17:17.802788 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:17.803768 np0000001589 nova-compute[98297]: INFO os_vif [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:62:78,bridge_name='br-int',has_traffic_filtering=True,id=802aca06-883d-486e-9b79-c6e583147611,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802aca06-88')
May 28 03:17:18.046297 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004032639999422827 future=<Future at 0x7e4b407dc2f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:18.046416 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:18.046936 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] Emitting event <LifecycleEvent: 1779938223.045777, 8cc063c9-471c-4e9b-830d-c74323a1447e => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:18.047157 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] VM Stopped (Lifecycle Event)
May 28 03:17:18.155630 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:18.551146 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90c54c3b-ecd0-4a81-a9c2-48055cd282c7 tempest-TestServerVolumeAttachmentScenario-1569926520 tempest-TestServerVolumeAttachmentScenario-1569926520-project-member] [instance: 8cc063c9-471c-4e9b-830d-c74323a1447e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:19.317909 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:19.318307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:19.318307 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No VIF found with MAC fa:16:3e:ac:62:78, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:17:19.318567 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Using config drive
May 28 03:17:19.823504 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:19.888041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:19.888282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:19.933517 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Creating config drive at /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk.config
May 28 03:17:19.937110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc_ag5rt0 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:19.993972 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc_ag5rt0" returned: 0 in 0.056s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:20.374914 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:20.390211 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:17:20.397385 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:20.471083 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:20.582018 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f073647e-ec04-4364-be19-07dd80f88f59 req-2a2eaee2-8208-455c-954d-03e59378f93d service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-vif-plugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:20.582601 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f073647e-ec04-4364-be19-07dd80f88f59 req-2a2eaee2-8208-455c-954d-03e59378f93d service nova] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:20.582961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f073647e-ec04-4364-be19-07dd80f88f59 req-2a2eaee2-8208-455c-954d-03e59378f93d service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:20.582961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f073647e-ec04-4364-be19-07dd80f88f59 req-2a2eaee2-8208-455c-954d-03e59378f93d service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:20.583177 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f073647e-ec04-4364-be19-07dd80f88f59 req-2a2eaee2-8208-455c-954d-03e59378f93d service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Processing event network-vif-plugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:17:20.731859 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:20.736158 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:20.755259 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:20.945211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:20.945562 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:20.949833 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:17:20.951270 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Claim successful on node np0000001589
May 28 03:17:21.129303 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938241.1288416, 275118e5-8f9a-4cc6-abab-e7ff17154aee => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:21.129841 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:17:21.130101 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] VM Started (Lifecycle Event)
May 28 03:17:21.134151 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:17:21.137909 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Instance spawned successfully.
May 28 03:17:21.138326 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:17:21.633299 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:21.635178 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:17:21.643990 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:21.644117 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:21.644340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:21.644542 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:21.644801 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:21.645038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:21.741610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:21.741812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:22.124418 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:17:22.124679 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:17:22.137208 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:17:22.137422 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938242.13728, 275118e5-8f9a-4cc6-abab-e7ff17154aee => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:22.137519 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] VM Paused (Lifecycle Event)
May 28 03:17:22.148786 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Took 6.24 seconds to spawn the instance on the hypervisor.
May 28 03:17:22.148935 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:22.243845 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Detaching volume ba6d6bf2-860a-4a3c-a822-1c2607bb7b41
May 28 03:17:22.277907 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attempting to driver detach volume ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 from mountpoint /dev/vdb
May 28 03:17:22.281754 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Found disk vdb by alias ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:17:22.282766 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Found disk vdb by alias ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:17:22.282873 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Attempting to detach device vdb from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:17:22.283108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:17:22.283108 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:22.283108 np0000001589 nova-compute[98297]:   <alias name="ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41"/>
May 28 03:17:22.283108 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-6"/>
May 28 03:17:22.283108 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:17:22.283108 np0000001589 nova-compute[98297]:   <serial>ba6d6bf2-860a-4a3c-a822-1c2607bb7b41</serial>
May 28 03:17:22.283108 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:17:22.283108 np0000001589 nova-compute[98297]: </disk>
May 28 03:17:22.283108 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:17:22.290623 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Successfully detached device vdb from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the persistent domain config.
May 28 03:17:22.290869 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] (1/8): Attempting to detach device vdb with device alias ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:17:22.291124 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:17:22.291124 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:22.291124 np0000001589 nova-compute[98297]:   <alias name="ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41"/>
May 28 03:17:22.291124 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-6"/>
May 28 03:17:22.291124 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:17:22.291124 np0000001589 nova-compute[98297]:   <serial>ba6d6bf2-860a-4a3c-a822-1c2607bb7b41</serial>
May 28 03:17:22.291124 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:17:22.291124 np0000001589 nova-compute[98297]: </disk>
May 28 03:17:22.291124 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:17:22.626957 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:17:22.639201 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:22.641370 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938242.641158, 275118e5-8f9a-4cc6-abab-e7ff17154aee => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:22.641517 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] VM Resumed (Lifecycle Event)
May 28 03:17:22.652051 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-00cd8983-9997-4c6e-b1fd-333c6893c3fc req-65872e71-e817-4792-9b7c-94cef3942cea service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-vif-plugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:22.652447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-00cd8983-9997-4c6e-b1fd-333c6893c3fc req-65872e71-e817-4792-9b7c-94cef3942cea service nova] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:22.652630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-00cd8983-9997-4c6e-b1fd-333c6893c3fc req-65872e71-e817-4792-9b7c-94cef3942cea service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:22.652760 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-00cd8983-9997-4c6e-b1fd-333c6893c3fc req-65872e71-e817-4792-9b7c-94cef3942cea service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:22.652883 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-00cd8983-9997-4c6e-b1fd-333c6893c3fc req-65872e71-e817-4792-9b7c-94cef3942cea service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] No waiting events found dispatching network-vif-plugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:17:22.653049 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-00cd8983-9997-4c6e-b1fd-333c6893c3fc req-65872e71-e817-4792-9b7c-94cef3942cea service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received unexpected event network-vif-plugged-802aca06-883d-486e-9b79-c6e583147611 for instance with vm_state active and task_state None.
May 28 03:17:22.656583 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Took 11.56 seconds to build instance.
May 28 03:17:22.750456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 for instance 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:17:22.811493 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:23.132764 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.187s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:23.133098 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:17:23.143448 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:23.145622 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:17:23.158403 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:23.160736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-897aa479-3f5e-4e4b-a3a3-aded0a085429 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.070s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:23.639960 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:17:23.639960 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:17:23.640583 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:23.640583 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:23.648775 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938243.6484516, 1d7d956c-368d-4986-8fa4-18980377f24e => ua-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:17:23.651534 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Successfully detached device vdb from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the live domain config.
May 28 03:17:23.652849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:17:23.653178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:23.653328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:23.653675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:23.653974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:17:23.654149 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:17:23.684338 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:23.684338 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:23.684338 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:23.684338 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:23.684338 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:23.684338 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:23.684338 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:23.684589 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:23.684589 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:23.684589 np0000001589 nova-compute[98297]: tcp: [190] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:23.684589 np0000001589 nova-compute[98297]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41 (non-flash)
May 28 03:17:23.684589 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:23.684589 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:23.684589 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:23.684795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', '191'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', '193')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:17:23.684795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', '190')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:23.685854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41', '191')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:23.686710 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4051f880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41'): ({'sdh'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:17:23.686998 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Removing multipathed devices sdg, sdh {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:17:23.687374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Flush multipath device 3300000003852ab65 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:17:23.720381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:23.736833 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:17:23.776597 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:23.820626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:17:23.821033 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:17:23.822408 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:17:23.832550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:17:23.832768 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:17:23.845437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:23.871744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.40.100,3260]
May 28 03:17:23.871744 np0000001589 nova-compute[98297]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.40.100,3260] successful.
May 28 03:17:23.871744 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:23.887277 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:23.898661 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:23.930101 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-changed-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:23.931106 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Refreshing instance network info cache due to event network-changed-802aca06-883d-486e-9b79-c6e583147611. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:17:23.931331 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] Acquiring lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:23.931489 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] Acquired lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:23.931767 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Refreshing network info cache for port 802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:17:23.933868 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.50.100,3260]
May 28 03:17:23.933868 np0000001589 nova-compute[98297]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-ba6d6bf2-860a-4a3c-a822-1c2607bb7b41, portal: 192.168.50.100,3260] successful.
May 28 03:17:23.933868 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:23.949192 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:23.949623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:23.949763 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== disconnect_volume: return (296ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:23.949902 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:17:24.143818 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:17:24.154039 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Successfully created port: 5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:17:24.434861 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:24.490764 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'flavor' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:24.563337 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Successfully updated port: 5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:17:24.605065 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-changed-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:24.605423 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Refreshing instance network info cache due to event network-changed-5de817f8-187b-486c-b032-d31544f5fc0a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:17:24.605423 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] Acquiring lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:24.605669 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] Acquired lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:24.605831 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Refreshing network info cache for port 5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:17:24.646878 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:17:24.706746 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:24.848111 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Updated VIF entry in instance network info cache for port 802aca06-883d-486e-9b79-c6e583147611. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:17:24.848461 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Updating instance_info_cache with network_info: [{"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:25.065197 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:25.107836 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:25.151621 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Booting with volume b4156ff4-0ac0-4189-8e61-4da7305c4ce2 at /dev/vda
May 28 03:17:25.163733 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:17:25.188464 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:25.201045 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:17:25.223407 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:25.279619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:17:25.280927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:17:25.289124 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:17:25.290401 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe9d:49be', 'fe80::f0da:32ff:fe23:fffb', 'fe80::fc16:3eff:feac:6278', 'fe80::68f8:b7ff:fe71:d00c'] 
May 28 03:17:25.290570 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:17:25.290741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:17:25.291092 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:25.291404 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Updating existing volume attachment record: 0fe89183-5ecc-4363-a118-4c2556779208 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:17:25.311947 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:25.350889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fa068efa-09ec-42a6-b1eb-8ec32a879179 req-e870a069-6be6-4459-906f-da5e60c76f6a service nova] Releasing lock "refresh_cache-275118e5-8f9a-4cc6-abab-e7ff17154aee" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:25.497138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-aa61c9e0-1069-4639-9528-0899d9f86a2b tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.755s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:25.815299 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-72fd8412-c6d2-4aad-b610-d6660778d1ee req-d955d270-71ab-4a00-b2c9-0ad625b47c4a service nova] Releasing lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:25.815800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:25.815800 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:17:26.398938 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:17:26.543705 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:26.661661 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Updating instance_info_cache with network_info: [{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:27.163929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:27.164306 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance network_info: |[{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:17:27.393872 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:17:27.395216 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:17:27.395500 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Creating image(s)
May 28 03:17:27.395825 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:17:27.395987 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Ensure instance console log exists: /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:17:27.396268 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:27.396478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:27.396609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:27.397135 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Start _get_guest_xml network_info=[{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0fe89183-5ecc-4363-a118-4c2556779208', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd09b4ea5-5136-4338-9813-8f3b762aa4ab', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'serial': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:17:27.402586 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:17:27.404189 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-108984611', uuid='d09b4ea5-5136-4338-9813-8f3b762aa4ab'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938247.4037554) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:17:27.405783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:17:27.406187 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:17:27.407534 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:17:27.407698 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:17:27.408541 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:17:27.408789 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:17:27.408926 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:17:27.409012 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:17:27.409119 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:17:27.409216 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:17:27.409357 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:17:27.409499 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:17:27.409590 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:17:27.409691 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:17:27.409786 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:17:27.409940 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:17:27.419150 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:17:27.419572 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:27.419695 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:27.420029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:27.420190 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:17:27.431442 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:27.431994 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:27.432546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:27.432620 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:17:27.432803 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:27.432982 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:17:27.446899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:17:27.446899 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:27.451018 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:17:27.451018 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:27.459684 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2] added
May 28 03:17:27.459684 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:17:27.459684 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:27.459684 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:27.459684 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:27.459684 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:27.459684 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:27.459895 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:17:27.460043 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:17:27.460147 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:17:27.461767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2] added
May 28 03:17:27.461767 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:17:27.461767 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:27.461767 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:27.461767 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:27.461767 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:27.461767 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:27.461990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:17:27.462159 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:17:27.462345 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:17:27.819434 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:28.159097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:28.460553 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:17:28.462662 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:17:28.474513 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:17:28.474513 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:17:28.480449 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:17:28.480449 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.486430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.502430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.503122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.503122 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.503122 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.503122 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.503122 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:28.503414 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.503414 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.503414 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.503414 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.503414 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:28.514729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.514729 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.514729 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.514729 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.514729 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:28.514989 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.514989 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.514989 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.514989 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.514989 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:28.547696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260]
May 28 03:17:28.547696 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260] successful.
May 28 03:17:28.547696 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.560702 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.572591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260]
May 28 03:17:28.572591 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260] successful.
May 28 03:17:28.572591 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.577893 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.577893 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.577893 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.577893 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.577893 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.577893 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.577893 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:28.578107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.578107 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.578107 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.578107 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.578107 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.578107 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.578107 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:28.578533 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.146s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:28.578533 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:17:28.579188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('9', '-', '-', 0) found on session 194 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:17:28.579381 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:17:28.587199 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:28.600626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 194 and hctl ['9', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:28.605785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.605785 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.605785 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.605785 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.605785 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.605785 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.605785 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:28.606002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.606002 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:28.606002 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.606002 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:28.606002 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.606002 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:28.606002 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:28.606310 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:28.606409 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:17:28.607014 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('12', '-', '-', 0) found on session 195 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:17:28.607112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:17:28.622357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 195 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:28.622357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:17:29.596178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 194 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:29.596525 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:17:30.123730 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:30.123899 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:30.448207 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 3300000007817086c for multipath device dm-4 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:17:30.448367 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:30.448514 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '3300000007817086c', 'path': '/dev/dm-4', 'multipath_id': '3300000007817086c'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:30.448630 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007817086c', 'path': '/dev/dm-4', 'multipath_id': '3300000007817086c'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:17:30.626588 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Detaching volume a059eab6-e30b-4c06-85b1-d9b8a0a025e6
May 28 03:17:30.660093 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Attempting to driver detach volume a059eab6-e30b-4c06-85b1-d9b8a0a025e6 from mountpoint /dev/vdc
May 28 03:17:30.663983 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Found disk vdc by alias ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:17:30.665171 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Found disk vdc by alias ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:17:30.665325 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Attempting to detach device vdc from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:17:30.665561 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:17:30.665561 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:30.665561 np0000001589 nova-compute[98297]:   <alias name="ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6"/>
May 28 03:17:30.665561 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:17:30.665561 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:17:30.665561 np0000001589 nova-compute[98297]:   <serial>a059eab6-e30b-4c06-85b1-d9b8a0a025e6</serial>
May 28 03:17:30.665561 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:17:30.665561 np0000001589 nova-compute[98297]: </disk>
May 28 03:17:30.665561 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:17:30.670913 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Successfully detached device vdc from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the persistent domain config.
May 28 03:17:30.671075 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] (1/8): Attempting to detach device vdc with device alias ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:17:30.671339 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:17:30.671339 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:30.671339 np0000001589 nova-compute[98297]:   <alias name="ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6"/>
May 28 03:17:30.671339 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:17:30.671339 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:17:30.671339 np0000001589 nova-compute[98297]:   <serial>a059eab6-e30b-4c06-85b1-d9b8a0a025e6</serial>
May 28 03:17:30.671339 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:17:30.671339 np0000001589 nova-compute[98297]: </disk>
May 28 03:17:30.671339 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:17:30.953452 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108984611',display_name='tempest-TestVolumeBootPattern-server-108984611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-108984611',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs4Z0IQvLfQNZ3quTlHVCvUfLAQyCiUjgW5GN2+o0QNyaYl9Lzorh8zHyCN9LrouVsCbda/rJk8A/lm/Gn97ZPnofjIIj0K7sHKscjHgBjyX9n++BMDHRHdxsqZ7hl4vQ==',key_name='tempest-keypair-882609080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-04jjv0qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=d09b4ea5-5136-4338-9813-8f3b762aa4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:17:30.953708 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:17:30.954310 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:17:30.954879 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:31.182676 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938251.1823294, 1d7d956c-368d-4986-8fa4-18980377f24e => ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:17:31.183876 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 for instance 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:17:31.185965 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Successfully detached device vdc from instance 1d7d956c-368d-4986-8fa4-18980377f24e from the live domain config.
May 28 03:17:31.186901 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:17:31.187162 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:31.187292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:31.187592 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:31.187843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:17:31.187976 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:17:31.210846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:31.210846 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:31.210846 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:31.210846 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:31.210846 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:31.210846 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:31.210846 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:31.211044 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:31.211044 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:31.211044 np0000001589 nova-compute[98297]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:31.211044 np0000001589 nova-compute[98297]: tcp: [193] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6 (non-flash)
May 28 03:17:31.211044 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:31.211044 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:31.211044 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:31.211167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', '192'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', '193'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '195')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:17:31.211344 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', '192')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:31.212320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6', '193')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:31.213188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40531ee0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:17:31.213402 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:17:31.213653 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Flush multipath device 330000000bd55b3bd {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:17:31.239522 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:31.284926 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:31.330549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:17:31.330701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:17:31.331652 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:17:31.342254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:17:31.342420 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:17:31.353282 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:31.381018 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.40.100,3260]
May 28 03:17:31.381018 np0000001589 nova-compute[98297]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.40.100,3260] successful.
May 28 03:17:31.381018 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:31.395469 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:31.405845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:31.438573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.50.100,3260]
May 28 03:17:31.438573 np0000001589 nova-compute[98297]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-a059eab6-e30b-4c06-85b1-d9b8a0a025e6, portal: 192.168.50.100,3260] successful.
May 28 03:17:31.438573 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:31.453575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:31.453774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:31.453916 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== disconnect_volume: return (266ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:31.454019 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:17:31.458810 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] End _get_guest_xml xml=<domain type="qemu">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <uuid>d09b4ea5-5136-4338-9813-8f3b762aa4ab</uuid>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <name>instance-00000044</name>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-108984611</nova:name>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:17:27</nova:creationTime>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         <nova:port uuid="5de817f8-187b-486c-b032-d31544f5fc0a">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <system>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <entry name="serial">d09b4ea5-5136-4338-9813-8f3b762aa4ab</entry>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <entry name="uuid">d09b4ea5-5136-4338-9813-8f3b762aa4ab</entry>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </system>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <os>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   </os>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <features>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   </features>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   <devices>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.config"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </disk>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <alias name="ua-b4156ff4-0ac0-4189-8e61-4da7305c4ce2"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-4"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <serial>b4156ff4-0ac0-4189-8e61-4da7305c4ce2</serial>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </disk>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:dc:19:e9"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <target dev="tap5de817f8-18"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </interface>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/console.log" append="off"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </serial>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <video>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </video>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </rng>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:   </devices>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]: </domain>
May 28 03:17:31.458810 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Preparing to wait for external event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108984611',display_name='tempest-TestVolumeBootPattern-server-108984611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-108984611',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs4Z0IQvLfQNZ3quTlHVCvUfLAQyCiUjgW5GN2+o0QNyaYl9Lzorh8zHyCN9LrouVsCbda/rJk8A/lm/Gn97ZPnofjIIj0K7sHKscjHgBjyX9n++BMDHRHdxsqZ7hl4vQ==',key_name='tempest-keypair-882609080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-04jjv0qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=d09b4ea5-5136-4338-9813-8f3b762aa4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:17:31.461421 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:31.462152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:31.462152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:17:31.462817 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:31.463245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b3bfbd-e0bf-5f7a-9ca7-c44ee17d5295', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:31.465091 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:31.465682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:17:31.466282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:31.468194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:31.468342 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5de817f8-18, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:31.468618 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5de817f8-18, col_values=(('qos', UUID('fcd5c712-eaba-440c-9469-1a350efb998c')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:31.468782 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5de817f8-18, col_values=(('external_ids', {'iface-id': '5de817f8-187b-486c-b032-d31544f5fc0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:19:e9', 'vm-uuid': 'd09b4ea5-5136-4338-9813-8f3b762aa4ab'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:31.469512 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:31.470902 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:17:31.475770 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:31.476874 np0000001589 nova-compute[98297]: INFO os_vif [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18')
May 28 03:17:32.010885 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'flavor' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:32.996687 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:32.996835 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:32.996835 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:dc:19:e9, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:17:32.997269 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Using config drive
May 28 03:17:33.018057 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0ae4e8d6-965e-48f1-88a2-aa758c2e6e69 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.894s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:33.162435 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:33.422656 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:33.422855 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing instance network info cache due to event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:17:33.423022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] Acquiring lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:33.423109 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] Acquired lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:33.423217 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:17:33.504733 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:33.621100 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Creating config drive at /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.config
May 28 03:17:33.625188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiw6l9f6k {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:33.680722 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiw6l9f6k" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:33.823966 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:33.824146 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing instance network info cache due to event network-changed-167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:17:33.824353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] Acquiring lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:33.925384 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:34.057579 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.078947 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.078947 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.178518 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.249550 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:34.344547 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:34.344846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:34.345148 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:34.345404 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:34.345579 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:34.349401 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Terminating instance
May 28 03:17:34.406040 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.408247 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.415102 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updated VIF entry in instance network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:17:34.415342 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating instance_info_cache with network_info: [{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:34.416363 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.434606 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.785852 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938254.785498, d09b4ea5-5136-4338-9813-8f3b762aa4ab => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:34.786021 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] VM Started (Lifecycle Event)
May 28 03:17:34.853445 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:17:34.871770 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.891483 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.901590 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:34.917859 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb8f8065-8dd0-4aa2-bcf6-a51087d17f2d req-9d4c8325-bb57-4c08-80b3-fa27ef4a76b2 service nova] Releasing lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:34.918315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] Acquired lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:34.918493 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Refreshing network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:17:34.923450 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.006076 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b26ab63b-8f58-4660-be83-84bf9ca62952 req-7c3c790e-49e4-4aa9-ac8a-38cbb1960be0 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-vif-unplugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:35.006349 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b26ab63b-8f58-4660-be83-84bf9ca62952 req-7c3c790e-49e4-4aa9-ac8a-38cbb1960be0 service nova] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:35.006573 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b26ab63b-8f58-4660-be83-84bf9ca62952 req-7c3c790e-49e4-4aa9-ac8a-38cbb1960be0 service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:35.006756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b26ab63b-8f58-4660-be83-84bf9ca62952 req-7c3c790e-49e4-4aa9-ac8a-38cbb1960be0 service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:35.007295 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b26ab63b-8f58-4660-be83-84bf9ca62952 req-7c3c790e-49e4-4aa9-ac8a-38cbb1960be0 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] No waiting events found dispatching network-vif-unplugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:17:35.007295 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b26ab63b-8f58-4660-be83-84bf9ca62952 req-7c3c790e-49e4-4aa9-ac8a-38cbb1960be0 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-vif-unplugged-167983c1-b75b-4cca-9cfc-4f774644dd96 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:17:35.145272 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.151245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.174703 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Instance destroyed successfully.
May 28 03:17:35.175247 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lazy-loading 'resources' on Instance uuid 1d7d956c-368d-4986-8fa4-18980377f24e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:35.288397 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:35.290627 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938255.2904139, d09b4ea5-5136-4338-9813-8f3b762aa4ab => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:35.290717 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] VM Paused (Lifecycle Event)
May 28 03:17:35.420690 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:35.482620 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:35.482620 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:35.483336 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:35.483466 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:35.483515 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Processing event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:17:35.483634 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:35.483747 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:35.483923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:35.484026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:35.484142 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] No waiting events found dispatching network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:17:35.484684 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a3f1c731-2d1c-4b5a-a6e5-2d7328da6165 req-f1e93064-2467-437d-8622-56eb214e76b2 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received unexpected event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a for instance with vm_state building and task_state spawning.
May 28 03:17:35.484910 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:17:35.487660 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:17:35.491211 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance spawned successfully.
May 28 03:17:35.491511 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:17:35.678440 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:16:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-1689439183',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testinstanceswithcindervolumes-server-1689439183',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDkryvmQI7PQ8tbkZXxV9qoprD6Pj21nE9OedAg5DyBJddw0mSO+zDgsZAwvwyo6sU8Qqa4euAMsfMFN2TKhtd9gqdNAgjJ3Vs9y9+Pgapwtc+FkJwCgs8VpQOZH7gAVqw==',key_name='tempest-TestInstancesWithCinderVolumes-1899106639',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:16:29Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='484e5bbfdebb46c5842b9b94cfa69f81',ramdisk_id='',reservation_id='r-l611yl10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-208839827',owner_user_name='tempest-TestInstancesWithCinderVolumes-208839827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:16:30Z,user_data=None,user_id='612418cc12484e51924169c654bb3718',uuid=1d7d956c-368d-4986-8fa4-18980377f24e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:17:35.678440 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Converting VIF {"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:17:35.678440 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:49:be,bridge_name='br-int',has_traffic_filtering=True,id=167983c1-b75b-4cca-9cfc-4f774644dd96,network=Network(aac22404-980a-4ddc-ab35-bf930d0974d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap167983c1-b7') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:17:35.678736 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:49:be,bridge_name='br-int',has_traffic_filtering=True,id=167983c1-b75b-4cca-9cfc-4f774644dd96,network=Network(aac22404-980a-4ddc-ab35-bf930d0974d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap167983c1-b7') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:17:35.679685 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.679936 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap167983c1-b7, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:35.680851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.682109 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.682783 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.682944 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=282d7ac8-e820-42cc-bb15-2d3b0589d0e5) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:17:35.683341 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:35.684239 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:17:35.686481 np0000001589 nova-compute[98297]: INFO os_vif [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:49:be,bridge_name='br-int',has_traffic_filtering=True,id=167983c1-b75b-4cca-9cfc-4f774644dd96,network=Network(aac22404-980a-4ddc-ab35-bf930d0974d0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap167983c1-b7')
May 28 03:17:35.689988 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:35.691671 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:17:35.692002 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:35.692133 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:35.692695 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:35.693120 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '579b9ef1-4500-4573-8d85-da54e846c2b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:17:35.693326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:17:35.717861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:35.717861 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:35.717861 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:35.717861 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:35.717861 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:35.718179 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsi session list stdout=tcp: [180] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:35.718179 np0000001589 nova-compute[98297]: tcp: [181] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9 (non-flash)
May 28 03:17:35.718179 np0000001589 nova-compute[98297]: tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:35.718179 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:35.718179 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:35.718392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '180'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '181'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '195')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:17:35.718502 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '181')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:35.719640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9', '180')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:17:35.720344 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b6446bce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:17:35.720564 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Removing multipathed devices sdf, sde {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:17:35.720802 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Flush multipath device 330000000d434a514 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:17:35.788740 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:35.792791 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:35.796472 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999748152999928 future=<Future at 0x7e4b781aa030 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:35.797217 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99911542000018 future=<Future at 0x7e4b781aa030 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:35.797343 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99884969599998 future=<Future at 0x7e4b781aa030 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:35.798418 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938255.7973604, d09b4ea5-5136-4338-9813-8f3b762aa4ab => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:35.798573 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] VM Resumed (Lifecycle Event)
May 28 03:17:35.830860 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updated VIF entry in instance network info cache for port 167983c1-b75b-4cca-9cfc-4f774644dd96. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:17:35.831111 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating instance_info_cache with network_info: [{"id": "167983c1-b75b-4cca-9cfc-4f774644dd96", "address": "fa:16:3e:9d:49:be", "network": {"id": "aac22404-980a-4ddc-ab35-bf930d0974d0", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-230456180-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "484e5bbfdebb46c5842b9b94cfa69f81", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap167983c1-b7", "ovs_interfaceid": "167983c1-b75b-4cca-9cfc-4f774644dd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:35.834741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:17:35.881511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:17:35.881657 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:17:35.882417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:17:35.893080 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:17:35.893296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:17:35.904140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:35.941600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 181, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.40.100,3260]
May 28 03:17:35.941600 np0000001589 nova-compute[98297]: Logout of [sid: 181, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.40.100,3260] successful.
May 28 03:17:35.941600 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:35.953816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:35.964752 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:35.991184 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 180, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.50.100,3260]
May 28 03:17:35.991184 np0000001589 nova-compute[98297]: Logout of [sid: 180, target: iqn.2023-03.storpool.com:os--volume-579b9ef1-4500-4573-8d85-da54e846c2b9, portal: 192.168.50.100,3260] successful.
May 28 03:17:35.991184 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:35.996906 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:35.997019 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:35.997269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:35.997453 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:35.997672 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:35.998236 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:17:36.004697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:36.004983 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:36.005100 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] <== disconnect_volume: return (313ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:36.005203 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:17:36.005461 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Deleting instance files /opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e_del
May 28 03:17:36.006069 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Deletion of /opt/stack/data/nova/instances/1d7d956c-368d-4986-8fa4-18980377f24e_del complete
May 28 03:17:36.138015 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:36.138343 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:36.302241 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:36.304630 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:17:36.332998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e71d131a-677b-458c-b08e-07bcc280566c req-f5d28293-46f1-442c-b640-7f4d9340b21b service nova] Releasing lock "refresh_cache-1d7d956c-368d-4986-8fa4-18980377f24e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:36.502711 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Took 9.11 seconds to spawn the instance on the hypervisor.
May 28 03:17:36.502915 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:36.511171 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Took 1.66 seconds to destroy the instance on the hypervisor.
May 28 03:17:36.511794 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:17:36.512045 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:17:36.512132 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:17:36.512340 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:36.569984 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:36.798291 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56c469d3-dfef-456f-8294-d7926e2cb539 req-c4359453-d776-40bd-b3d1-12e89f9daedc service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-vif-deleted-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:36.798948 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-56c469d3-dfef-456f-8294-d7926e2cb539 req-c4359453-d776-40bd-b3d1-12e89f9daedc service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Neutron deleted interface 167983c1-b75b-4cca-9cfc-4f774644dd96; detaching it from the instance and deleting it from the info cache
May 28 03:17:36.800356 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56c469d3-dfef-456f-8294-d7926e2cb539 req-c4359453-d776-40bd-b3d1-12e89f9daedc service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Detach interface failed, port_id=167983c1-b75b-4cca-9cfc-4f774644dd96, reason: Instance 1d7d956c-368d-4986-8fa4-18980377f24e could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:17:36.806939 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:17:37.012708 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Took 16.12 seconds to build instance.
May 28 03:17:37.057872 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ab384de4-f81f-4717-a385-3679ce734dab req-68f431b3-3101-4295-b9a1-02c38197ce63 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-vif-unplugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:37.058409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ab384de4-f81f-4717-a385-3679ce734dab req-68f431b3-3101-4295-b9a1-02c38197ce63 service nova] Acquiring lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:37.058409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ab384de4-f81f-4717-a385-3679ce734dab req-68f431b3-3101-4295-b9a1-02c38197ce63 service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:37.058409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ab384de4-f81f-4717-a385-3679ce734dab req-68f431b3-3101-4295-b9a1-02c38197ce63 service nova] Lock "1d7d956c-368d-4986-8fa4-18980377f24e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:37.058506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ab384de4-f81f-4717-a385-3679ce734dab req-68f431b3-3101-4295-b9a1-02c38197ce63 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] No waiting events found dispatching network-vif-unplugged-167983c1-b75b-4cca-9cfc-4f774644dd96 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:17:37.058598 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ab384de4-f81f-4717-a385-3679ce734dab req-68f431b3-3101-4295-b9a1-02c38197ce63 service nova] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Received event network-vif-unplugged-167983c1-b75b-4cca-9cfc-4f774644dd96 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:17:37.247954 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:37.517255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-90becc7a-7e5b-4afb-95c0-606160419c31 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.626s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:37.749871 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Took 1.24 seconds to deallocate network for instance.
May 28 03:17:38.164802 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:38.291168 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:17:38.795829 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:38.796272 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:38.865802 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-changed-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:17:38.866088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Refreshing instance network info cache due to event network-changed-5de817f8-187b-486c-b032-d31544f5fc0a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:17:38.866237 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] Acquiring lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:17:38.866316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] Acquired lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:17:38.866417 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Refreshing network info cache for port 5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:17:38.966688 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:17:38.966900 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:17:39.368097 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:39.469540 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:17:39.621040 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:17:39.739182 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Updated VIF entry in instance network info cache for port 5de817f8-187b-486c-b032-d31544f5fc0a. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:17:39.739442 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Updating instance_info_cache with network_info: [{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:17:39.976370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.180s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:40.018145 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Deleted allocations for instance 1d7d956c-368d-4986-8fa4-18980377f24e
May 28 03:17:40.137788 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:40.243398 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd598fd1-b334-423e-b600-64794dc800c3 req-a7fb24f3-d662-49b3-a2de-f71c7d8faccf service nova] Releasing lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:17:40.641602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:40.641781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:40.641908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:40.642042 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:17:40.683325 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:41.024940 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-43ce0f43-4519-403b-97af-1b9119d71ef5 tempest-TestInstancesWithCinderVolumes-208839827 tempest-TestInstancesWithCinderVolumes-208839827-project-member] Lock "1d7d956c-368d-4986-8fa4-18980377f24e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.680s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:41.659839 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:17:41.661072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:41.746587 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:41.747110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:41.833904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:41.838345 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:17:41.840055 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:41.886916 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:17:41.887283 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13414MB free_disk=72.72447967529297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:17:41.887459 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:41.887682 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:42.939012 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 275118e5-8f9a-4cc6-abab-e7ff17154aee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:17:42.939484 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance d09b4ea5-5136-4338-9813-8f3b762aa4ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:17:42.939484 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:17:42.939484 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:17:41 up 45 min,  2 users,  load average: 3.15, 5.35, 4.71\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_8a6a1526383440ceb5b3f69f7492d966': '1', 'io_workload': '0', 'num_proj_26deda1c00a84355951239b1a62997e8': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:17:43.052513 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:17:43.052707 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:17:43.164495 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:43.555120 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:17:44.061112 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:17:44.061563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.174s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:44.062325 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:44.777190 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:45.684103 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:46.061643 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:46.061882 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:46.062056 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:46.062356 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:17:46.062415 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.08 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:46.352735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:47.138319 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:47.138703 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:48.133886 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:48.134176 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:48.165886 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:49.137819 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:49.570909 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:49.639947 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:49.745487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:49.745609 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:50.248807 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'flavor' on Instance uuid 275118e5-8f9a-4cc6-abab-e7ff17154aee {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:50.635719 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:50.636368 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:50.685874 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:50.752141 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Ignoring supplied device name: /dev/vdb
May 28 03:17:50.796593 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00034626299975570873 future=<Future at 0x7e4b781aa030 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:50.796980 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:17:50.797368 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Emitting event <LifecycleEvent: 1779938255.796128, 1d7d956c-368d-4986-8fa4-18980377f24e => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:17:50.797516 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] VM Stopped (Lifecycle Event)
May 28 03:17:51.090397 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:51.138781 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:51.138781 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98297) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 03:17:51.254973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:17:51.300041 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: 1d7d956c-368d-4986-8fa4-18980377f24e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:17:51.641152 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:51.775644 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:52.421502 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:52.421688 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:52.421898 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Attaching volume f895ae08-c318-4ef5-978f-622bb5ab4b26 to /dev/vdb
May 28 03:17:52.456341 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:52.467804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:17:52.488434 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:17:52.533894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:17:52.534211 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:17:52.542446 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:17:52.543479 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feac:6278', 'fe80::68f8:b7ff:fe71:d00c', 'fe80::fc16:3eff:fedc:19e9', 'fe80::f861:80ff:fe4e:b461'] 
May 28 03:17:52.543653 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:17:52.543835 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:17:52.544125 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:52.544436 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Updating existing volume attachment record: 7a923995-b92f-4f21-a3b0-18e45e7f39ee {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:17:52.641238 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:52.641687 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:53.101630 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:17:53.102422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:17:53.102422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:53.102824 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:53.103084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:17:53.115177 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:53.115892 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:17:53.116480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:53.116818 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:17:53.117171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:17:53.117399 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:17:53.128617 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:17:53.128617 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:53.129594 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:17:53.129594 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:53.140085 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26] added
May 28 03:17:53.140085 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:17:53.140085 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:53.140085 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:53.140085 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:53.140085 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:53.140085 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:53.140338 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:17:53.141218 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0237(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:17:53.141411 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:17:53.142698 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26] added
May 28 03:17:53.142698 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:17:53.142698 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:53.142698 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:53.142698 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:17:53.142698 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:17:53.142698 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:53.142834 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:17:53.142998 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:17:53.143164 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:17:53.167879 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:53.341425 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:54.141815 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:17:54.143631 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:17:54.152739 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:17:54.152739 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:17:54.157990 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:17:54.157990 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.163534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.168833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.175072 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.175072 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.175072 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:54.175072 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.175072 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.175072 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:54.181276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.181276 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.181276 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:54.181765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.181765 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.181765 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:54.201444 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.40.100,3260]
May 28 03:17:54.201444 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.40.100,3260] successful.
May 28 03:17:54.201444 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.213318 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.223704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.50.100,3260]
May 28 03:17:54.223704 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.50.100,3260] successful.
May 28 03:17:54.223704 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.228287 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:54.228784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.112s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:54.228784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:17:54.229142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] HCTL ('7', '-', '-', 0) found on session 196 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:17:54.229239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:17:54.234738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:17:54.243146 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching for a device in session 196 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:54.243146 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:17:54.247050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.247050 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.247050 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.247050 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.247050 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:17:54.247246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.247246 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:17:54.247246 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.247246 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:17:54.247246 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:17:54.247405 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:54.247497 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:17:54.247979 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] HCTL ('8', '-', '-', 0) found on session 197 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:17:54.248074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:17:54.260634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Searching for a device in session 197 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:17:54.260634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:17:55.116987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:17:55.137909 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:17:55.137999 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 03:17:55.242921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:55.640454 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] There are 0 instances to clean {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 03:17:55.640719 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 31.10 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:17:55.687787 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:56.132143 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Found WWN 33000000053cf99ed for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:17:56.132426 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:17:56.132575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '33000000053cf99ed', 'path': '/dev/dm-0', 'multipath_id': '33000000053cf99ed'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:17:56.132696 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000053cf99ed', 'path': '/dev/dm-0', 'multipath_id': '33000000053cf99ed'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:17:56.135305 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'flavor' on Instance uuid 275118e5-8f9a-4cc6-abab-e7ff17154aee {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:17:56.638340 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Attempting to attach volume f895ae08-c318-4ef5-978f-622bb5ab4b26 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:17:56.639916 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:17:56.639916 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:17:56.639916 np0000001589 nova-compute[98297]:   <alias name="ua-f895ae08-c318-4ef5-978f-622bb5ab4b26"/>
May 28 03:17:56.639916 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:17:56.639916 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:17:56.639916 np0000001589 nova-compute[98297]:   <serial>f895ae08-c318-4ef5-978f-622bb5ab4b26</serial>
May 28 03:17:56.639916 np0000001589 nova-compute[98297]: </disk>
May 28 03:17:56.639916 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:17:57.905073 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:58.087387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:58.087599 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:58.169458 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:17:58.281833 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:58.281959 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:58.282075 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:17:58.282217 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No VIF found with MAC fa:16:3e:ac:62:78, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:17:58.589438 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:17:59.133305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:17:59.133628 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:17:59.136719 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:17:59.136853 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Claim successful on node np0000001589
May 28 03:17:59.823390 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-01abd1ed-61e8-49e0-90a7-40f8c21f6d7b tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.402s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:00.297343 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:18:00.297808 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:18:00.688515 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:00.799917 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:18:01.306515 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:01.306891 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:18:01.811885 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:18:01.812845 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:18:01.812845 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:01.812845 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:01.874454 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc6820ff3bfd4e90a108c237bcfb235d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b78a160e3c24b99b0760e4c18e688e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:18:02.263865 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Successfully created port: 5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:18:02.315756 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:18:02.733765 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Successfully updated port: 5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:18:02.784556 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:02.784755 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing instance network info cache due to event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:18:02.784838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] Acquiring lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:02.784935 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] Acquired lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:02.785039 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:18:02.818935 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:18:03.169974 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:03.235466 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:03.287508 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:03.357958 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:18:03.482788 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:03.829795 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:18:03.830698 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:18:03.830938 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Creating image(s)
May 28 03:18:03.831422 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:03.831591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:03.832040 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:03.832364 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:03.832921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:03.984548 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a53ac34d-097b-42ab-9771-225e62d7b42d req-70d1d7e7-ff3f-4617-8dc6-e329028f295b service nova] Releasing lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:03.984888 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquired lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:03.985078 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:18:04.269078 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:18:04.271490 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:18:04.271838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:04.464943 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.part --force-share --output=json" returned: 0 in 0.193s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:04.465480 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] 1cc944cd-03da-4f59-8021-93beb7b72ccb was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:18:04.466185 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:18:04.466477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.part /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:04.572432 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:18:04.645123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.part /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.converted" returned: 0 in 0.179s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:04.650106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:04.725794 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:04.743975 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8.converted --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:04.744698 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.912s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:04.745104 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:18:04.747973 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:18:04.749032 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:04.837607 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:04.838114 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:04.838618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:04.839102 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:18:04.842398 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:18:04.843429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:04.867055 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:04.955412 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json" returned: 0 in 0.112s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:04.955867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8,backing_fmt=raw /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:05.014475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8,backing_fmt=raw /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk 1073741824" returned: 0 in 0.058s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:05.014893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:05.015196 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:05.103768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:05.104181 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:18:05.104438 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:05.193085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:05.193463 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Cannot resize image /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:18:05.193850 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:18:05.194003 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Ensure instance console log exists: /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:18:05.194269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:05.194489 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:05.194610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:05.372020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Releasing lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:05.372485 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance network_info: |[{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:18:05.374779 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Start _get_guest_xml network_info=[{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T03:17:56Z,direct_url=<?>,disk_format='qcow2',id=1cc944cd-03da-4f59-8021-93beb7b72ccb,min_disk=0,min_ram=0,name='tempest-scenario-img--123797644',owner='6b78a160e3c24b99b0760e4c18e688e3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T03:17:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': '1cc944cd-03da-4f59-8021-93beb7b72ccb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:18:05.378883 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:18:05.380242 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1cc944cd-03da-4f59-8021-93beb7b72ccb', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1726996886', uuid='00cd655c-7eb1-4dd3-b320-fe38811c1834'), owner=OwnerMeta(userid='bc6820ff3bfd4e90a108c237bcfb235d', username='tempest-TestMinimumBasicScenario-62402083-project-member', projectid='6b78a160e3c24b99b0760e4c18e688e3', projectname='tempest-TestMinimumBasicScenario-62402083'), image=ImageMeta(id='1cc944cd-03da-4f59-8021-93beb7b72ccb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938285.3798823) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:18:05.381204 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:18:05.381524 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:18:05.382328 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:18:05.382472 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:18:05.383373 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:18:05.383710 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T03:17:56Z,direct_url=<?>,disk_format='qcow2',id=1cc944cd-03da-4f59-8021-93beb7b72ccb,min_disk=0,min_ram=0,name='tempest-scenario-img--123797644',owner='6b78a160e3c24b99b0760e4c18e688e3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T03:17:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:18:05.383812 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:18:05.383876 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:18:05.383982 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:18:05.384064 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:18:05.384144 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:18:05.384331 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:18:05.384424 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:18:05.384527 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:18:05.384633 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:18:05.384747 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:18:05.394292 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1726996886',display_name='tempest-TestMinimumBasicScenario-server-1726996886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-1726996886',id=69,image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5tzzJCLbVanD3idP7BCCwkQ9/vm3gdJ0H3M5nmiW7eDnPjDlVbg5fNTX2qoIMOakmQZE8hGh1e6DUqjgzkne66VhceFzSw/gyLKfS4BvzalRpzic5f3Ob35pmMk9hpg==',key_name='tempest-TestMinimumBasicScenario-1862345335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-xo6klmpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:18:03Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=00cd655c-7eb1-4dd3-b320-fe38811c1834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:18:05.394540 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:05.395024 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:05.395538 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'pci_devices' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:05.688935 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.898194 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] End _get_guest_xml xml=<domain type="qemu">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <uuid>00cd655c-7eb1-4dd3-b320-fe38811c1834</uuid>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <name>instance-00000045</name>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestMinimumBasicScenario-server-1726996886</nova:name>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:18:05</nova:creationTime>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:image uuid="1cc944cd-03da-4f59-8021-93beb7b72ccb">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:properties/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:user uuid="bc6820ff3bfd4e90a108c237bcfb235d">tempest-TestMinimumBasicScenario-62402083-project-member</nova:user>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:project uuid="6b78a160e3c24b99b0760e4c18e688e3">tempest-TestMinimumBasicScenario-62402083</nova:project>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="1cc944cd-03da-4f59-8021-93beb7b72ccb"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         <nova:port uuid="5708b542-7cfc-4ac9-8c9d-2893fea4189e">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <system>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <entry name="serial">00cd655c-7eb1-4dd3-b320-fe38811c1834</entry>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <entry name="uuid">00cd655c-7eb1-4dd3-b320-fe38811c1834</entry>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </system>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <os>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   </os>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <features>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   </features>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   <devices>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </disk>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.config"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </disk>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:b5:e5:d4"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <target dev="tap5708b542-7c"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </interface>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/console.log" append="off"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </serial>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <video>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </video>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </rng>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:   </devices>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]: </domain>
May 28 03:18:05.898194 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Preparing to wait for external event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1726996886',display_name='tempest-TestMinimumBasicScenario-server-1726996886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-1726996886',id=69,image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5tzzJCLbVanD3idP7BCCwkQ9/vm3gdJ0H3M5nmiW7eDnPjDlVbg5fNTX2qoIMOakmQZE8hGh1e6DUqjgzkne66VhceFzSw/gyLKfS4BvzalRpzic5f3Ob35pmMk9hpg==',key_name='tempest-TestMinimumBasicScenario-1862345335',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-xo6klmpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:18:03Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=00cd655c-7eb1-4dd3-b320-fe38811c1834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.902530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34643011-85ae-5e38-9530-bff56e9fbb24', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:05.903096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.904148 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:05.904148 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.905942 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.906077 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5708b542-7c, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:05.906446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5708b542-7c, col_values=(('qos', UUID('efff65cf-049e-441a-9ba0-fad6da990d3c')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:05.906606 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5708b542-7c, col_values=(('external_ids', {'iface-id': '5708b542-7cfc-4ac9-8c9d-2893fea4189e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:e5:d4', 'vm-uuid': '00cd655c-7eb1-4dd3-b320-fe38811c1834'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:05.907440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.909234 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:05.912387 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:05.913034 np0000001589 nova-compute[98297]: INFO os_vif [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c')
May 28 03:18:07.426768 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:07.427198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:07.427198 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No VIF found with MAC fa:16:3e:b5:e5:d4, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:18:07.427517 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Using config drive
May 28 03:18:07.932443 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:08.050064 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Creating config drive at /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.config
May 28 03:18:08.053365 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyw8ll0xc {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:08.111081 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpyw8ll0xc" returned: 0 in 0.057s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:08.184782 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.478643 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.500055 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.501748 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.597454 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.651462 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8dbdb3d9-4632-40f0-909a-ae85ad737317 req-418f5b81-8f19-4a54-a12d-2367cb1a5a3b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:08.651750 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8dbdb3d9-4632-40f0-909a-ae85ad737317 req-418f5b81-8f19-4a54-a12d-2367cb1a5a3b service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:08.653014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8dbdb3d9-4632-40f0-909a-ae85ad737317 req-418f5b81-8f19-4a54-a12d-2367cb1a5a3b service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:08.653014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8dbdb3d9-4632-40f0-909a-ae85ad737317 req-418f5b81-8f19-4a54-a12d-2367cb1a5a3b service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:08.653014 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8dbdb3d9-4632-40f0-909a-ae85ad737317 req-418f5b81-8f19-4a54-a12d-2367cb1a5a3b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Processing event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:18:08.809655 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.811266 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.813418 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:08.832656 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:09.210554 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938289.2101452, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:09.211136 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:18:09.211357 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] VM Started (Lifecycle Event)
May 28 03:18:09.213377 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:18:09.216161 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance spawned successfully.
May 28 03:18:09.216524 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:18:09.714715 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:09.716693 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:18:09.724389 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:18:09.724530 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:18:09.725255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:18:09.725255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:18:09.725255 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:18:09.725485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:18:10.220216 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:18:10.220462 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938290.2202747, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:10.220918 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] VM Paused (Lifecycle Event)
May 28 03:18:10.233592 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Took 6.40 seconds to spawn the instance on the hypervisor.
May 28 03:18:10.233797 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:10.720786 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3de660c4-1110-4f34-b078-7c4fae6efb95 req-e6701050-bc5f-46f8-9f1e-1e2655da0222 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:10.721298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3de660c4-1110-4f34-b078-7c4fae6efb95 req-e6701050-bc5f-46f8-9f1e-1e2655da0222 service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:10.721432 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3de660c4-1110-4f34-b078-7c4fae6efb95 req-e6701050-bc5f-46f8-9f1e-1e2655da0222 service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:10.721600 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3de660c4-1110-4f34-b078-7c4fae6efb95 req-e6701050-bc5f-46f8-9f1e-1e2655da0222 service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:10.721708 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3de660c4-1110-4f34-b078-7c4fae6efb95 req-e6701050-bc5f-46f8-9f1e-1e2655da0222 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] No waiting events found dispatching network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:10.721798 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-3de660c4-1110-4f34-b078-7c4fae6efb95 req-e6701050-bc5f-46f8-9f1e-1e2655da0222 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received unexpected event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e for instance with vm_state active and task_state None.
May 28 03:18:10.722412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:10.724427 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938290.7242727, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:10.724527 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] VM Resumed (Lifecycle Event)
May 28 03:18:10.745636 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Took 11.65 seconds to build instance.
May 28 03:18:10.907853 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:11.226617 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:11.228327 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:18:11.250445 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0716e376-89f2-4b44-942d-8593de883f5f tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.163s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:13.197365 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:13.277244 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:13.277408 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:13.780859 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'flavor' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:14.085443 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:14.085734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:14.085853 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:14.088415 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98297) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 28 03:18:14.088859 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'flavor' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:14.784984 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:15.110600 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:15.114189 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:15.124275 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:15.134532 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:15.148012 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:15.152287 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:15.224835 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-37dbd961-39ad-447e-9434-51b0e1f83da1 req-b26780ac-92ce-4e67-b161-5467903edea1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:15.224995 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-37dbd961-39ad-447e-9434-51b0e1f83da1 req-b26780ac-92ce-4e67-b161-5467903edea1 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:15.225338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-37dbd961-39ad-447e-9434-51b0e1f83da1 req-b26780ac-92ce-4e67-b161-5467903edea1 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:15.225448 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-37dbd961-39ad-447e-9434-51b0e1f83da1 req-b26780ac-92ce-4e67-b161-5467903edea1 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:15.225656 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-37dbd961-39ad-447e-9434-51b0e1f83da1 req-b26780ac-92ce-4e67-b161-5467903edea1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] No waiting events found dispatching network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:15.225764 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-37dbd961-39ad-447e-9434-51b0e1f83da1 req-b26780ac-92ce-4e67-b161-5467903edea1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received unexpected event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a for instance with vm_state active and task_state powering-off.
May 28 03:18:15.416295 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999680417000036 future=<Future at 0x7e4b407f4740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:15.416492 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99820371800024 future=<Future at 0x7e4b407f4740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:15.416668 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99800148300028 future=<Future at 0x7e4b407f4740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:15.417387 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance destroyed successfully.
May 28 03:18:15.417863 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'numa_topology' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:15.863314 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:15.863314 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:15.863314 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Attaching volume 45bef9e2-d456-47bc-9c64-2b5eea1c9b7e to /dev/vdb
May 28 03:18:15.899201 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:15.908679 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:15.911826 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:18:15.919757 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Object Instance<d09b4ea5-5136-4338-9813-8f3b762aa4ab> lazy-loaded attributes: flavor,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:15.920029 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:15.932278 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:15.978654 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:18:15.979413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:18:15.991243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:18:15.991243 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feac:6278', 'fe80::68f8:b7ff:fe71:d00c', 'fe80::fc16:3eff:feb5:e5d4', 'fe80::d2:e0ff:fef0:5ce3'] 
May 28 03:18:15.991243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:18:15.991243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:18:15.991243 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:15.991243 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating existing volume attachment record: 44c9d702-9320-41f3-847a-4e0ff4707363 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:18:16.433530 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d03b031-27ed-4eda-8833-956f5823fc7d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.348s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:16.533628 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:18:16.533628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:16.533628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:16.533628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:16.533628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:18:16.547717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:16.548574 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:16.549122 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:16.549387 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:16.549706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:16.549949 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:16.560416 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:16.560416 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:16.565200 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:16.565200 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:16.571272 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e] added
May 28 03:18:16.571272 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:16.571272 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:16.571272 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:16.571272 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:16.571272 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:16.571272 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:16.571490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:16.571721 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:16.571899 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:16.576973 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e] added
May 28 03:18:16.576973 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:16.576973 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:16.576973 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:16.576973 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:16.576973 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:16.576973 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:16.577135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:16.577341 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0274(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:16.577504 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:17.278787 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56bca0b1-d3c7-45f8-b5f0-516d5ca5294e req-de099e80-24be-48a1-8558-8ac9f7eecbe1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:17.279222 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-56bca0b1-d3c7-45f8-b5f0-516d5ca5294e req-de099e80-24be-48a1-8558-8ac9f7eecbe1 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:17.279292 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-56bca0b1-d3c7-45f8-b5f0-516d5ca5294e req-de099e80-24be-48a1-8558-8ac9f7eecbe1 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:17.279455 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-56bca0b1-d3c7-45f8-b5f0-516d5ca5294e req-de099e80-24be-48a1-8558-8ac9f7eecbe1 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:17.279705 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56bca0b1-d3c7-45f8-b5f0-516d5ca5294e req-de099e80-24be-48a1-8558-8ac9f7eecbe1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] No waiting events found dispatching network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:17.279840 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-56bca0b1-d3c7-45f8-b5f0-516d5ca5294e req-de099e80-24be-48a1-8558-8ac9f7eecbe1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received unexpected event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a for instance with vm_state stopped and task_state None.
May 28 03:18:17.572477 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:17.577868 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:17.584948 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:17.584948 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:17.593789 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:17.593789 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.601660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.608094 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.616018 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.616018 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.616018 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.616018 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.616018 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:17.616183 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.616183 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.616183 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.616183 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.616183 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:17.621312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.621312 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.621312 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.621312 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.621312 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:17.621586 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.621586 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.621586 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.621586 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.621586 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:17.646255 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260]
May 28 03:18:17.646255 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260] successful.
May 28 03:18:17.646255 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.655470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260]
May 28 03:18:17.655470 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260] successful.
May 28 03:18:17.655470 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.659819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.666404 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:17.674276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.674276 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.674276 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.674276 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.674276 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.674276 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.674276 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:17.674635 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.674635 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.674635 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.674635 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.674635 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.674635 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.674635 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:17.674853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:17.674853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:17.675718 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] HCTL ('10', '-', '-', 0) found on session 199 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:17.675847 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:17.681589 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.681589 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.681589 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.681589 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.681589 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.681589 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.681589 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:17.681949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.681949 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:17.681949 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.681949 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:17.681949 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.681949 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:17.681949 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:17.681949 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:17.682261 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:17.682613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] HCTL ('11', '-', '-', 0) found on session 200 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:17.682707 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:17.694264 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching for a device in session 199 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:17.694535 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:17.697917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching for a device in session 200 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:17.698066 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:17.816642 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'flavor' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:18.198163 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:18.321135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:18.321712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:18.321712 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:18:18.321712 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'info_cache' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:18.549753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:18:18.824628 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Object Instance<d09b4ea5-5136-4338-9813-8f3b762aa4ab> lazy-loaded attributes: flavor,info_cache {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:19.326461 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:19.563780 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Found WWN 330000000a8733c60 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:18:19.563990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:19.564161 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000a8733c60', 'path': '/dev/dm-1', 'multipath_id': '330000000a8733c60'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:19.564285 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8733c60', 'path': '/dev/dm-1', 'multipath_id': '330000000a8733c60'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:18:19.566784 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'flavor' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:19.586593 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:19.719100 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Updating instance_info_cache with network_info: [{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:20.070900 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Attempting to attach volume 45bef9e2-d456-47bc-9c64-2b5eea1c9b7e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:18:20.072218 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:18:20.072218 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:18:20.072218 np0000001589 nova-compute[98297]:   <alias name="ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e"/>
May 28 03:18:20.072218 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:18:20.072218 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:18:20.072218 np0000001589 nova-compute[98297]:   <serial>45bef9e2-d456-47bc-9c64-2b5eea1c9b7e</serial>
May 28 03:18:20.072218 np0000001589 nova-compute[98297]: </disk>
May 28 03:18:20.072218 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:18:20.221815 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-d09b4ea5-5136-4338-9813-8f3b762aa4ab" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:20.910082 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:21.233955 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance destroyed successfully.
May 28 03:18:21.234369 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'numa_topology' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:21.705207 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:21.705369 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:21.705460 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:21.705530 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No VIF found with MAC fa:16:3e:b5:e5:d4, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:18:21.736088 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Object Instance<d09b4ea5-5136-4338-9813-8f3b762aa4ab> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:21.736494 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:22.238101 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Object Instance<d09b4ea5-5136-4338-9813-8f3b762aa4ab> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:22.238976 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108984611',display_name='tempest-TestVolumeBootPattern-server-108984611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-108984611',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs4Z0IQvLfQNZ3quTlHVCvUfLAQyCiUjgW5GN2+o0QNyaYl9Lzorh8zHyCN9LrouVsCbda/rJk8A/lm/Gn97ZPnofjIIj0K7sHKscjHgBjyX9n++BMDHRHdxsqZ7hl4vQ==',key_name='tempest-keypair-882609080',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:17:36Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-04jjv0qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=d09b4ea5-5136-4338-9813-8f3b762aa4ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:18:22.239202 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:22.239797 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:22.240026 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:18:22.241260 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:22.241518 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5de817f8-18, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:22.242564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:22.244147 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:22.244147 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:22.247823 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:22.247967 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcd5c712-eaba-440c-9469-1a350efb998c) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:22.249186 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:22.249186 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:22.249186 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:22.252351 np0000001589 nova-compute[98297]: INFO os_vif [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18')
May 28 03:18:22.255598 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:18:22.256982 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:22.258269 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:22.260215 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:22.261620 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:18:22.262278 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:18:22.297525 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:22.297525 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:22.297525 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:22.297525 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:22.297525 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:22.297525 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:22.297525 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:22.297525 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:22.300641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [194] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:22.300641 np0000001589 nova-compute[98297]: tcp: [195] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:22.300641 np0000001589 nova-compute[98297]: tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:22.300641 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:22.300641 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:22.300641 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:22.300641 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:22.300641 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:22.303181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '194'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '195'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af', '201')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:18:22.303669 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '194')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:22.311796 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '195')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:22.323092 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4051d3a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'): ({'sdg'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:18:22.324575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdd, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:18:22.327308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 3300000007817086c {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:18:22.386370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:22.439660 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:22.503406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:18:22.503750 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:18:22.505274 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:18:22.516580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:18:22.516822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:18:22.528838 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:22.562326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260]
May 28 03:18:22.562326 np0000001589 nova-compute[98297]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260] successful.
May 28 03:18:22.562326 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:22.579729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:22.590855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:22.616383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260]
May 28 03:18:22.616383 np0000001589 nova-compute[98297]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260] successful.
May 28 03:18:22.616383 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:22.631680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:22.631904 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:22.632042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (375ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:22.632155 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:18:22.635956 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Start _get_guest_xml network_info=[{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '0fe89183-5ecc-4363-a118-4c2556779208', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': 'd09b4ea5-5136-4338-9813-8f3b762aa4ab', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'serial': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:18:22.637989 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:18:22.639074 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-108984611', uuid='d09b4ea5-5136-4338-9813-8f3b762aa4ab'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938302.6387947) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:18:22.640348 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:18:22.640693 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:18:22.641770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:18:22.641963 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:18:22.643085 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:18:22.643591 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:18:22.643732 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:18:22.643862 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:18:22.644078 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:18:22.644301 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:18:22.644411 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:18:22.644598 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:18:22.644710 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:18:22.644831 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:18:22.644948 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:18:22.645272 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:18:22.645512 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'vcpu_model' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:23.148002 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Object Instance<d09b4ea5-5136-4338-9813-8f3b762aa4ab> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:23.156628 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:23.256872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c153675a-b672-4bea-8ecc-fcddead5086a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.396s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:23.258240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.config --force-share --output=json" returned: 0 in 0.101s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:23.258944 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "/opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:23.259238 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "/opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:23.259898 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "/opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:23.260484 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:18:23.261131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:23.261373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:23.261739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:23.262138 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:18:23.274351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:23.274534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:23.274966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:23.275220 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:23.275623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:23.275793 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:23.289654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:23.289654 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:23.292288 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:23.292288 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:23.318279 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2] added
May 28 03:18:23.318279 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:23.318279 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:23.318279 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:23.318279 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:23.318279 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:23.318279 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:23.318574 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:23.318826 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0429(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:23.319126 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:23.322532 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2] added
May 28 03:18:23.322532 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:23.322532 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:23.322532 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:23.322532 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:23.322532 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:23.322532 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:23.322741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:23.322848 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0476(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:23.322930 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:24.319529 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:24.323266 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:24.333247 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:24.333247 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:24.341550 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:24.341550 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.348539 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.354816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.363679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.363679 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.363679 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.363679 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.363679 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.363679 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:24.364000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.364000 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.364000 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.364000 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.364000 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.364000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:24.374457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.374457 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.374457 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.374457 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.374457 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.374457 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:24.374716 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.374716 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.374716 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.374716 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.374716 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.374716 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:24.404581 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260]
May 28 03:18:24.404581 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260] successful.
May 28 03:18:24.404581 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.417969 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.426417 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260]
May 28 03:18:24.426417 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260] successful.
May 28 03:18:24.426417 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.435210 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.435210 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.435210 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.435210 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.435210 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.435210 np0000001589 nova-compute[98297]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.435210 np0000001589 nova-compute[98297]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.435210 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:24.435666 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.435666 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.435666 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.435666 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.435666 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.435666 np0000001589 nova-compute[98297]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.435666 np0000001589 nova-compute[98297]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.435666 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:24.435990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:24.435990 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:24.441548 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('9', '-', '-', 0) found on session 202 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:24.441687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:24.458769 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 202 and hctl ['9', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:24.464499 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:24.489124 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.489124 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.489124 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.489124 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.489124 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.489124 np0000001589 nova-compute[98297]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.489124 np0000001589 nova-compute[98297]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.489124 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:24.489332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.489332 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:24.489332 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.489332 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:24.489332 np0000001589 nova-compute[98297]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd97e0a-78bc-4920-9e13-e536f4c853af (non-flash)
May 28 03:18:24.489332 np0000001589 nova-compute[98297]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.489332 np0000001589 nova-compute[98297]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:24.489332 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:24.489625 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:24.489753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:24.490694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('12', '-', '-', 0) found on session 203 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:24.490813 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:24.515326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 203 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:24.517304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:25.459166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 202 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:25.463057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:25.696114 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:25.696284 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing instance network info cache due to event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:18:25.696450 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] Acquiring lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:25.696578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] Acquired lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:25.696700 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:18:26.199420 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:26.292842 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 3300000007817086c for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:18:26.293128 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:26.293314 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '3300000007817086c', 'path': '/dev/dm-2', 'multipath_id': '3300000007817086c'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:26.293435 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007817086c', 'path': '/dev/dm-2', 'multipath_id': '3300000007817086c'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:18:26.471765 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:26.585581 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updated VIF entry in instance network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:18:26.585810 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:26.743862 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:26.803600 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108984611',display_name='tempest-TestVolumeBootPattern-server-108984611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-108984611',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs4Z0IQvLfQNZ3quTlHVCvUfLAQyCiUjgW5GN2+o0QNyaYl9Lzorh8zHyCN9LrouVsCbda/rJk8A/lm/Gn97ZPnofjIIj0K7sHKscjHgBjyX9n++BMDHRHdxsqZ7hl4vQ==',key_name='tempest-keypair-882609080',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:17:36Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-04jjv0qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=d09b4ea5-5136-4338-9813-8f3b762aa4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:18:26.803848 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:26.804480 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:26.805114 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:26.997485 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:26.998173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing instance network info cache due to event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:18:26.998390 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] Acquiring lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:27.087390 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fed92a3e-4bb2-4d80-97b9-cb02fdbfa9bb req-a8e0e1e0-6aee-49e8-90fe-ced257758086 service nova] Releasing lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:27.087816 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] Acquired lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:27.087998 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:18:27.248718 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] While synchronizing instance power states, found 3 instances in the database and 2 instances on the hypervisor.
May 28 03:18:27.248821 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid 275118e5-8f9a-4cc6-abab-e7ff17154aee {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:18:27.249010 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:18:27.249148 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:18:27.249596 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:27.249767 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:27.250037 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.39 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:18:27.250476 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:27.251050 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:27.251424 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:27.251546 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.254024 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:27.254656 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 03:18:27.254656 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.004s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:27.308376 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Object Instance<d09b4ea5-5136-4338-9813-8f3b762aa4ab> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:27.309362 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] End _get_guest_xml xml=<domain type="qemu">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <uuid>d09b4ea5-5136-4338-9813-8f3b762aa4ab</uuid>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <name>instance-00000044</name>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-108984611</nova:name>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:18:22</nova:creationTime>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         <nova:port uuid="5de817f8-187b-486c-b032-d31544f5fc0a">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <system>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <entry name="serial">d09b4ea5-5136-4338-9813-8f3b762aa4ab</entry>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <entry name="uuid">d09b4ea5-5136-4338-9813-8f3b762aa4ab</entry>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </system>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <os>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   </os>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <features>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   </features>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   <devices>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/disk.config"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </disk>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <alias name="ua-b4156ff4-0ac0-4189-8e61-4da7305c4ce2"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-2"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <serial>b4156ff4-0ac0-4189-8e61-4da7305c4ce2</serial>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </disk>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:dc:19:e9"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <target dev="tap5de817f8-18"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </interface>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab/console.log" append="off"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </serial>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <video>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </video>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </rng>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:   </devices>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]: </domain>
May 28 03:18:27.309362 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:18:27.311692 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] skipping disk /dev/dm-2 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:18:27.311692 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108984611',display_name='tempest-TestVolumeBootPattern-server-108984611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-108984611',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs4Z0IQvLfQNZ3quTlHVCvUfLAQyCiUjgW5GN2+o0QNyaYl9Lzorh8zHyCN9LrouVsCbda/rJk8A/lm/Gn97ZPnofjIIj0K7sHKscjHgBjyX9n++BMDHRHdxsqZ7hl4vQ==',key_name='tempest-keypair-882609080',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:17:36Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-04jjv0qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=d09b4ea5-5136-4338-9813-8f3b762aa4ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:18:27.311692 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:27.311692 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:27.311692 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:18:27.311692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.311977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:27.312104 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:18:27.312613 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.312782 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b3bfbd-e0bf-5f7a-9ca7-c44ee17d5295', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:27.313441 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.314057 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:27.314176 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.315587 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.315692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5de817f8-18, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:27.315970 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5de817f8-18, col_values=(('qos', UUID('6c7dd16d-814c-4cb3-a6b3-1bb899a6e8b0')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:27.316124 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5de817f8-18, col_values=(('external_ids', {'iface-id': '5de817f8-187b-486c-b032-d31544f5fc0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:19:e9', 'vm-uuid': 'd09b4ea5-5136-4338-9813-8f3b762aa4ab'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:27.316735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.317729 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:27.322669 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.323368 np0000001589 nova-compute[98297]: INFO os_vif [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18')
May 28 03:18:27.590281 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:27.697528 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.717309 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.755133 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.505s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:27.758756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.507s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:27.805925 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:27.855165 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b415704d-7a80-4342-b17d-10241ca554d3 req-41e02ffd-cfb2-4b5c-bba3-edac206738c1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:27.855394 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b415704d-7a80-4342-b17d-10241ca554d3 req-41e02ffd-cfb2-4b5c-bba3-edac206738c1 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:27.855636 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b415704d-7a80-4342-b17d-10241ca554d3 req-41e02ffd-cfb2-4b5c-bba3-edac206738c1 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:27.855792 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b415704d-7a80-4342-b17d-10241ca554d3 req-41e02ffd-cfb2-4b5c-bba3-edac206738c1 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:27.856235 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b415704d-7a80-4342-b17d-10241ca554d3 req-41e02ffd-cfb2-4b5c-bba3-edac206738c1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] No waiting events found dispatching network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:27.856650 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-b415704d-7a80-4342-b17d-10241ca554d3 req-41e02ffd-cfb2-4b5c-bba3-edac206738c1 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received unexpected event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a for instance with vm_state stopped and task_state powering-on.
May 28 03:18:27.892251 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:28.013544 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updated VIF entry in instance network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:18:28.013544 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:28.013909 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:28.016764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:28.018870 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:28.034544 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:28.199030 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:28.375538 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for d09b4ea5-5136-4338-9813-8f3b762aa4ab due to new event <LifecycleEvent: 1779938308.375143, d09b4ea5-5136-4338-9813-8f3b762aa4ab => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:18:28.375714 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938308.375143, d09b4ea5-5136-4338-9813-8f3b762aa4ab => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:28.375838 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] VM Resumed (Lifecycle Event)
May 28 03:18:28.377071 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:18:28.379979 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance rebooted successfully.
May 28 03:18:28.515492 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-acc7f3ba-d9f9-42bd-8811-9c1f4c4f0876 req-49475087-9c0e-407f-8054-2261c2c3377b service nova] Releasing lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:28.878918 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:28.880801 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:18:29.384612 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 03:18:29.384878 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938309.3846877, d09b4ea5-5136-4338-9813-8f3b762aa4ab => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:29.384991 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] VM Started (Lifecycle Event)
May 28 03:18:29.890047 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:29.893043 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:18:29.894653 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:29.894836 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:29.894888 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:dc:19:e9, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:18:29.895188 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb179c8b-4161-45a4-b3e8-66d007849226 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:29.910474 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e0eb7c18-d0e4-4608-a096-b36b8190a672 req-fa3bbad3-e5f3-41ff-a034-2c32cec744a0 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:29.910474 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e0eb7c18-d0e4-4608-a096-b36b8190a672 req-fa3bbad3-e5f3-41ff-a034-2c32cec744a0 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:29.911018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e0eb7c18-d0e4-4608-a096-b36b8190a672 req-fa3bbad3-e5f3-41ff-a034-2c32cec744a0 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:29.912088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e0eb7c18-d0e4-4608-a096-b36b8190a672 req-fa3bbad3-e5f3-41ff-a034-2c32cec744a0 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:29.912088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e0eb7c18-d0e4-4608-a096-b36b8190a672 req-fa3bbad3-e5f3-41ff-a034-2c32cec744a0 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] No waiting events found dispatching network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:29.912088 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-e0eb7c18-d0e4-4608-a096-b36b8190a672 req-fa3bbad3-e5f3-41ff-a034-2c32cec744a0 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received unexpected event network-vif-plugged-5de817f8-187b-486c-b032-d31544f5fc0a for instance with vm_state stopped and task_state powering-on.
May 28 03:18:30.398295 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] During sync_power_state the instance has a pending task (powering-on). Skip.
May 28 03:18:30.414974 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0002788459996736492 future=<Future at 0x7e4b407f4740 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:30.415100 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:30.622300 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-5129df0e-3992-4805-9463-69cfce6ee0b8 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Get console output
May 28 03:18:30.625558 np0000001589 nova-compute[98297]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 28 03:18:32.330048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:32.761776 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:32.761924 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:32.762092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:32.762234 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:32.762358 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:32.764205 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Terminating instance
May 28 03:18:33.205240 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:33.270048 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:18:33.287062 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:33.306008 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:33.310438 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:33.343553 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:33.459086 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-196c242d-dcc3-4350-a7cb-3e146dc6dce3 req-48e18789-2f07-4bee-b1c5-ba5d1a034922 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:33.459243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-196c242d-dcc3-4350-a7cb-3e146dc6dce3 req-48e18789-2f07-4bee-b1c5-ba5d1a034922 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:33.459477 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-196c242d-dcc3-4350-a7cb-3e146dc6dce3 req-48e18789-2f07-4bee-b1c5-ba5d1a034922 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:33.459796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-196c242d-dcc3-4350-a7cb-3e146dc6dce3 req-48e18789-2f07-4bee-b1c5-ba5d1a034922 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:33.459962 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-196c242d-dcc3-4350-a7cb-3e146dc6dce3 req-48e18789-2f07-4bee-b1c5-ba5d1a034922 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] No waiting events found dispatching network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:33.460171 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-196c242d-dcc3-4350-a7cb-3e146dc6dce3 req-48e18789-2f07-4bee-b1c5-ba5d1a034922 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:18:33.699144 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999184116999913 future=<Future at 0x7e4b407ded80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:33.700324 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Instance destroyed successfully.
May 28 03:18:33.700768 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.997522765999747 future=<Future at 0x7e4b407ded80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:33.701494 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid d09b4ea5-5136-4338-9813-8f3b762aa4ab {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:33.702729 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99558400099977 future=<Future at 0x7e4b407ded80 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:34.203948 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-108984611',display_name='tempest-TestVolumeBootPattern-server-108984611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-108984611',id=68,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs4Z0IQvLfQNZ3quTlHVCvUfLAQyCiUjgW5GN2+o0QNyaYl9Lzorh8zHyCN9LrouVsCbda/rJk8A/lm/Gn97ZPnofjIIj0K7sHKscjHgBjyX9n++BMDHRHdxsqZ7hl4vQ==',key_name='tempest-keypair-882609080',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:17:36Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-04jjv0qm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=d09b4ea5-5136-4338-9813-8f3b762aa4ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:18:34.204166 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "5de817f8-187b-486c-b032-d31544f5fc0a", "address": "fa:16:3e:dc:19:e9", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.224", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5de817f8-18", "ovs_interfaceid": "5de817f8-187b-486c-b032-d31544f5fc0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:34.204753 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:34.205020 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:18:34.206865 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:34.207061 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5de817f8-18, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:34.209394 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:34.210314 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:34.210941 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:34.211111 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c7dd16d-814c-4cb3-a6b3-1bb899a6e8b0) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:34.212300 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:34.212958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:34.214239 np0000001589 nova-compute[98297]: INFO os_vif [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:19:e9,bridge_name='br-int',has_traffic_filtering=True,id=5de817f8-187b-486c-b032-d31544f5fc0a,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5de817f8-18')
May 28 03:18:34.219799 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:18:34.220067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:34.220197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:34.220520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:34.220764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:18:34.220886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:18:34.246614 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:34.246614 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:34.246614 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:34.246614 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:34.246614 np0000001589 nova-compute[98297]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:34.246614 np0000001589 nova-compute[98297]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:34.246614 np0000001589 nova-compute[98297]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be9e43f6-f606-49f2-8d97-e968d68ff348 (non-flash)
May 28 03:18:34.246614 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2 (non-flash)
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: tcp: [204] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-be9e43f6-f606-49f2-8d97-e968d68ff348 (non-flash)
May 28 03:18:34.246992 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '200'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '203'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-be9e43f6-f606-49f2-8d97-e968d68ff348', '204')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:18:34.246992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '203')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:34.247820 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2', '202')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:34.248513 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646cbd80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'): ({'sdd'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:18:34.248672 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdd, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:18:34.248854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 3300000007817086c {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:18:34.313267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:34.373863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:34.418499 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdd, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:18:34.418696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdd, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:18:34.419531 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdd', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:18:34.429848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdd', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:18:34.430042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:18:34.441152 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:34.478497 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260]
May 28 03:18:34.478497 np0000001589 nova-compute[98297]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.40.100,3260] successful.
May 28 03:18:34.478497 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:34.497059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:34.519862 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:34.562721 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260]
May 28 03:18:34.562721 np0000001589 nova-compute[98297]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-b4156ff4-0ac0-4189-8e61-4da7305c4ce2, portal: 192.168.50.100,3260] successful.
May 28 03:18:34.562721 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:34.577955 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:34.578198 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:34.578412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (357ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:34.578593 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:18:34.578909 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Deleting instance files /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab_del
May 28 03:18:34.579427 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Deletion of /opt/stack/data/nova/instances/d09b4ea5-5136-4338-9813-8f3b762aa4ab_del complete
May 28 03:18:35.085338 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Took 1.81 seconds to destroy the instance on the hypervisor.
May 28 03:18:35.085955 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:18:35.086271 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:18:35.086985 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:18:35.087217 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:35.151620 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:35.538705 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0c711aa4-6d8e-495f-9ab3-740a0fac0c9a req-aabf3446-72dd-4191-ad98-99bea9842c53 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:35.540101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0c711aa4-6d8e-495f-9ab3-740a0fac0c9a req-aabf3446-72dd-4191-ad98-99bea9842c53 service nova] Acquiring lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:35.540490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0c711aa4-6d8e-495f-9ab3-740a0fac0c9a req-aabf3446-72dd-4191-ad98-99bea9842c53 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:35.541106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0c711aa4-6d8e-495f-9ab3-740a0fac0c9a req-aabf3446-72dd-4191-ad98-99bea9842c53 service nova] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:35.541784 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0c711aa4-6d8e-495f-9ab3-740a0fac0c9a req-aabf3446-72dd-4191-ad98-99bea9842c53 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] No waiting events found dispatching network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:35.542847 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0c711aa4-6d8e-495f-9ab3-740a0fac0c9a req-aabf3446-72dd-4191-ad98-99bea9842c53 service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-unplugged-5de817f8-187b-486c-b032-d31544f5fc0a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:18:35.605356 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ed0b75a9-b16c-4f36-99f4-9b578b072670 req-223223d2-e2f3-4e2f-be9a-d8e56a17ccdb service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Received event network-vif-deleted-5de817f8-187b-486c-b032-d31544f5fc0a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:35.605513 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-ed0b75a9-b16c-4f36-99f4-9b578b072670 req-223223d2-e2f3-4e2f-be9a-d8e56a17ccdb service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Neutron deleted interface 5de817f8-187b-486c-b032-d31544f5fc0a; detaching it from the instance and deleting it from the info cache
May 28 03:18:35.610639 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ed0b75a9-b16c-4f36-99f4-9b578b072670 req-223223d2-e2f3-4e2f-be9a-d8e56a17ccdb service nova] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Detach interface failed, port_id=5de817f8-187b-486c-b032-d31544f5fc0a, reason: Instance d09b4ea5-5136-4338-9813-8f3b762aa4ab could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:18:36.060114 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:36.562816 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Took 1.48 seconds to deallocate network for instance.
May 28 03:18:36.643940 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:36.644274 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.49 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:18:36.847312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:36.847496 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:36.847690 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Rebooting instance
May 28 03:18:37.122254 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Took 0.56 seconds to detach 1 volumes for instance.
May 28 03:18:37.399241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:37.399374 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquired lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:37.399501 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:18:37.627504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:37.627947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:37.728761 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Refreshing inventories for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 03:18:37.773695 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Updating ProviderTree inventory for provider 672703c4-2150-4765-9740-44d3bdb44a8c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 03:18:37.773849 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 03:18:37.810363 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Refreshing aggregate associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, aggregates: None {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 03:18:37.852717 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Refreshing trait associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, traits: COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 03:18:37.901273 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:38.040632 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:18:38.040839 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:18:38.214113 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:38.219302 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:38.325240 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:38.544151 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:18:38.827351 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Releasing lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:39.051129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.423s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:39.095264 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance d09b4ea5-5136-4338-9813-8f3b762aa4ab
May 28 03:18:39.213524 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:39.330730 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:40.102865 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-88c8859b-afa0-4ddf-b922-467103fef04b tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "d09b4ea5-5136-4338-9813-8f3b762aa4ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.341s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:40.137640 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:40.374609 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:40.377010 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:40.391965 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:40.394115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:40.412489 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:40.502544 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-492969e6-ba04-4b30-a9fe-f002f576f98d req-2a4ddc66-1384-4967-864c-f2dd475600ce service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:40.502895 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-492969e6-ba04-4b30-a9fe-f002f576f98d req-2a4ddc66-1384-4967-864c-f2dd475600ce service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:40.503076 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-492969e6-ba04-4b30-a9fe-f002f576f98d req-2a4ddc66-1384-4967-864c-f2dd475600ce service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:40.503243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-492969e6-ba04-4b30-a9fe-f002f576f98d req-2a4ddc66-1384-4967-864c-f2dd475600ce service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:40.503432 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-492969e6-ba04-4b30-a9fe-f002f576f98d req-2a4ddc66-1384-4967-864c-f2dd475600ce service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] No waiting events found dispatching network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:40.503584 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-492969e6-ba04-4b30-a9fe-f002f576f98d req-2a4ddc66-1384-4967-864c-f2dd475600ce service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received unexpected event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e for instance with vm_state active and task_state reboot_started_hard.
May 28 03:18:40.641768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:40.641946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:40.642080 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:40.642207 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:18:40.677066 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99969557600025 future=<Future at 0x7e4b64588530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:40.679991 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance destroyed successfully.
May 28 03:18:40.680831 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'resources' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:41.182621 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1726996886',display_name='tempest-TestMinimumBasicScenario-server-1726996886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-1726996886',id=69,image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5tzzJCLbVanD3idP7BCCwkQ9/vm3gdJ0H3M5nmiW7eDnPjDlVbg5fNTX2qoIMOakmQZE8hGh1e6DUqjgzkne66VhceFzSw/gyLKfS4BvzalRpzic5f3Ob35pmMk9hpg==',key_name='tempest-TestMinimumBasicScenario-1862345335',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:18:10Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-xo6klmpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:18:39Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=00cd655c-7eb1-4dd3-b320-fe38811c1834,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:18:41.183105 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:41.183368 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:41.183638 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:18:41.184667 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:41.184925 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5708b542-7c, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:41.185814 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:41.186459 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:41.186584 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:41.188625 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:41.188980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efff65cf-049e-441a-9ba0-fad6da990d3c) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:41.189301 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:41.189805 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:41.191558 np0000001589 nova-compute[98297]: INFO os_vif [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c')
May 28 03:18:41.193071 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:18:41.193369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:41.193562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:41.193778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:41.194022 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:18:41.194158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:18:41.215832 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:41.215832 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:41.215832 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:41.215832 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:41.215832 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:41.216027 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:41.216027 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:41.216027 np0000001589 nova-compute[98297]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:41.216027 np0000001589 nova-compute[98297]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:41.216027 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:41.216197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '200')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:18:41.216392 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '200')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:41.217490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '199')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:41.218415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40587920>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:18:41.218652 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Removing multipathed devices sdf, sde {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:18:41.218935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flush multipath device 330000000a8733c60 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:18:41.251747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:41.290545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:41.328739 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking to see if SCSI volumes sdf, sde have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:18:41.328896 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] SCSI volumes sdf, sde have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:18:41.329537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking to see if device paths {'sdf', 'sde'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:18:41.340528 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Device paths {'sdf', 'sde'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:18:41.340690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:18:41.351161 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:41.380970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260]
May 28 03:18:41.380970 np0000001589 nova-compute[98297]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260] successful.
May 28 03:18:41.380970 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:41.389736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:41.389915 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:41.394119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:41.404475 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:41.430770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260]
May 28 03:18:41.430770 np0000001589 nova-compute[98297]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260] successful.
May 28 03:18:41.430770 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:41.442470 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:41.442657 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.249s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:41.442761 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== disconnect_volume: return (249ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:41.442869 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:18:41.447572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Start _get_guest_xml network_info=[{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1cc944cd-03da-4f59-8021-93beb7b72ccb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': '1cc944cd-03da-4f59-8021-93beb7b72ccb'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '44c9d702-9320-41f3-847a-4e0ff4707363', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, 'status': 'reserved', 'instance': '00cd655c-7eb1-4dd3-b320-fe38811c1834', 'attached_at': '', 'detached_at': '', 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'serial': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'}, 'delete_on_termination': False, 'boot_index': None, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:18:41.449269 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:18:41.450137 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='1cc944cd-03da-4f59-8021-93beb7b72ccb', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1726996886', uuid='00cd655c-7eb1-4dd3-b320-fe38811c1834'), owner=OwnerMeta(userid='bc6820ff3bfd4e90a108c237bcfb235d', username='tempest-TestMinimumBasicScenario-62402083-project-member', projectid='6b78a160e3c24b99b0760e4c18e688e3', projectname='tempest-TestMinimumBasicScenario-62402083'), image=ImageMeta(id='1cc944cd-03da-4f59-8021-93beb7b72ccb', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938321.4498763) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:18:41.451069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:18:41.451383 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:18:41.452216 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:18:41.452389 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:18:41.453080 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:18:41.453322 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1cc944cd-03da-4f59-8021-93beb7b72ccb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:18:41.453462 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:18:41.453545 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:18:41.453673 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:18:41.453753 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:18:41.453840 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:18:41.453958 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:18:41.454049 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:18:41.454145 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:18:41.454251 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:18:41.454376 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:18:41.454484 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:41.693613 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:41.787690 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:41.789103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:41.882975 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:41.883411 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:18:41.886137 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Error from libvirt while getting description of instance-00000045: [Error Code 42] Domain not found: no domain with matching uuid '00cd655c-7eb1-4dd3-b320-fe38811c1834' (instance-00000045): libvirt.libvirtError: Domain not found: no domain with matching uuid '00cd655c-7eb1-4dd3-b320-fe38811c1834' (instance-00000045)
May 28 03:18:41.887834 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:18:41.888846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:41.901622 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Detaching volume f895ae08-c318-4ef5-978f-622bb5ab4b26
May 28 03:18:41.935273 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:41.935623 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13365MB free_disk=72.6477279663086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:18:41.935800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:41.936044 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:41.944669 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Attempting to driver detach volume f895ae08-c318-4ef5-978f-622bb5ab4b26 from mountpoint /dev/vdb
May 28 03:18:41.949757 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Found disk vdb by alias ua-f895ae08-c318-4ef5-978f-622bb5ab4b26 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:18:41.951092 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Found disk vdb by alias ua-f895ae08-c318-4ef5-978f-622bb5ab4b26 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:18:41.951214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Attempting to detach device vdb from instance 275118e5-8f9a-4cc6-abab-e7ff17154aee from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:18:41.951484 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:18:41.951484 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:18:41.951484 np0000001589 nova-compute[98297]:   <alias name="ua-f895ae08-c318-4ef5-978f-622bb5ab4b26"/>
May 28 03:18:41.951484 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:18:41.951484 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:18:41.951484 np0000001589 nova-compute[98297]:   <serial>f895ae08-c318-4ef5-978f-622bb5ab4b26</serial>
May 28 03:18:41.951484 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:18:41.951484 np0000001589 nova-compute[98297]: </disk>
May 28 03:18:41.951484 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:18:41.956241 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Object Instance<00cd655c-7eb1-4dd3-b320-fe38811c1834> lazy-loaded attributes: resources,vcpu_model {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:41.965674 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully detached device vdb from instance 275118e5-8f9a-4cc6-abab-e7ff17154aee from the persistent domain config.
May 28 03:18:41.966602 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] (1/8): Attempting to detach device vdb with device alias ua-f895ae08-c318-4ef5-978f-622bb5ab4b26 from instance 275118e5-8f9a-4cc6-abab-e7ff17154aee from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:18:41.966836 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:18:41.966836 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:18:41.966836 np0000001589 nova-compute[98297]:   <alias name="ua-f895ae08-c318-4ef5-978f-622bb5ab4b26"/>
May 28 03:18:41.966836 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:18:41.966836 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:18:41.966836 np0000001589 nova-compute[98297]:   <serial>f895ae08-c318-4ef5-978f-622bb5ab4b26</serial>
May 28 03:18:41.966836 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:18:41.966836 np0000001589 nova-compute[98297]: </disk>
May 28 03:18:41.966836 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:18:41.967368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.config --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:42.058968 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.config --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:42.059440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:42.059815 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:42.061159 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:42.061159 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:18:42.061159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:42.061159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:42.061756 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:42.061756 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:18:42.073301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:42.073819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:42.074021 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:42.075778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:42.075778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:42.075778 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:42.086650 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:42.086650 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:42.087396 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:42.087396 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:42.097267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e] added
May 28 03:18:42.097267 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:42.097267 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:42.097267 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:42.097267 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:42.097267 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:42.097267 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:42.098067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:42.098067 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:42.098067 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:42.100337 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e] added
May 28 03:18:42.100337 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:42.100337 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:42.100337 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:42.100337 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:42.100337 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:42.100337 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:42.100337 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:42.100337 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:42.100669 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:42.425126 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938322.4247906, 275118e5-8f9a-4cc6-abab-e7ff17154aee => ua-f895ae08-c318-4ef5-978f-622bb5ab4b26> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:18:42.426010 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f895ae08-c318-4ef5-978f-622bb5ab4b26 for instance 275118e5-8f9a-4cc6-abab-e7ff17154aee {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:18:42.428072 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully detached device vdb from instance 275118e5-8f9a-4cc6-abab-e7ff17154aee from the live domain config.
May 28 03:18:42.429087 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:18:42.429407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:42.429572 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:42.554565 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aaf0b9e4-3f62-410f-a3c6-49414aaa0792 req-99b0864f-c472-45dc-8d7f-0a2238691407 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:42.555088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aaf0b9e4-3f62-410f-a3c6-49414aaa0792 req-99b0864f-c472-45dc-8d7f-0a2238691407 service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:42.555321 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aaf0b9e4-3f62-410f-a3c6-49414aaa0792 req-99b0864f-c472-45dc-8d7f-0a2238691407 service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:42.555481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-aaf0b9e4-3f62-410f-a3c6-49414aaa0792 req-99b0864f-c472-45dc-8d7f-0a2238691407 service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:42.555657 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-aaf0b9e4-3f62-410f-a3c6-49414aaa0792 req-99b0864f-c472-45dc-8d7f-0a2238691407 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] No waiting events found dispatching network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:42.555820 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-aaf0b9e4-3f62-410f-a3c6-49414aaa0792 req-99b0864f-c472-45dc-8d7f-0a2238691407 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received unexpected event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e for instance with vm_state active and task_state reboot_started_hard.
May 28 03:18:42.986473 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 275118e5-8f9a-4cc6-abab-e7ff17154aee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:18:42.986646 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 00cd655c-7eb1-4dd3-b320-fe38811c1834 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:18:42.986819 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:18:42.986945 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:18:41 up 46 min,  2 users,  load average: 3.38, 5.02, 4.64\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_8a6a1526383440ceb5b3f69f7492d966': '1', 'io_workload': '0', 'num_task_reboot_started_hard': '1', 'num_proj_6b78a160e3c24b99b0760e4c18e688e3': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:18:43.098574 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:43.101008 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:43.108434 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:18:43.108706 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:43.111953 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:43.111953 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:43.118755 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:43.118755 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.124198 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.130900 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.136743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.136743 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.136743 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:43.136901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.136901 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.136901 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:43.143321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.143321 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.143321 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:43.143510 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.143510 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.143510 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:43.169467 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260]
May 28 03:18:43.169467 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260] successful.
May 28 03:18:43.169467 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.180178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.181440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260]
May 28 03:18:43.181440 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260] successful.
May 28 03:18:43.181440 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.193264 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.193264 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.193264 np0000001589 nova-compute[98297]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.193264 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.193264 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:43.193458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.193458 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.193458 np0000001589 nova-compute[98297]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.193458 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.193458 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:43.193730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:43.193822 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:43.194494 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] HCTL ('9', '-', '-', 0) found on session 205 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:43.194716 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:43.195196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:43.208054 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching for a device in session 205 and hctl ['9', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:43.211929 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.211929 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.211929 np0000001589 nova-compute[98297]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.211929 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.211929 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:43.212081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.212081 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:43.212081 np0000001589 nova-compute[98297]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.212081 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:43.212081 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:43.212248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:43.212383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:43.212861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] HCTL ('10', '-', '-', 0) found on session 206 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:43.212968 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:43.222580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:43.227132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching for a device in session 206 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:43.227132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:43.611201 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:18:44.117782 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:18:44.117957 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.182s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:44.118274 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:18:44.208103 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching for a device in session 205 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:44.208297 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:45.089530 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Found WWN 330000000a8733c60 for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:18:45.089942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:45.089942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '330000000a8733c60', 'path': '/dev/dm-1', 'multipath_id': '330000000a8733c60'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:45.090028 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a8733c60', 'path': '/dev/dm-1', 'multipath_id': '330000000a8733c60'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:18:45.090588 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.661s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:45.090893 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:18:45.091019 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:18:45.114148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:45.114148 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:45.114148 np0000001589 nova-compute[98297]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:45.114148 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:45.114148 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:45.114376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [196] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:45.114376 np0000001589 nova-compute[98297]: tcp: [197] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26 (non-flash)
May 28 03:18:45.114376 np0000001589 nova-compute[98297]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:45.114376 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:45.114376 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:45.114482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '196'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '197'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '206')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:18:45.114482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '196')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:45.115167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', '197')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:45.115784 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b405862a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:18:45.115940 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:18:45.116136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Flush multipath device 33000000053cf99ed {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:18:45.146275 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:45.194445 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:18:45.239397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:18:45.239527 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:18:45.240131 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:18:45.250897 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:18:45.251052 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:18:45.261562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:45.286993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.40.100,3260]
May 28 03:18:45.286993 np0000001589 nova-compute[98297]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.40.100,3260] successful.
May 28 03:18:45.286993 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:45.300039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:45.313108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:45.340055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.50.100,3260]
May 28 03:18:45.340055 np0000001589 nova-compute[98297]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, portal: 192.168.50.100,3260] successful.
May 28 03:18:45.340055 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:45.351954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:45.352189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:45.352376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] <== disconnect_volume: return (2922ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:45.352501 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:18:45.412696 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:45.412867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:45.596373 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1726996886',display_name='tempest-TestMinimumBasicScenario-server-1726996886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-1726996886',id=69,image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5tzzJCLbVanD3idP7BCCwkQ9/vm3gdJ0H3M5nmiW7eDnPjDlVbg5fNTX2qoIMOakmQZE8hGh1e6DUqjgzkne66VhceFzSw/gyLKfS4BvzalRpzic5f3Ob35pmMk9hpg==',key_name='tempest-TestMinimumBasicScenario-1862345335',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:18:10Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-xo6klmpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:18:39Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=00cd655c-7eb1-4dd3-b320-fe38811c1834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:18:45.596373 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:45.596637 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:45.597146 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'pci_devices' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:45.894269 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'flavor' on Instance uuid 275118e5-8f9a-4cc6-abab-e7ff17154aee {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:45.914669 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:18:46.098864 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Object Instance<00cd655c-7eb1-4dd3-b320-fe38811c1834> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:46.099958 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] End _get_guest_xml xml=<domain type="qemu">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <uuid>00cd655c-7eb1-4dd3-b320-fe38811c1834</uuid>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <name>instance-00000045</name>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestMinimumBasicScenario-server-1726996886</nova:name>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:18:41</nova:creationTime>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:image uuid="1cc944cd-03da-4f59-8021-93beb7b72ccb">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:user uuid="bc6820ff3bfd4e90a108c237bcfb235d">tempest-TestMinimumBasicScenario-62402083-project-member</nova:user>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:project uuid="6b78a160e3c24b99b0760e4c18e688e3">tempest-TestMinimumBasicScenario-62402083</nova:project>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="1cc944cd-03da-4f59-8021-93beb7b72ccb"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         <nova:port uuid="5708b542-7cfc-4ac9-8c9d-2893fea4189e">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <system>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <entry name="serial">00cd655c-7eb1-4dd3-b320-fe38811c1834</entry>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <entry name="uuid">00cd655c-7eb1-4dd3-b320-fe38811c1834</entry>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </system>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <os>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   </os>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <features>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   </features>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   <devices>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </disk>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk.config"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </disk>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <alias name="ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-1"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <target dev="vdb" bus="virtio"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <serial>45bef9e2-d456-47bc-9c64-2b5eea1c9b7e</serial>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </disk>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:b5:e5:d4"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <target dev="tap5708b542-7c"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </interface>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/console.log" append="off"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </serial>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <video>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </video>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </rng>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:   </devices>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]: </domain>
May 28 03:18:46.099958 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:18:46.102344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:46.187997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:46.188397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:46.199179 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:46.274281 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:46.274755 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:18:46.275387 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:46.462469 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:46.462719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:46.467661 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:18:46.467796 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Claim successful on node np0000001589
May 28 03:18:46.639001 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:46.777453 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Object Instance<00cd655c-7eb1-4dd3-b320-fe38811c1834> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:46.777797 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:46.863747 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eda4e29eb15965b0bea97dc4ce05ee7c62fc3f8 --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:46.864242 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:18:46.864536 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:46.902114 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-abf66c42-d56b-45db-848a-8b92588219c6 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.511s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:46.904072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.264s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:46.904578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:46.904895 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:46.905099 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:46.907717 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Terminating instance
May 28 03:18:46.948452 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:18:46.948810 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Cannot resize image /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:18:46.949020 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'migration_context' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:47.118457 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:47.118869 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:47.118869 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:47.118972 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:18:47.119256 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.02 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:18:47.410684 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:18:47.426890 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.429022 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.443999 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.452104 np0000001589 nova-compute[98297]: DEBUG nova.objects.base [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Object Instance<00cd655c-7eb1-4dd3-b320-fe38811c1834> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98297) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 28 03:18:47.453134 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1726996886',display_name='tempest-TestMinimumBasicScenario-server-1726996886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-1726996886',id=69,image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5tzzJCLbVanD3idP7BCCwkQ9/vm3gdJ0H3M5nmiW7eDnPjDlVbg5fNTX2qoIMOakmQZE8hGh1e6DUqjgzkne66VhceFzSw/gyLKfS4BvzalRpzic5f3Ob35pmMk9hpg==',key_name='tempest-TestMinimumBasicScenario-1862345335',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:18:10Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-xo6klmpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:18:39Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=00cd655c-7eb1-4dd3-b320-fe38811c1834,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:18:47.453392 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.19", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:47.453962 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:47.454193 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:18:47.454555 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.454806 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:47.455045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:18:47.455697 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.455904 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34643011-85ae-5e38-9530-bff56e9fbb24', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:47.457196 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.457526 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:47.460488 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.465268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.476136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.478426 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.478607 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5708b542-7c, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:47.478946 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5708b542-7c, col_values=(('qos', UUID('096ac836-3e90-41f5-b024-0efff47985a4')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:47.479170 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5708b542-7c, col_values=(('external_ids', {'iface-id': '5708b542-7cfc-4ac9-8c9d-2893fea4189e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:e5:d4', 'vm-uuid': '00cd655c-7eb1-4dd3-b320-fe38811c1834'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:47.481668 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.482744 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:47.491245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:47.492928 np0000001589 nova-compute[98297]: INFO os_vif [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c')
May 28 03:18:47.630633 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:18:47.630823 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:18:47.862907 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999701066999933 future=<Future at 0x7e4b781db470 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:47.866151 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Instance destroyed successfully.
May 28 03:18:47.867266 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lazy-loading 'resources' on Instance uuid 275118e5-8f9a-4cc6-abab-e7ff17154aee {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:47.985046 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:48.002620 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:48.024211 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2873baa3-1d17-40f6-9ea4-53823927d8ab req-20561f20-7cd4-4731-b364-48759ce9d16b service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-vif-unplugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:48.024494 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2873baa3-1d17-40f6-9ea4-53823927d8ab req-20561f20-7cd4-4731-b364-48759ce9d16b service nova] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:48.024688 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2873baa3-1d17-40f6-9ea4-53823927d8ab req-20561f20-7cd4-4731-b364-48759ce9d16b service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:48.024815 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2873baa3-1d17-40f6-9ea4-53823927d8ab req-20561f20-7cd4-4731-b364-48759ce9d16b service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:48.024928 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2873baa3-1d17-40f6-9ea4-53823927d8ab req-20561f20-7cd4-4731-b364-48759ce9d16b service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] No waiting events found dispatching network-vif-unplugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:48.025050 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2873baa3-1d17-40f6-9ea4-53823927d8ab req-20561f20-7cd4-4731-b364-48759ce9d16b service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-vif-unplugged-802aca06-883d-486e-9b79-c6e583147611 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:18:48.081863 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:48.098489 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:48.133335 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:18:48.139748 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:48.139988 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-2011356735',display_name='tempest-VolumesBackupsTest-instance-2011356735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumesbackupstest-instance-2011356735',id=67,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7TNZT7lIq0IlUWfC5e2GgcLkCiz+vEiHj6xCz+1ihxzeghfOUDsLo7oeowPh3W7drh4lsqoq/4WqWj6bNE47uBCxVREr+2WHN40Zp4n9dgfWIMqEzmmUULMqRIZzD3QQ==',key_name='tempest-keypair-473449176',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:17:22Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a6a1526383440ceb5b3f69f7492d966',ramdisk_id='',reservation_id='r-i4sprbl1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-1005474821',owner_user_name='tempest-VolumesBackupsTest-1005474821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='833c35fdd92b4929b9f3c40ffb29b3c5',uuid=275118e5-8f9a-4cc6-abab-e7ff17154aee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converting VIF {"id": "802aca06-883d-486e-9b79-c6e583147611", "address": "fa:16:3e:ac:62:78", "network": {"id": "b7d6f3e2-404c-4280-8fab-d859a658dc56", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-573034485-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8a6a1526383440ceb5b3f69f7492d966", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap802aca06-88", "ovs_interfaceid": "802aca06-883d-486e-9b79-c6e583147611", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:62:78,bridge_name='br-int',has_traffic_filtering=True,id=802aca06-883d-486e-9b79-c6e583147611,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802aca06-88') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:62:78,bridge_name='br-int',has_traffic_filtering=True,id=802aca06-883d-486e-9b79-c6e583147611,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802aca06-88') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap802aca06-88, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d410c06-b928-489b-b519-2b3dbc8cde56) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: INFO os_vif [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:62:78,bridge_name='br-int',has_traffic_filtering=True,id=802aca06-883d-486e-9b79-c6e583147611,network=Network(b7d6f3e2-404c-4280-8fab-d859a658dc56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap802aca06-88')
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:49.049785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f895ae08-c318-4ef5-978f-622bb5ab4b26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:49.052214 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:49.052214 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '206')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26, 0): [] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f895ae08-c318-4ef5-978f-622bb5ab4b26') {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646c8860>, {}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Disconnecting from: [] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] <== disconnect_volume: return (30ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Deleting instance files /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee_del
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Deletion of /opt/stack/data/nova/instances/275118e5-8f9a-4cc6-abab-e7ff17154aee_del complete
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.181s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 00cd655c-7eb1-4dd3-b320-fe38811c1834 due to new event <LifecycleEvent: 1779938328.6733341, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance event wait completed in 0 seconds for  {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938328.6733341, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] VM Resumed (Lifecycle Event)
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance rebooted successfully.
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003854900000987982 future=<Future at 0x7e4b407ded80 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779938313.6981976, d09b4ea5-5136-4338-9813-8f3b762aa4ab => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] VM Stopped (Lifecycle Event)
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.975928976999967 future=<Future at 0x7e4b64588530 state=cancelled>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=6.97580819399991 future=<Future at 0x7e4b64588530 state=cancelled>) was cancelled while queued, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.161471455000083 future=<Future at 0x7e4b781db470 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.16140378 future=<Future at 0x7e4b781db470 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Took 1.50 seconds to destroy the instance on the hypervisor.
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:49.052214 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:49.150881 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:18:49.151917 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:18:49.152165 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:49.152437 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:49.179725 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:49.183327 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:18:49.206565 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: d09b4ea5-5136-4338-9813-8f3b762aa4ab] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:49.243319 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:18:49.398937 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5a8560e5-b4a5-4899-b124-ff8b6212b7bd req-fbf542cd-3dac-4417-be3b-37f8cbab725d service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-vif-deleted-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:49.399346 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-5a8560e5-b4a5-4899-b124-ff8b6212b7bd req-fbf542cd-3dac-4417-be3b-37f8cbab725d service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Neutron deleted interface 802aca06-883d-486e-9b79-c6e583147611; detaching it from the instance and deleting it from the info cache
May 28 03:18:49.401211 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5a8560e5-b4a5-4899-b124-ff8b6212b7bd req-fbf542cd-3dac-4417-be3b-37f8cbab725d service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Detach interface failed, port_id=802aca06-883d-486e-9b79-c6e583147611, reason: Instance 275118e5-8f9a-4cc6-abab-e7ff17154aee could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:18:49.654348 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:18:49.663448 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Successfully created port: 9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:18:49.686752 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 03:18:49.687056 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938329.686853, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:18:49.687209 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] VM Started (Lifecycle Event)
May 28 03:18:49.857262 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:50.076469 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Successfully updated port: 9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:18:50.083496 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-vif-unplugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:50.083642 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Acquiring lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:50.083812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:50.083959 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:50.084109 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] No waiting events found dispatching network-vif-unplugged-802aca06-883d-486e-9b79-c6e583147611 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:50.084556 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Received event network-vif-unplugged-802aca06-883d-486e-9b79-c6e583147611 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:18:50.084659 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:50.084781 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:50.084898 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:50.084998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:50.085093 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] No waiting events found dispatching network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:50.085199 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received unexpected event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e for instance with vm_state active and task_state reboot_started_hard.
May 28 03:18:50.085326 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:50.085439 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:50.085533 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:50.085624 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:50.085712 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] No waiting events found dispatching network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:18:50.085800 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-28ed1c52-2ba8-4bc9-82b5-84bd7afa62b6 req-56e8a5a2-163d-4193-bd84-2cdeef26c24b service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received unexpected event network-vif-plugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e for instance with vm_state active and task_state reboot_started_hard.
May 28 03:18:50.122304 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-changed-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:18:50.122447 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Refreshing instance network info cache due to event network-changed-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:18:50.122733 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] Acquiring lock "refresh_cache-f5e01cbd-878f-494d-96ed-bdb75d04cbdd" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:50.122867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] Acquired lock "refresh_cache-f5e01cbd-878f-494d-96ed-bdb75d04cbdd" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:50.123029 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Refreshing network info cache for port 9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:18:50.157312 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:18:50.189316 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:50.191365 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:50.191594 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:50.191785 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:18:50.191984 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No VIF found with MAC fa:16:3e:b5:e5:d4, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:18:50.192142 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:18:50.194563 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:18:50.359126 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Took 1.44 seconds to deallocate network for instance.
May 28 03:18:50.382692 np0000001589 nova-compute[98297]: WARNING nova.volume.cinder [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Attachment 7a923995-b92f-4f21-a3b0-18e45e7f39ee does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7a923995-b92f-4f21-a3b0-18e45e7f39ee. (HTTP 404) (Request-ID: req-633f4554-7b85-4a38-8098-f26e47c96a0c)
May 28 03:18:50.382962 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Took 0.02 seconds to detach 1 volumes for instance.
May 28 03:18:50.578312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-f5e01cbd-878f-494d-96ed-bdb75d04cbdd" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:18:50.625628 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:50.664873 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Booting with volume snapshot 9bcc7fc6-ed98-4c36-b6e5-784d2c103018 at /dev/vda
May 28 03:18:50.680135 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:18:50.694072 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 28 03:18:50.700496 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8ca61dbc-38b1-4324-b3ab-f367a7ca2b8a tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 13.852s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:50.816983 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:50.888108 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:50.888302 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:51.076145 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:18:51.076355 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:18:51.133823 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:51.134016 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:18:51.318727 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-171f3e92-a3f4-48f1-a39d-74d3694ade00 req-22faec24-0021-4661-9a2a-4dfe027bd2bc service nova] Releasing lock "refresh_cache-f5e01cbd-878f-494d-96ed-bdb75d04cbdd" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:51.319163 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-f5e01cbd-878f-494d-96ed-bdb75d04cbdd" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:18:51.319416 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:18:51.578593 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:18:51.875073 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:18:52.016165 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:18:52.089431 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.201s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:52.144093 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Deleted allocations for instance 275118e5-8f9a-4cc6-abab-e7ff17154aee
May 28 03:18:52.152834 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Updating instance_info_cache with network_info: [{"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:18:52.655248 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-f5e01cbd-878f-494d-96ed-bdb75d04cbdd" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:18:52.655624 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Instance network_info: |[{"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:18:53.152741 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-eeee402f-90e1-4bb3-9827-36289b861f93 tempest-VolumesBackupsTest-1005474821 tempest-VolumesBackupsTest-1005474821-project-member] Lock "275118e5-8f9a-4cc6-abab-e7ff17154aee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.250s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:53.235987 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:53.374161 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:54.038599 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:54.049190 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:18:54.071206 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:18:54.123774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:18:54.124601 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:18:54.137262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:18:54.137262 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feb5:e5d4', 'fe80::d2:e0ff:fef0:5ce3'] 
May 28 03:18:54.137262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:18:54.137262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:18:54.137262 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:54.137262 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Updating existing volume attachment record: 71556ed7-e990-473f-b439-5a8154b64343 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:18:54.141132 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:18:54.141504 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:18:56.231380 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:18:56.231380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:18:56.231380 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Creating image(s)
May 28 03:18:56.231380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:18:56.231380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Ensure instance console log exists: /opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:18:56.231380 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:18:56.231977 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:18:56.232174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:18:56.232685 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Start _get_guest_xml network_info=[{"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '71556ed7-e990-473f-b439-5a8154b64343', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f5e01cbd-878f-494d-96ed-bdb75d04cbdd', 'attached_at': '', 'detached_at': '', 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'serial': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:18:56.236465 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:18:56.237432 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1824432203', uuid='f5e01cbd-878f-494d-96ed-bdb75d04cbdd'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938336.2371278) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:18:56.238738 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:18:56.239119 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:18:56.240123 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:18:56.240419 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:18:56.241393 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:18:56.241707 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:18:56.241941 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:18:56.242093 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:18:56.242307 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:18:56.242455 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:18:56.242604 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:18:56.242819 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:18:56.242980 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:18:56.243140 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:18:56.243324 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:18:56.243511 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:18:56.252463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:18:56.252838 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:18:56.253058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:56.253446 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:56.253697 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:18:56.267396 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:56.268129 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:18:56.268571 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:56.268741 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:56.269503 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:18:56.269878 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:56.280025 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:56.280025 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:56.285192 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:18:56.285192 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:56.292353 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a] added
May 28 03:18:56.292353 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:56.292353 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:56.292353 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:56.292353 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:56.292353 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:56.292353 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:56.292508 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:56.292633 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:56.292764 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:56.295685 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a] added
May 28 03:18:56.295685 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:18:56.295685 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:56.295685 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:56.295685 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:18:56.295685 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:18:56.295685 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:56.295883 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:18:56.296034 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:18:56.296198 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:18:56.804458 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:57.293139 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:18:57.296647 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:57.305396 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:57.305396 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:18:57.311286 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:18:57.311286 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.318523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.323188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.333303 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.333303 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.333303 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:57.333463 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.333463 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.333463 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:57.338844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.338844 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.338844 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:57.338974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.338974 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.338974 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:57.363528 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.40.100,3260]
May 28 03:18:57.363528 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.40.100,3260] successful.
May 28 03:18:57.363528 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.372446 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.50.100,3260]
May 28 03:18:57.372446 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.50.100,3260] successful.
May 28 03:18:57.372446 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.377068 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.383921 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:18:57.391174 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.391174 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.391174 np0000001589 nova-compute[98297]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.391174 np0000001589 nova-compute[98297]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.391174 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:57.391415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.391415 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.391415 np0000001589 nova-compute[98297]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.391415 np0000001589 nova-compute[98297]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.391415 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:57.391564 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:57.391647 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:57.392266 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('7', '-', '-', 0) found on session 207 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:57.392328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:57.397829 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.397829 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.397829 np0000001589 nova-compute[98297]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.397829 np0000001589 nova-compute[98297]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.397829 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:18:57.398016 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.398016 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:18:57.398016 np0000001589 nova-compute[98297]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.398016 np0000001589 nova-compute[98297]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:18:57.398016 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:18:57.398236 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:57.398383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:18:57.398952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('8', '-', '-', 0) found on session 208 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:18:57.399089 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:18:57.406056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 207 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:57.406056 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:57.413974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 208 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:18:57.413974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:18:58.238570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:58.270460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:18:58.377776 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:58.484896 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:18:59.288017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 33000000060d416ed for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:18:59.288333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:18:59.288542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000060d416ed', 'path': '/dev/dm-0', 'multipath_id': '33000000060d416ed'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:18:59.288729 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000060d416ed', 'path': '/dev/dm-0', 'multipath_id': '33000000060d416ed'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:18:59.796990 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1824432203',display_name='tempest-TestVolumeBootPattern-server-1824432203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1824432203',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-z8wv758l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:18:50Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=f5e01cbd-878f-494d-96ed-bdb75d04cbdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:18:59.797386 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:18:59.797802 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:1b:be,bridge_name='br-int',has_traffic_filtering=True,id=9b8af38e-d0c4-4a87-bb96-17a1ad90bfae,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b8af38e-d0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:18:59.798369 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid f5e01cbd-878f-494d-96ed-bdb75d04cbdd {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:18:59.827725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:00.300922 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] End _get_guest_xml xml=<domain type="qemu">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <uuid>f5e01cbd-878f-494d-96ed-bdb75d04cbdd</uuid>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <name>instance-00000046</name>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-1824432203</nova:name>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:18:56</nova:creationTime>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         <nova:port uuid="9b8af38e-d0c4-4a87-bb96-17a1ad90bfae">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <system>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <entry name="serial">f5e01cbd-878f-494d-96ed-bdb75d04cbdd</entry>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <entry name="uuid">f5e01cbd-878f-494d-96ed-bdb75d04cbdd</entry>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </system>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <os>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   </os>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <features>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   </features>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   <devices>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd/disk.config"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </disk>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <alias name="ua-4ff063bf-bb9d-4734-bb1a-fc0163b3769a"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <serial>4ff063bf-bb9d-4734-bb1a-fc0163b3769a</serial>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </disk>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:85:1b:be"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <target dev="tap9b8af38e-d0"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </interface>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd/console.log" append="off"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </serial>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <video>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </video>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </rng>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:   </devices>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]: </domain>
May 28 03:19:00.300922 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:19:00.302709 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Preparing to wait for external event network-vif-plugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:19:00.302709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:00.302709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:00.302709 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:00.302709 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1824432203',display_name='tempest-TestVolumeBootPattern-server-1824432203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1824432203',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-z8wv758l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:18:50Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=f5e01cbd-878f-494d-96ed-bdb75d04cbdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:19:00.302709 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:19:00.302709 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:1b:be,bridge_name='br-int',has_traffic_filtering=True,id=9b8af38e-d0c4-4a87-bb96-17a1ad90bfae,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b8af38e-d0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:19:00.302957 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:1b:be,bridge_name='br-int',has_traffic_filtering=True,id=9b8af38e-d0c4-4a87-bb96-17a1ad90bfae,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b8af38e-d0') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:19:00.303444 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:00.303621 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:00.303882 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:19:00.304574 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:00.304718 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a727a094-219d-5819-b6d8-d23a26a774da', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:00.305798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:00.307205 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:00.309812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:00.310034 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b8af38e-d0, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:00.310239 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b8af38e-d0, col_values=(('qos', UUID('6f288f40-9d3d-437f-9cc3-3cf6ff947dae')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:00.310395 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b8af38e-d0, col_values=(('external_ids', {'iface-id': '9b8af38e-d0c4-4a87-bb96-17a1ad90bfae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:1b:be', 'vm-uuid': 'f5e01cbd-878f-494d-96ed-bdb75d04cbdd'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:00.311005 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:00.312699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:00.316995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:00.317734 np0000001589 nova-compute[98297]: INFO os_vif [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:1b:be,bridge_name='br-int',has_traffic_filtering=True,id=9b8af38e-d0c4-4a87-bb96-17a1ad90bfae,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b8af38e-d0')
May 28 03:19:01.719804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:01.840061 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:01.840061 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:01.840061 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:85:1b:be, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:19:01.840449 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Using config drive
May 28 03:19:02.345897 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:02.453221 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Creating config drive at /opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd/disk.config
May 28 03:19:02.456452 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3r5c0kru {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:02.516867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3r5c0kru" returned: 0 in 0.060s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:02.863169 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0005428750000646687 future=<Future at 0x7e4b781db470 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:02.864049 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938327.8624675, 275118e5-8f9a-4cc6-abab-e7ff17154aee => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:02.864338 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:02.864491 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] VM Stopped (Lifecycle Event)
May 28 03:19:02.903303 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:02.922024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:03.019732 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:03.228593 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:03.233885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:03.236010 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:03.250661 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:03.367913 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 275118e5-8f9a-4cc6-abab-e7ff17154aee] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:03.587828 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938343.5874875, f5e01cbd-878f-494d-96ed-bdb75d04cbdd => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:03.587946 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] VM Started (Lifecycle Event)
May 28 03:19:03.979869 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:04.090163 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:04.092134 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938344.0919375, f5e01cbd-878f-494d-96ed-bdb75d04cbdd => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:04.092292 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] VM Paused (Lifecycle Event)
May 28 03:19:04.594773 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:04.596637 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:19:05.098764 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:19:05.320767 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:06.187203 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:06.626676 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9fb4d136-ba77-4d5a-a69b-d3cf8d9d9f85 req-4e5d1444-6c54-4129-9cf8-92d49a2ee92e service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-vif-plugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:06.627103 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9fb4d136-ba77-4d5a-a69b-d3cf8d9d9f85 req-4e5d1444-6c54-4129-9cf8-92d49a2ee92e service nova] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:06.627335 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9fb4d136-ba77-4d5a-a69b-d3cf8d9d9f85 req-4e5d1444-6c54-4129-9cf8-92d49a2ee92e service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:06.627468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9fb4d136-ba77-4d5a-a69b-d3cf8d9d9f85 req-4e5d1444-6c54-4129-9cf8-92d49a2ee92e service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:06.627581 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9fb4d136-ba77-4d5a-a69b-d3cf8d9d9f85 req-4e5d1444-6c54-4129-9cf8-92d49a2ee92e service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Processing event network-vif-plugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:19:06.628265 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:19:06.630734 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938346.6304414, f5e01cbd-878f-494d-96ed-bdb75d04cbdd => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:06.630880 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] VM Resumed (Lifecycle Event)
May 28 03:19:06.632106 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:19:06.635053 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Instance spawned successfully.
May 28 03:19:06.635447 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:19:07.133882 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:07.136742 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:19:07.144112 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:07.144317 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:07.144644 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:07.144898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:07.145200 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:07.145509 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:07.642195 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:19:07.650232 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Took 11.42 seconds to spawn the instance on the hypervisor.
May 28 03:19:07.650412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:08.159395 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Took 21.74 seconds to build instance.
May 28 03:19:08.250867 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:08.660627 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.248s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:08.678660 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-90bac5b6-f902-4bae-a350-1f727f8afc60 req-3cc24993-dbb6-46f9-beee-b4b2a57720bb service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-vif-plugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:08.678827 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-90bac5b6-f902-4bae-a350-1f727f8afc60 req-3cc24993-dbb6-46f9-beee-b4b2a57720bb service nova] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:08.679014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-90bac5b6-f902-4bae-a350-1f727f8afc60 req-3cc24993-dbb6-46f9-beee-b4b2a57720bb service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:08.679130 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-90bac5b6-f902-4bae-a350-1f727f8afc60 req-3cc24993-dbb6-46f9-beee-b4b2a57720bb service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:08.679269 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-90bac5b6-f902-4bae-a350-1f727f8afc60 req-3cc24993-dbb6-46f9-beee-b4b2a57720bb service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] No waiting events found dispatching network-vif-plugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:19:08.679381 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-90bac5b6-f902-4bae-a350-1f727f8afc60 req-3cc24993-dbb6-46f9-beee-b4b2a57720bb service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received unexpected event network-vif-plugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae for instance with vm_state active and task_state None.
May 28 03:19:09.200701 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:09.200826 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:09.201002 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:09.201138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:09.201274 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:09.203055 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Terminating instance
May 28 03:19:09.705815 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:19:09.719661 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:09.736076 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:09.738526 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:09.756802 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:09.993853 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:09.998414 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:10.027333 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999721333000252 future=<Future at 0x7e4b4055e180 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:10.028391 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998729926000124 future=<Future at 0x7e4b4055e180 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:10.028479 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998549580000144 future=<Future at 0x7e4b4055e180 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:10.030618 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Instance destroyed successfully.
May 28 03:19:10.031033 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid f5e01cbd-878f-494d-96ed-bdb75d04cbdd {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:19:10.321849 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:10.535124 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:18:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1824432203',display_name='tempest-TestVolumeBootPattern-server-1824432203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1824432203',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:19:07Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-z8wv758l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:19:08Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=f5e01cbd-878f-494d-96ed-bdb75d04cbdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:19:10.535350 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "address": "fa:16:3e:85:1b:be", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b8af38e-d0", "ovs_interfaceid": "9b8af38e-d0c4-4a87-bb96-17a1ad90bfae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:19:10.535856 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:1b:be,bridge_name='br-int',has_traffic_filtering=True,id=9b8af38e-d0c4-4a87-bb96-17a1ad90bfae,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b8af38e-d0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:19:10.536059 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:1b:be,bridge_name='br-int',has_traffic_filtering=True,id=9b8af38e-d0c4-4a87-bb96-17a1ad90bfae,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b8af38e-d0') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:19:10.537343 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:10.537604 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b8af38e-d0, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:10.546671 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:10.547692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:10.548320 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:10.548493 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f288f40-9d3d-437f-9cc3-3cf6ff947dae) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:10.548907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:10.549393 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:10.550967 np0000001589 nova-compute[98297]: INFO os_vif [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:1b:be,bridge_name='br-int',has_traffic_filtering=True,id=9b8af38e-d0c4-4a87-bb96-17a1ad90bfae,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b8af38e-d0')
May 28 03:19:10.552317 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:19:10.552610 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:19:10.552827 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:10.553157 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:10.553450 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:19:10.553587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:19:10.575029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:10.575029 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:10.575029 np0000001589 nova-compute[98297]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:19:10.575029 np0000001589 nova-compute[98297]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:19:10.575029 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:10.575287 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:10.575287 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:10.575287 np0000001589 nova-compute[98297]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:19:10.575287 np0000001589 nova-compute[98297]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a (non-flash)
May 28 03:19:10.575287 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:10.575287 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', '208')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:19:10.575516 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', '207')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:19:10.576130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a', '208')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:19:10.576746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40547c40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:19:10.576918 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:19:10.577111 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 33000000060d416ed {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:19:10.637498 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:19:10.682663 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:19:10.730624 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-vif-unplugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] No waiting events found dispatching network-vif-unplugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-vif-unplugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-vif-unplugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] Acquiring lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] No waiting events found dispatching network-vif-unplugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:19:10.733094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2acf471d-35ff-45e0-923f-b59a1c11a792 req-403eb25c-d3ef-407f-bf07-74cd8aa21db0 service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-vif-unplugged-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:19:10.737585 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:19:10.737952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:19:10.738738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:19:10.749771 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:19:10.749940 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:19:10.760403 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:10.782774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.40.100,3260]
May 28 03:19:10.782774 np0000001589 nova-compute[98297]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.40.100,3260] successful.
May 28 03:19:10.782774 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:10.796093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:10.806545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:10.831626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.50.100,3260]
May 28 03:19:10.831626 np0000001589 nova-compute[98297]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-4ff063bf-bb9d-4734-bb1a-fc0163b3769a, portal: 192.168.50.100,3260] successful.
May 28 03:19:10.831626 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:10.843753 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:10.843935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:10.844057 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (291ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:19:10.844175 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:19:10.844464 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Deleting instance files /opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd_del
May 28 03:19:10.844931 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Deletion of /opt/stack/data/nova/instances/f5e01cbd-878f-494d-96ed-bdb75d04cbdd_del complete
May 28 03:19:11.350811 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Took 1.64 seconds to destroy the instance on the hypervisor.
May 28 03:19:11.351463 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:19:11.351786 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:19:11.351905 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:19:11.352180 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:11.415039 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:12.107905 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:12.609726 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Took 1.26 seconds to deallocate network for instance.
May 28 03:19:12.780312 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-72323bf2-befa-486b-a920-af667fecd4d3 req-4cf6a982-e532-478c-acd7-c407485f01f3 service nova] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Received event network-vif-deleted-9b8af38e-d0c4-4a87-bb96-17a1ad90bfae {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:13.162575 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Took 0.55 seconds to detach 1 volumes for instance.
May 28 03:19:13.163246 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Deleting volume: 4ff063bf-bb9d-4734-bb1a-fc0163b3769a {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:19:13.262413 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:13.696666 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:13.696840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:13.816910 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:19:13.817116 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:19:14.319504 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:19:14.583389 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:14.825838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.129s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:14.832062 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:14.832236 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing instance network info cache due to event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:19:14.833870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] Acquiring lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:14.834041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] Acquired lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:14.834152 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:19:14.871733 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance f5e01cbd-878f-494d-96ed-bdb75d04cbdd
May 28 03:19:15.290350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:15.290501 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:15.335960 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:15.549755 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:15.650646 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:15.759869 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updated VIF entry in instance network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:19:15.760062 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:15.792860 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Detaching volume 45bef9e2-d456-47bc-9c64-2b5eea1c9b7e
May 28 03:19:15.826354 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Attempting to driver detach volume 45bef9e2-d456-47bc-9c64-2b5eea1c9b7e from mountpoint /dev/vdb
May 28 03:19:15.833478 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Found disk vdb by alias ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:19:15.836938 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Found disk vdb by alias ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:19:15.837082 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Attempting to detach device vdb from instance 00cd655c-7eb1-4dd3-b320-fe38811c1834 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:19:15.837392 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:19:15.837392 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:19:15.837392 np0000001589 nova-compute[98297]:   <alias name="ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e"/>
May 28 03:19:15.837392 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:19:15.837392 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:19:15.837392 np0000001589 nova-compute[98297]:   <serial>45bef9e2-d456-47bc-9c64-2b5eea1c9b7e</serial>
May 28 03:19:15.837392 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:19:15.837392 np0000001589 nova-compute[98297]: </disk>
May 28 03:19:15.837392 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:19:15.842382 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully detached device vdb from instance 00cd655c-7eb1-4dd3-b320-fe38811c1834 from the persistent domain config.
May 28 03:19:15.842533 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] (1/8): Attempting to detach device vdb with device alias ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e from instance 00cd655c-7eb1-4dd3-b320-fe38811c1834 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:19:15.842776 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:19:15.842776 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:19:15.842776 np0000001589 nova-compute[98297]:   <alias name="ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e"/>
May 28 03:19:15.842776 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-1"/>
May 28 03:19:15.842776 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:19:15.842776 np0000001589 nova-compute[98297]:   <serial>45bef9e2-d456-47bc-9c64-2b5eea1c9b7e</serial>
May 28 03:19:15.842776 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 28 03:19:15.842776 np0000001589 nova-compute[98297]: </disk>
May 28 03:19:15.842776 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:19:15.879315 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-9b8ef4c1-e408-4c60-ac8f-b9a633c0bf8a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "f5e01cbd-878f-494d-96ed-bdb75d04cbdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.678s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:16.063056 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:16.261782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] Releasing lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:16.261937 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:16.262037 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing instance network info cache due to event network-changed-5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:19:16.262181 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] Acquiring lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:16.262364 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] Acquired lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:16.262397 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Refreshing network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:19:16.335481 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938356.334936, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:19:16.336711 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e for instance 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:19:16.339208 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully detached device vdb from instance 00cd655c-7eb1-4dd3-b320-fe38811c1834 from the live domain config.
May 28 03:19:16.340214 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:19:16.340486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:19:16.340587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:16.340889 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:16.341143 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:19:16.341272 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:19:16.361768 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:16.361768 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:16.361768 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:16.361881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:16.361881 np0000001589 nova-compute[98297]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e (non-flash)
May 28 03:19:16.361881 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:16.362012 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '206')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:19:16.362094 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '205')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:19:16.362900 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e', '206')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:19:16.363547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40585080>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:19:16.363808 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:19:16.363930 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flush multipath device 330000000a8733c60 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:19:16.396579 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:19:16.443730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:19:16.492189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:19:16.492402 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:19:16.493066 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:19:16.503533 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:19:16.503694 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:19:16.514055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:16.539091 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260]
May 28 03:19:16.539091 np0000001589 nova-compute[98297]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.40.100,3260] successful.
May 28 03:19:16.539091 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:16.550143 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:16.560587 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:16.587133 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260]
May 28 03:19:16.587133 np0000001589 nova-compute[98297]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-45bef9e2-d456-47bc-9c64-2b5eea1c9b7e, portal: 192.168.50.100,3260] successful.
May 28 03:19:16.587133 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:16.598218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:16.598218 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:16.598402 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== disconnect_volume: return (257ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:19:16.598402 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:19:16.764170 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:17.011523 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:17.132057 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updated VIF entry in instance network info cache for port 5708b542-7cfc-4ac9-8c9d-2893fea4189e. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:19:17.132506 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [{"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:17.147682 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'flavor' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:19:17.634651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ff2bf38b-e5e4-4721-bab3-4381b4421652 req-ef403a92-cfae-499f-940d-8e300483b0df service nova] Releasing lock "refresh_cache-00cd655c-7eb1-4dd3-b320-fe38811c1834" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:18.152480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d265b866-ca1a-4674-bbcc-ee6e047ae236 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.862s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:18.275341 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:19.609046 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:19.609480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:19.609546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:19.609703 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:19.609814 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:19.612375 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Terminating instance
May 28 03:19:20.115131 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:19:20.129897 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.131490 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.146703 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.147388 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.165760 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.259776 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3ec79d8f-20f7-4ea4-9872-76899b646098 req-411b7d7f-4d2a-40f7-beff-28cc74034680 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:20.260153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3ec79d8f-20f7-4ea4-9872-76899b646098 req-411b7d7f-4d2a-40f7-beff-28cc74034680 service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:20.260311 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3ec79d8f-20f7-4ea4-9872-76899b646098 req-411b7d7f-4d2a-40f7-beff-28cc74034680 service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:20.260441 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3ec79d8f-20f7-4ea4-9872-76899b646098 req-411b7d7f-4d2a-40f7-beff-28cc74034680 service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:20.260554 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3ec79d8f-20f7-4ea4-9872-76899b646098 req-411b7d7f-4d2a-40f7-beff-28cc74034680 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] No waiting events found dispatching network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:19:20.260694 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3ec79d8f-20f7-4ea4-9872-76899b646098 req-411b7d7f-4d2a-40f7-beff-28cc74034680 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:19:20.420868 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.446321 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999726212000041 future=<Future at 0x7e4b404cb830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:20.448465 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Instance destroyed successfully.
May 28 03:19:20.448951 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'resources' on Instance uuid 00cd655c-7eb1-4dd3-b320-fe38811c1834 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:19:20.550187 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.951427 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1726996886',display_name='tempest-TestMinimumBasicScenario-server-1726996886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-1726996886',id=69,image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5tzzJCLbVanD3idP7BCCwkQ9/vm3gdJ0H3M5nmiW7eDnPjDlVbg5fNTX2qoIMOakmQZE8hGh1e6DUqjgzkne66VhceFzSw/gyLKfS4BvzalRpzic5f3Ob35pmMk9hpg==',key_name='tempest-TestMinimumBasicScenario-1862345335',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:18:10Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-xo6klmpx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1cc944cd-03da-4f59-8021-93beb7b72ccb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:18:50Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=00cd655c-7eb1-4dd3-b320-fe38811c1834,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:19:20.951951 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "address": "fa:16:3e:b5:e5:d4", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5708b542-7c", "ovs_interfaceid": "5708b542-7cfc-4ac9-8c9d-2893fea4189e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:19:20.952130 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:19:20.952368 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:19:20.953141 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.953320 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5708b542-7c, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:20.954510 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.955643 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:20.956136 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.956310 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=096ac836-3e90-41f5-b024-0efff47985a4) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:20.956699 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:20.957122 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:20.958658 np0000001589 nova-compute[98297]: INFO os_vif [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:e5:d4,bridge_name='br-int',has_traffic_filtering=True,id=5708b542-7cfc-4ac9-8c9d-2893fea4189e,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5708b542-7c')
May 28 03:19:20.958906 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Deleting instance files /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834_del
May 28 03:19:20.959608 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Deletion of /opt/stack/data/nova/instances/00cd655c-7eb1-4dd3-b320-fe38811c1834_del complete
May 28 03:19:21.093372 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:21.093524 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:21.465478 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Took 1.35 seconds to destroy the instance on the hypervisor.
May 28 03:19:21.466031 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:19:21.466380 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:19:21.466478 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:19:21.466701 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:21.524153 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:21.595061 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:19:21.771722 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75c4fa7d-bd3e-487e-9b15-6e53e59570ec req-c822f353-31ff-4511-a2c6-720c007fa458 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-deleted-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:21.772118 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-75c4fa7d-bd3e-487e-9b15-6e53e59570ec req-c822f353-31ff-4511-a2c6-720c007fa458 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Neutron deleted interface 5708b542-7cfc-4ac9-8c9d-2893fea4189e; detaching it from the instance and deleting it from the info cache
May 28 03:19:21.773554 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75c4fa7d-bd3e-487e-9b15-6e53e59570ec req-c822f353-31ff-4511-a2c6-720c007fa458 service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Detach interface failed, port_id=5708b542-7cfc-4ac9-8c9d-2893fea4189e, reason: Instance 00cd655c-7eb1-4dd3-b320-fe38811c1834 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:19:22.138345 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:22.138629 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:22.141357 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:19:22.141490 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Claim successful on node np0000001589
May 28 03:19:22.231839 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:22.315287 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-da1d3ff5-ff2f-40bf-b9e8-0117cf5b0e90 req-3badd0e3-ec82-413b-9da0-f7bfd42da4ba service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:22.315462 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-da1d3ff5-ff2f-40bf-b9e8-0117cf5b0e90 req-3badd0e3-ec82-413b-9da0-f7bfd42da4ba service nova] Acquiring lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:22.315622 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-da1d3ff5-ff2f-40bf-b9e8-0117cf5b0e90 req-3badd0e3-ec82-413b-9da0-f7bfd42da4ba service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:22.315736 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-da1d3ff5-ff2f-40bf-b9e8-0117cf5b0e90 req-3badd0e3-ec82-413b-9da0-f7bfd42da4ba service nova] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:22.315855 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-da1d3ff5-ff2f-40bf-b9e8-0117cf5b0e90 req-3badd0e3-ec82-413b-9da0-f7bfd42da4ba service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] No waiting events found dispatching network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:19:22.315963 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-da1d3ff5-ff2f-40bf-b9e8-0117cf5b0e90 req-3badd0e3-ec82-413b-9da0-f7bfd42da4ba service nova] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Received event network-vif-unplugged-5708b542-7cfc-4ac9-8c9d-2893fea4189e for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:19:22.733359 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Took 1.27 seconds to deallocate network for instance.
May 28 03:19:23.238440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:23.261731 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:19:23.261914 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:19:23.764132 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:19:24.271448 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:24.271896 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:19:24.273863 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.033s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:24.388925 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:19:24.389129 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:19:24.777166 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:19:24.777980 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:19:24.777980 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:24.777980 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:24.839161 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:19:24.891569 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:19:25.027509 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00035266599979877356 future=<Future at 0x7e4b4055e180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:25.028020 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779938350.0269606, f5e01cbd-878f-494d-96ed-bdb75d04cbdd => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:25.028145 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:25.028331 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] VM Stopped (Lifecycle Event)
May 28 03:19:25.029315 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.416755503000331 future=<Future at 0x7e4b404cb830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:25.029414 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=10.416598631999932 future=<Future at 0x7e4b404cb830 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:25.206241 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Successfully created port: e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:19:25.279926 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:19:25.397995 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.126s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:25.450410 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Deleted allocations for instance 00cd655c-7eb1-4dd3-b320-fe38811c1834
May 28 03:19:25.531073 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: f5e01cbd-878f-494d-96ed-bdb75d04cbdd] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:25.614896 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Successfully updated port: e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:19:25.665106 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-changed-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:25.665238 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Refreshing instance network info cache due to event network-changed-e240ecf4-625f-4e00-9f47-9157297f9694. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:19:25.665387 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] Acquiring lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:25.665630 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] Acquired lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:25.665726 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Refreshing network info cache for port e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:19:25.782690 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:19:25.957652 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:26.116680 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:26.167276 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:26.221645 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:19:26.288248 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Booting with volume c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 at /dev/vda
May 28 03:19:26.326065 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:19:26.335325 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:26.338500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:19:26.358301 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:26.404981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:19:26.405199 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:19:26.412751 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:19:26.413535 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40'] 
May 28 03:19:26.413633 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:19:26.413738 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:19:26.414003 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:19:26.414174 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Updating existing volume attachment record: a19c948b-aabd-4d54-b09b-0672874242eb {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:19:26.459490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3b8f41f3-5560-477e-92bd-7d0799d08813 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "00cd655c-7eb1-4dd3-b320-fe38811c1834" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.850s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:26.837581 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bd5b215a-bedc-4145-8589-9643651db55b req-65a881b7-8079-4933-80a5-d8b2704d102f service nova] Releasing lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:26.838088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:26.838290 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:19:27.391311 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:19:27.519693 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:27.627269 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Updating instance_info_cache with network_info: [{"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:28.128961 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:28.129238 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Instance network_info: |[{"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:19:28.498800 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:19:28.500254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:19:28.500531 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Creating image(s)
May 28 03:19:28.500849 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:19:28.500995 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Ensure instance console log exists: /opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:19:28.501272 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:28.501486 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:28.501643 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:28.502197 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Start _get_guest_xml network_info=[{"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'a19c948b-aabd-4d54-b09b-0672874242eb', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '365e0b89-d6ac-4681-ae36-1ca287152972', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'serial': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:19:28.506617 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:19:28.507884 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-1140268347', uuid='365e0b89-d6ac-4681-ae36-1ca287152972'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938368.507509) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:19:28.508949 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:19:28.509503 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:19:28.510614 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:19:28.510800 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:19:28.511834 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:19:28.512162 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:19:28.512344 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:19:28.512459 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:19:28.512613 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:19:28.512724 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:19:28.512848 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:19:28.513025 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:19:28.513166 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:19:28.513320 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:19:28.513449 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:19:28.513593 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:19:28.526343 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:19:28.526766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:19:28.526942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:28.527371 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:28.527622 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:19:28.541001 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:28.541638 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:28.542177 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:28.542405 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:19:28.542795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:28.542981 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:19:28.554951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:19:28.554951 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:28.559543 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:19:28.559543 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:28.566143 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26] added
May 28 03:19:28.566143 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:19:28.566143 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:28.566143 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:28.566143 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:28.566143 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:28.566143 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:28.566330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:19:28.566572 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:19:28.566757 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:19:28.570246 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26] added
May 28 03:19:28.570246 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:19:28.570246 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:28.570246 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:28.570246 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:28.570246 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:28.570246 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:28.570407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:19:28.570524 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:19:28.570638 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:19:29.567163 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:19:29.571093 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:19:29.577980 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:19:29.577980 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:19:29.584491 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:19:29.584491 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:29.590714 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:29.595443 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:29.601501 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:19:29.601501 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:29.601606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:19:29.601606 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:29.601707 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:19:29.601707 np0000001589 nova-compute[98297]: 
May 28 03:19:29.606850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:19:29.606850 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:29.607050 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:19:29.607050 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:29.607107 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:19:29.607107 np0000001589 nova-compute[98297]: 
May 28 03:19:29.878741 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:29.878938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:30.380463 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:19:30.635711 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.40.100,3260]
May 28 03:19:30.635711 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.40.100,3260] successful.
May 28 03:19:30.635711 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:30.637332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.50.100,3260]
May 28 03:19:30.637332 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.50.100,3260] successful.
May 28 03:19:30.637332 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:30.647284 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:30.651854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:30.661770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.661770 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.661770 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:30.661910 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.661910 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.661910 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:30.662166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.120s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:30.662296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:19:30.662769 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('7', '-', '-', 0) found on session 209 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:19:30.662941 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:19:30.663304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.663304 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.663304 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:30.663440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.663440 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:30.663440 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:30.663676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.121s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:30.663981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:19:30.664364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('8', '-', '-', 0) found on session 210 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:19:30.664490 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:19:30.678613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 209 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:19:30.678613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:19:30.678613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 210 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:19:30.678613 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:19:30.923752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:30.923942 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:30.926989 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:19:30.927202 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Claim successful on node np0000001589
May 28 03:19:30.958283 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:31.542994 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:19:32.049113 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:19:32.049449 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:19:32.551891 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:19:32.559212 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 33000000013d37eef for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:19:32.559437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.032s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:32.559565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (4032ms) {'type': 'block', 'scsi_wwn': '33000000013d37eef', 'path': '/dev/dm-0', 'multipath_id': '33000000013d37eef'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:19:32.559664 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000013d37eef', 'path': '/dev/dm-0', 'multipath_id': '33000000013d37eef'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:19:33.058137 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.134s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:33.058643 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:19:33.064137 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1140268347',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1140268347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-volume-backed-server-1140268347',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4hPrcIqAwrjoopjDKT6Y8OCEEQKKukoVBQVGJx0OI/3weeVUTcC0CsvQZh5cF1D1nM/xrOtxdycd7AoEkli3oo9QuBMjYw7K/eBqcJeMKYS80TYdwiuVAlvNyi4gReDA==',key_name='tempest-keypair-887840945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-y81o2nrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=365e0b89-d6ac-4681-ae36-1ca287152972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:19:33.064340 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:19:33.064875 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d6:cf,bridge_name='br-int',has_traffic_filtering=True,id=e240ecf4-625f-4e00-9f47-9157297f9694,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240ecf4-62') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:19:33.065421 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid 365e0b89-d6ac-4681-ae36-1ca287152972 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:19:33.564725 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:19:33.565608 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:19:33.565876 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:33.566094 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:33.570709 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] End _get_guest_xml xml=<domain type="qemu">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <uuid>365e0b89-d6ac-4681-ae36-1ca287152972</uuid>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <name>instance-00000047</name>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1140268347</nova:name>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:19:28</nova:creationTime>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         <nova:port uuid="e240ecf4-625f-4e00-9f47-9157297f9694">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <system>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <entry name="serial">365e0b89-d6ac-4681-ae36-1ca287152972</entry>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <entry name="uuid">365e0b89-d6ac-4681-ae36-1ca287152972</entry>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </system>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <os>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   </os>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <features>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   </features>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   <devices>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972/disk.config"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </disk>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <alias name="ua-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <serial>c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26</serial>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </disk>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:99:d6:cf"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <target dev="tape240ecf4-62"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </interface>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972/console.log" append="off"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </serial>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <video>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </video>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </rng>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:   </devices>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]: </domain>
May 28 03:19:33.570709 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Preparing to wait for external event network-vif-plugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1140268347',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1140268347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-volume-backed-server-1140268347',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4hPrcIqAwrjoopjDKT6Y8OCEEQKKukoVBQVGJx0OI/3weeVUTcC0CsvQZh5cF1D1nM/xrOtxdycd7AoEkli3oo9QuBMjYw7K/eBqcJeMKYS80TYdwiuVAlvNyi4gReDA==',key_name='tempest-keypair-887840945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-y81o2nrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:19:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=365e0b89-d6ac-4681-ae36-1ca287152972,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:d6:cf,bridge_name='br-int',has_traffic_filtering=True,id=e240ecf4-625f-4e00-9f47-9157297f9694,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240ecf4-62') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d6:cf,bridge_name='br-int',has_traffic_filtering=True,id=e240ecf4-625f-4e00-9f47-9157297f9694,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240ecf4-62') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:33.573772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:19:33.574317 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:33.574472 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c33c100-f3a4-59c1-b3f7-93dc1472743d', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:33.576647 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:33.578682 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:33.578956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape240ecf4-62, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:33.579269 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape240ecf4-62, col_values=(('qos', UUID('caaaaced-e44c-4230-af9a-7c0bea1ed710')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:33.579417 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape240ecf4-62, col_values=(('external_ids', {'iface-id': 'e240ecf4-625f-4e00-9f47-9157297f9694', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:d6:cf', 'vm-uuid': '365e0b89-d6ac-4681-ae36-1ca287152972'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:33.580324 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:33.580990 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:33.585114 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:33.585882 np0000001589 nova-compute[98297]: INFO os_vif [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:d6:cf,bridge_name='br-int',has_traffic_filtering=True,id=e240ecf4-625f-4e00-9f47-9157297f9694,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240ecf4-62')
May 28 03:19:33.623526 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc6820ff3bfd4e90a108c237bcfb235d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b78a160e3c24b99b0760e4c18e688e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:19:33.946731 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Successfully created port: edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:19:34.065441 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:19:34.361969 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Successfully updated port: edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:19:34.404870 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-changed-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:34.405813 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing instance network info cache due to event network-changed-edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:19:34.405975 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] Acquiring lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:34.406101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] Acquired lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:34.406244 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing network info cache for port edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:19:34.568004 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:19:34.863750 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:34.907934 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:34.961362 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:19:35.075481 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:35.098785 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:35.098900 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:35.098971 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:99:d6:cf, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:19:35.099306 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Using config drive
May 28 03:19:35.446496 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00042950999977620086 future=<Future at 0x7e4b404cb830 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:35.447189 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:19:35.447368 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] Emitting event <LifecycleEvent: 1779938360.4459658, 00cd655c-7eb1-4dd3-b320-fe38811c1834 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:35.447500 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] VM Stopped (Lifecycle Event)
May 28 03:19:35.576787 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:19:35.577833 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-61ed2ad7-fe06-4c13-abd6-39171c66e08c req-458738ff-579d-4467-8514-ddcbf27e91ba service nova] Releasing lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:35.578134 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:19:35.578340 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquired lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:35.578560 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Creating image(s)
May 28 03:19:35.578927 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:19:35.579768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "/opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:35.579979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "/opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:35.580615 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "/opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:35.580712 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "b2dc94460dfd34fe10adb6c430d5eccc38198bf6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:35.580976 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "b2dc94460dfd34fe10adb6c430d5eccc38198bf6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:35.603381 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:35.706453 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Creating config drive at /opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972/disk.config
May 28 03:19:35.710024 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7alqi8xr {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:35.774848 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7alqi8xr" returned: 0 in 0.064s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:35.950100 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-07c6433a-5628-461a-b473-5a5a59be75c3 tempest-AttachVolumeMultiAttachTest-1379082653 tempest-AttachVolumeMultiAttachTest-1379082653-project-member] [instance: 00cd655c-7eb1-4dd3-b320-fe38811c1834] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:35.987211 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:19:35.990511 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:19:35.991124 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.part --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.078131 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.part --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.078660 np0000001589 nova-compute[98297]: DEBUG nova.virt.images [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] 8128eb85-abf4-4a30-8857-903ca87c5a97 was qcow2, converting to raw {{(pid=98297) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 28 03:19:36.079018 np0000001589 nova-compute[98297]: DEBUG nova.privsep.utils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98297) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 28 03:19:36.079287 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.part /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.converted {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.154257 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:19:36.181282 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:36.202211 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:36.220644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.part /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.converted" returned: 0 in 0.141s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.225576 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.converted --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.301052 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:36.305950 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:36.340451 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6.converted --force-share --output=json" returned: 0 in 0.115s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.341038 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "b2dc94460dfd34fe10adb6c430d5eccc38198bf6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.760s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:36.341445 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:19:36.345524 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:19:36.347348 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.395079 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3cf72b84-17ae-4ee1-842d-dde1779ad44f req-5e4c6c5b-4f3f-447b-8c1c-3243287a92af service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-vif-plugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:36.397297 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3cf72b84-17ae-4ee1-842d-dde1779ad44f req-5e4c6c5b-4f3f-447b-8c1c-3243287a92af service nova] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:36.397433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3cf72b84-17ae-4ee1-842d-dde1779ad44f req-5e4c6c5b-4f3f-447b-8c1c-3243287a92af service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:36.397637 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-3cf72b84-17ae-4ee1-842d-dde1779ad44f req-5e4c6c5b-4f3f-447b-8c1c-3243287a92af service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:36.397806 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3cf72b84-17ae-4ee1-842d-dde1779ad44f req-5e4c6c5b-4f3f-447b-8c1c-3243287a92af service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Processing event network-vif-plugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:19:36.406095 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:36.440085 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6 --force-share --output=json" returned: 0 in 0.093s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.440468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "b2dc94460dfd34fe10adb6c430d5eccc38198bf6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:36.440815 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "b2dc94460dfd34fe10adb6c430d5eccc38198bf6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:36.441163 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:19:36.443676 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:19:36.443993 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.532242 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:36.533076 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6 --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.533345 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:36.535840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6,backing_fmt=raw /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.548848 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:36.597117 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:36.599266 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6,backing_fmt=raw /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk 1073741824" returned: 0 in 0.066s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.599800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "b2dc94460dfd34fe10adb6c430d5eccc38198bf6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.159s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:36.600146 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6 --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.690921 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b2dc94460dfd34fe10adb6c430d5eccc38198bf6 --force-share --output=json" returned: 0 in 0.090s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.691389 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:19:36.691693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:36.778504 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:36.778857 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Cannot resize image /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:19:36.779271 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:19:36.779435 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Ensure instance console log exists: /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:19:36.779707 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:36.779948 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:36.780073 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:36.883532 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938376.883148, 365e0b89-d6ac-4681-ae36-1ca287152972 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:36.883695 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] VM Started (Lifecycle Event)
May 28 03:19:36.885823 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:19:36.887992 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:19:36.890730 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Instance spawned successfully.
May 28 03:19:36.891108 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:19:37.101425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Releasing lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:37.101845 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance network_info: |[{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:19:37.103450 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Start _get_guest_xml network_info=[{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T03:19:28Z,direct_url=<?>,disk_format='qcow2',id=8128eb85-abf4-4a30-8857-903ca87c5a97,min_disk=0,min_ram=0,name='tempest-scenario-img--2116533429',owner='6b78a160e3c24b99b0760e4c18e688e3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T03:19:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': '8128eb85-abf4-4a30-8857-903ca87c5a97'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:19:37.105914 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:19:37.107128 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='8128eb85-abf4-4a30-8857-903ca87c5a97', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-833059047', uuid='1fa7922a-c053-4633-bd71-4818cfae11d5'), owner=OwnerMeta(userid='bc6820ff3bfd4e90a108c237bcfb235d', username='tempest-TestMinimumBasicScenario-62402083-project-member', projectid='6b78a160e3c24b99b0760e4c18e688e3', projectname='tempest-TestMinimumBasicScenario-62402083'), image=ImageMeta(id='8128eb85-abf4-4a30-8857-903ca87c5a97', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938377.106819) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:19:37.108191 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:19:37.108543 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:19:37.110164 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:19:37.110376 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:19:37.111727 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:19:37.112156 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T03:19:28Z,direct_url=<?>,disk_format='qcow2',id=8128eb85-abf4-4a30-8857-903ca87c5a97,min_disk=0,min_ram=0,name='tempest-scenario-img--2116533429',owner='6b78a160e3c24b99b0760e4c18e688e3',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T03:19:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:19:37.112360 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:19:37.112464 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:19:37.112601 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:19:37.112681 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:19:37.112769 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:19:37.112906 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:19:37.113071 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:19:37.113191 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:19:37.113310 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:19:37.113423 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:19:37.124553 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:19:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-833059047',display_name='tempest-TestMinimumBasicScenario-server-833059047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-833059047',id=72,image_ref='8128eb85-abf4-4a30-8857-903ca87c5a97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGajBPgwQA/weAFew3BohQfGwDTnusOoPoQPEjhds82CO01bjVWh4SARr0yui/91swcSrsv7wdAFqgQFDDQhjPWx/BjjhuvxIZX9/ZQ+rK7VpGWaJgOKmwxnEzvpjuG/zw==',key_name='tempest-TestMinimumBasicScenario-463016163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-lmuhwuy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8128eb85-abf4-4a30-8857-903ca87c5a97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:19:35Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=1fa7922a-c053-4633-bd71-4818cfae11d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:19:37.124739 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:19:37.125360 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:77:e5,bridge_name='br-int',has_traffic_filtering=True,id=edb6970b-a010-4425-8374-736296d41cba,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb6970b-a0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:19:37.125922 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fa7922a-c053-4633-bd71-4818cfae11d5 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:19:37.387471 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:37.388829 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:19:37.397440 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:37.397572 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:37.397782 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:37.397995 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:37.398381 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:37.398691 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:37.628857 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] End _get_guest_xml xml=<domain type="qemu">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <uuid>1fa7922a-c053-4633-bd71-4818cfae11d5</uuid>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <name>instance-00000048</name>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestMinimumBasicScenario-server-833059047</nova:name>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:19:37</nova:creationTime>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:image uuid="8128eb85-abf4-4a30-8857-903ca87c5a97">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:properties/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:user uuid="bc6820ff3bfd4e90a108c237bcfb235d">tempest-TestMinimumBasicScenario-62402083-project-member</nova:user>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:project uuid="6b78a160e3c24b99b0760e4c18e688e3">tempest-TestMinimumBasicScenario-62402083</nova:project>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="8128eb85-abf4-4a30-8857-903ca87c5a97"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         <nova:port uuid="edb6970b-a010-4425-8374-736296d41cba">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <system>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <entry name="serial">1fa7922a-c053-4633-bd71-4818cfae11d5</entry>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <entry name="uuid">1fa7922a-c053-4633-bd71-4818cfae11d5</entry>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </system>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <os>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   </os>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <features>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   </features>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   <devices>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </disk>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk.config"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </disk>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:13:77:e5"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <target dev="tapedb6970b-a0"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </interface>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/console.log" append="off"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </serial>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <video>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </video>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </rng>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:   </devices>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]: </domain>
May 28 03:19:37.628857 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:19:37.630678 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Preparing to wait for external event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:19:37.630678 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:37.630678 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:37.630678 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:37.630678 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:19:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-833059047',display_name='tempest-TestMinimumBasicScenario-server-833059047',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-833059047',id=72,image_ref='8128eb85-abf4-4a30-8857-903ca87c5a97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGajBPgwQA/weAFew3BohQfGwDTnusOoPoQPEjhds82CO01bjVWh4SARr0yui/91swcSrsv7wdAFqgQFDDQhjPWx/BjjhuvxIZX9/ZQ+rK7VpGWaJgOKmwxnEzvpjuG/zw==',key_name='tempest-TestMinimumBasicScenario-463016163',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-lmuhwuy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8128eb85-abf4-4a30-8857-903ca87c5a97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:19:35Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=1fa7922a-c053-4633-bd71-4818cfae11d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:19:37.630944 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:19:37.631441 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:77:e5,bridge_name='br-int',has_traffic_filtering=True,id=edb6970b-a010-4425-8374-736296d41cba,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb6970b-a0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:19:37.631747 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:77:e5,bridge_name='br-int',has_traffic_filtering=True,id=edb6970b-a010-4425-8374-736296d41cba,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb6970b-a0') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:19:37.632138 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:37.632695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:37.632964 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:19:37.633669 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:37.633805 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b534045b-3dcc-5460-9f63-66362a26cb95', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:37.634570 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:37.635380 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:37.635707 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:37.637454 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:37.637595 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedb6970b-a0, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:37.637865 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedb6970b-a0, col_values=(('qos', UUID('1fcde2b5-c23e-4076-99f6-cffdaf04e89f')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:37.638025 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedb6970b-a0, col_values=(('external_ids', {'iface-id': 'edb6970b-a010-4425-8374-736296d41cba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:77:e5', 'vm-uuid': '1fa7922a-c053-4633-bd71-4818cfae11d5'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:19:37.639097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:37.639985 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:19:37.643439 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:37.644317 np0000001589 nova-compute[98297]: INFO os_vif [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:77:e5,bridge_name='br-int',has_traffic_filtering=True,id=edb6970b-a010-4425-8374-736296d41cba,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb6970b-a0')
May 28 03:19:37.890950 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:19:37.892190 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938377.8911526, 365e0b89-d6ac-4681-ae36-1ca287152972 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:37.892190 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] VM Paused (Lifecycle Event)
May 28 03:19:37.902860 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Took 9.40 seconds to spawn the instance on the hypervisor.
May 28 03:19:37.903233 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:38.137806 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:38.138330 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:38.292571 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:38.394100 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:38.396842 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938378.3957381, 365e0b89-d6ac-4681-ae36-1ca287152972 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:38.396842 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] VM Resumed (Lifecycle Event)
May 28 03:19:38.411089 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Took 16.31 seconds to build instance.
May 28 03:19:38.451733 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bec787a3-8c34-4b9d-8519-d5842e7c0991 req-255060ea-7180-42d8-a586-1018e449d31b service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-vif-plugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:38.451733 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bec787a3-8c34-4b9d-8519-d5842e7c0991 req-255060ea-7180-42d8-a586-1018e449d31b service nova] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:38.451733 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bec787a3-8c34-4b9d-8519-d5842e7c0991 req-255060ea-7180-42d8-a586-1018e449d31b service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:38.451733 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bec787a3-8c34-4b9d-8519-d5842e7c0991 req-255060ea-7180-42d8-a586-1018e449d31b service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:38.451733 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bec787a3-8c34-4b9d-8519-d5842e7c0991 req-255060ea-7180-42d8-a586-1018e449d31b service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] No waiting events found dispatching network-vif-plugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:19:38.451733 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-bec787a3-8c34-4b9d-8519-d5842e7c0991 req-255060ea-7180-42d8-a586-1018e449d31b service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received unexpected event network-vif-plugged-e240ecf4-625f-4e00-9f47-9157297f9694 for instance with vm_state active and task_state None.
May 28 03:19:38.899220 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:38.901861 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:19:38.912534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.819s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:39.158011 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:39.158484 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:39.158484 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No VIF found with MAC fa:16:3e:13:77:e5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:19:39.158611 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Using config drive
May 28 03:19:39.663441 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:39.761462 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Creating config drive at /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk.config
May 28 03:19:39.764240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc15v4xvr {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:39.820925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc15v4xvr" returned: 0 in 0.056s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:40.178638 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.202888 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.206925 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.291249 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.358587 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4d9ccaa-ae8d-458a-9ef0-844726e6135e req-844faf4d-36a1-4ab9-8f5a-4ea7b4ca52db service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:40.359208 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4d9ccaa-ae8d-458a-9ef0-844726e6135e req-844faf4d-36a1-4ab9-8f5a-4ea7b4ca52db service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:40.360480 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4d9ccaa-ae8d-458a-9ef0-844726e6135e req-844faf4d-36a1-4ab9-8f5a-4ea7b4ca52db service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:40.360840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a4d9ccaa-ae8d-458a-9ef0-844726e6135e req-844faf4d-36a1-4ab9-8f5a-4ea7b4ca52db service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:40.360911 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a4d9ccaa-ae8d-458a-9ef0-844726e6135e req-844faf4d-36a1-4ab9-8f5a-4ea7b4ca52db service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Processing event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:19:40.510736 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-changed-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:40.512651 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Refreshing instance network info cache due to event network-changed-e240ecf4-625f-4e00-9f47-9157297f9694. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:19:40.512651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] Acquiring lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:40.512651 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] Acquired lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:40.512651 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Refreshing network info cache for port e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:19:40.532144 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.535835 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.536977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.551999 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:40.875196 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938380.8747993, 1fa7922a-c053-4633-bd71-4818cfae11d5 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:40.875775 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:19:40.875963 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] VM Started (Lifecycle Event)
May 28 03:19:40.880061 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:19:40.886027 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance spawned successfully.
May 28 03:19:40.886400 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:19:41.014018 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:41.279240 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:41.378551 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:41.380561 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:19:41.392099 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:41.392238 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:41.392469 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:41.392682 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:41.392918 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:41.393491 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:19:41.398792 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Updated VIF entry in instance network info cache for port e240ecf4-625f-4e00-9f47-9157297f9694. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:19:41.398792 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Updating instance_info_cache with network_info: [{"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:41.882657 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:19:41.882857 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938381.8827195, 1fa7922a-c053-4633-bd71-4818cfae11d5 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:41.882961 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] VM Paused (Lifecycle Event)
May 28 03:19:41.900339 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Took 6.32 seconds to spawn the instance on the hypervisor.
May 28 03:19:41.900674 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:41.901312 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5be2e4d7-cd8f-435d-9187-6bcebe83fd6a req-63b66af0-f4ad-410e-89a9-592dbaa78b88 service nova] Releasing lock "refresh_cache-365e0b89-d6ac-4681-ae36-1ca287152972" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:42.137745 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:42.385161 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:42.387065 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938382.3868787, 1fa7922a-c053-4633-bd71-4818cfae11d5 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:19:42.387295 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] VM Resumed (Lifecycle Event)
May 28 03:19:42.406614 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-992b415d-73e1-4419-ba07-f899b4017ca4 req-7d00751b-30d2-4285-b306-0ac9cdd919e7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:42.407022 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-992b415d-73e1-4419-ba07-f899b4017ca4 req-7d00751b-30d2-4285-b306-0ac9cdd919e7 service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:42.407204 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-992b415d-73e1-4419-ba07-f899b4017ca4 req-7d00751b-30d2-4285-b306-0ac9cdd919e7 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:42.407370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-992b415d-73e1-4419-ba07-f899b4017ca4 req-7d00751b-30d2-4285-b306-0ac9cdd919e7 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:42.408027 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-992b415d-73e1-4419-ba07-f899b4017ca4 req-7d00751b-30d2-4285-b306-0ac9cdd919e7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] No waiting events found dispatching network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:19:42.408027 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-992b415d-73e1-4419-ba07-f899b4017ca4 req-7d00751b-30d2-4285-b306-0ac9cdd919e7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received unexpected event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba for instance with vm_state active and task_state None.
May 28 03:19:42.411623 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Took 11.53 seconds to build instance.
May 28 03:19:42.639691 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:42.641296 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:42.641507 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:42.641657 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:42.641838 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:19:42.890460 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:19:42.892273 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:19:42.913042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c85db6e-24f2-402e-aff8-8b542e5003e9 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.034s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:43.305743 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:43.660893 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:19:43.662328 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:43.756990 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:43.757440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:43.844497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:43.848511 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:19:43.850652 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:43.899098 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:19:43.899487 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13600MB free_disk=72.66361618041992GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:19:43.899652 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:43.899909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:44.892458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:44.892838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:44.951472 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 365e0b89-d6ac-4681-ae36-1ca287152972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:19:44.951584 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1fa7922a-c053-4633-bd71-4818cfae11d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:19:44.951771 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:19:44.951872 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:19:43 up 47 min,  2 users,  load average: 2.67, 4.53, 4.49\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_26deda1c00a84355951239b1a62997e8': '1', 'io_workload': '0', 'num_proj_6b78a160e3c24b99b0760e4c18e688e3': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:19:45.065238 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:19:45.065478 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:19:45.395754 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'flavor' on Instance uuid 1fa7922a-c053-4633-bd71-4818cfae11d5 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:19:45.568013 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:19:46.074864 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:19:46.075333 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.175s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:46.075486 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:46.400763 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:47.455334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:19:47.455773 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:19:47.455773 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Attaching volume a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f to /dev/vdb
May 28 03:19:47.490337 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:19:47.500924 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:19:47.520239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:19:47.573552 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:19:47.574061 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:19:47.582142 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:19:47.583160 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe99:d6cf', 'fe80::f861:80ff:fe4e:b461', 'fe80::fc16:3eff:fe13:77e5', 'fe80::d2:e0ff:fef0:5ce3'] 
May 28 03:19:47.583284 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:19:47.583411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:19:47.583642 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:19:47.583884 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating existing volume attachment record: 0cd5d12e-f83b-4a2c-bedb-bba90ebe70dc {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:19:47.642125 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:48.075634 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:48.075853 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:48.076046 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:48.076173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:19:48.076445 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.06 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:48.129873 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:19:48.130265 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:19:48.130430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:48.130954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:48.131141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:19:48.142712 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:48.143414 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:19:48.143843 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:48.144043 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:19:48.144459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:19:48.145298 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:19:48.155326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:19:48.155326 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:48.160061 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:19:48.160061 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:48.166422 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f] added
May 28 03:19:48.166422 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:19:48.166422 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:48.166422 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:48.166422 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:48.166422 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:48.166422 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:48.166746 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:19:48.166746 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0227(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:19:48.166840 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:19:48.170748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f] added
May 28 03:19:48.170748 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:19:48.170748 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:48.170748 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:48.170748 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:19:48.170748 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:19:48.170748 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:48.171042 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:19:48.171042 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:19:48.171174 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:19:48.312376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:49.167280 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:19:49.171478 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:19:49.179059 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:19:49.179059 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:19:49.185170 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:19:49.185170 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.190818 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.198663 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.204038 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.204038 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.204038 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:49.204261 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.204261 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.204261 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:49.209995 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.209995 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.209995 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:49.210187 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.210187 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.210187 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:49.236366 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.40.100,3260]
May 28 03:19:49.236366 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.40.100,3260] successful.
May 28 03:19:49.236366 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.240701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.50.100,3260]
May 28 03:19:49.240701 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.50.100,3260] successful.
May 28 03:19:49.240701 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.248386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.256250 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:19:49.268203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.268203 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.268203 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.268203 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.268203 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:49.268432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.268432 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.268432 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.268432 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.268432 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:49.268594 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:49.268687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:19:49.269296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] HCTL ('9', '-', '-', 0) found on session 211 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:19:49.269436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:19:49.270008 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.270008 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.270008 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.270008 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.270008 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:19:49.270154 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.270154 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:19:49.270154 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.270154 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:19:49.270154 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:19:49.270361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:49.270483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:19:49.271091 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] HCTL ('10', '-', '-', 0) found on session 212 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:19:49.271196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:19:49.283830 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching for a device in session 211 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:19:49.284034 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:19:49.290415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Searching for a device in session 212 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:19:49.290415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:19:50.138508 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:50.138760 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:50.144524 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:19:51.134072 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:51.134654 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:51.159917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Found WWN 3300000007f0363d9 for multipath device dm-3 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:19:51.160304 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:19:51.160559 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000007f0363d9', 'path': '/dev/dm-3', 'multipath_id': '3300000007f0363d9'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:19:51.160718 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f0363d9', 'path': '/dev/dm-3', 'multipath_id': '3300000007f0363d9'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:19:51.163671 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'flavor' on Instance uuid 1fa7922a-c053-4633-bd71-4818cfae11d5 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:19:51.667655 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Attempting to attach volume a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:19:51.669220 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:19:51.669220 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:19:51.669220 np0000001589 nova-compute[98297]:   <alias name="ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f"/>
May 28 03:19:51.669220 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-3"/>
May 28 03:19:51.669220 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:19:51.669220 np0000001589 nova-compute[98297]:   <serial>a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f</serial>
May 28 03:19:51.669220 np0000001589 nova-compute[98297]: </disk>
May 28 03:19:51.669220 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:19:51.777804 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:52.643819 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:53.133832 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:53.134152 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:53.306117 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:53.306299 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:53.306430 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:19:53.306560 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] No VIF found with MAC fa:16:3e:13:77:e5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:19:53.328856 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:54.137652 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:19:54.138083 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:19:54.850063 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7dbcf71d-def2-4742-b175-c6ae54ffe2c2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.394s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:19:55.895979 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-changed-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:55.896400 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing instance network info cache due to event network-changed-edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:19:55.896510 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] Acquiring lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:55.896592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] Acquired lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:55.896711 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing network info cache for port edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:19:56.398737 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:56.685279 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:56.821801 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updated VIF entry in instance network info cache for port edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:19:56.822138 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:57.324110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee2ad4e5-408c-4e71-9756-90d99131ca51 req-9956fe5c-757e-41ce-864f-5e9db24519f7 service nova] Releasing lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:19:57.646617 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:57.945658 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-changed-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:19:57.946005 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing instance network info cache due to event network-changed-edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:19:57.946153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] Acquiring lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:19:57.946255 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] Acquired lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:19:57.946378 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing network info cache for port edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:19:58.344059 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:19:58.448091 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:58.719300 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:19:58.833363 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updated VIF entry in instance network info cache for port edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:19:58.833618 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:19:59.335359 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-269d5dc7-4ae1-4175-82d1-1b25e52eab7c req-bd6ef429-7c35-4597-9def-8aa210a3e7f5 service nova] Releasing lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:20:02.649684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:03.354141 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:04.558586 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:06.116631 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:06.117176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:06.618826 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:20:07.168280 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:07.168588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:07.173334 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:20:07.173483 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Claim successful on node np0000001589
May 28 03:20:07.652488 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:08.330842 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:20:08.331216 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:20:08.367083 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:08.833602 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:20:09.340029 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.171s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:09.340641 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:20:09.844818 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:20:09.847583 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:20:09.847847 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:20:09.848130 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:09.848315 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:09.933856 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:20:10.350111 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:20:10.363912 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Successfully created port: c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:20:10.771131 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Successfully updated port: c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:20:10.812374 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-changed-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:10.812686 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Refreshing instance network info cache due to event network-changed-c6e26856-9990-4b8f-a7d9-a30410109037. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:20:10.812873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] Acquiring lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:20:10.812933 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] Acquired lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:20:10.813037 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Refreshing network info cache for port c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:20:10.854911 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Booting with volume snapshot 5ff5577a-fdb7-45bc-bfe1-47c7efe06d58 at /dev/vda
May 28 03:20:11.272952 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:20:11.314724 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:11.372525 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:20:11.484797 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:20:11.986466 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-6408eb1d-9dea-40c2-8abd-96d45f87f3a8 req-6a162c5d-dde4-47f2-99d3-6f2f780f9507 service nova] Releasing lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:20:11.986795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:20:11.986944 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:20:12.545303 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:20:12.655559 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:12.679859 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:12.798281 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Updating instance_info_cache with network_info: [{"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:20:13.300650 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:20:13.300650 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Instance network_info: |[{"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:20:13.376680 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:13.838386 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:13.838807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:13.838807 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Rebooting instance
May 28 03:20:14.216020 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:20:14.226607 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:20:14.246745 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:20:14.291327 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:20:14.291616 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:20:14.299711 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:20:14.300632 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe99:d6cf', 'fe80::f861:80ff:fe4e:b461', 'fe80::fc16:3eff:fe13:77e5', 'fe80::d2:e0ff:fef0:5ce3'] 
May 28 03:20:14.300778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:20:14.300881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:20:14.301093 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:20:14.301310 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Updating existing volume attachment record: c28c4c21-744d-4c5c-ad40-a416134b1177 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:20:14.396193 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:20:14.396334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquired lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:20:14.396464 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:20:14.898569 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:15.179369 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:15.318144 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:20:15.819938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Releasing lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:20:16.323487 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:16.389970 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:20:16.391050 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:20:16.391264 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Creating image(s)
May 28 03:20:16.391544 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:20:16.391647 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Ensure instance console log exists: /opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:20:16.391871 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:16.392026 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:16.392147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:16.392577 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Start _get_guest_xml network_info=[{"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T03:20:03Z,direct_url=<?>,disk_format='raw',id=ab047014-a1a9-4a0e-992f-98bcf2fe7659,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1801630528',owner='26deda1c00a84355951239b1a62997e8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T03:20:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'c28c4c21-744d-4c5c-ad40-a416134b1177', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '92bfc823-f4ab-4b8e-a91d-0428c149556f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'serial': 'd2687de9-8590-4df6-8b45-82527ebee9c4'}, 'delete_on_termination': True, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:20:16.394735 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:20:16.395699 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-121835496', uuid='92bfc823-f4ab-4b8e-a91d-0428c149556f'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='ab047014-a1a9-4a0e-992f-98bcf2fe7659', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938416.3954246) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:20:16.396624 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:20:16.396898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:20:16.397788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:20:16.397957 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:20:16.398779 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:20:16.399016 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-28T03:20:03Z,direct_url=<?>,disk_format='raw',id=ab047014-a1a9-4a0e-992f-98bcf2fe7659,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1801630528',owner='26deda1c00a84355951239b1a62997e8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-28T03:20:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:20:16.399135 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:20:16.399213 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:20:16.399360 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:20:16.399434 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:20:16.399518 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:20:16.399664 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:20:16.399766 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:20:16.399860 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:20:16.399947 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:20:16.400081 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:20:16.409669 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:20:16.409963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:20:16.410087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:20:16.410412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:20:16.410569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:20:16.422311 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:20:16.422920 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:20:16.423411 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:20:16.423709 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:20:16.424106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:20:16.424347 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:20:16.434799 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:20:16.434799 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:16.439351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:20:16.439351 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:16.445952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4] added
May 28 03:20:16.445952 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:20:16.445952 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:20:16.445952 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:20:16.445952 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:20:16.445952 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:20:16.445952 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:16.446135 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:20:16.446340 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0226(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:20:16.446515 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:20:16.450242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4] added
May 28 03:20:16.450242 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:20:16.450242 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:20:16.450242 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:20:16.450242 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:20:16.450242 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:20:16.450242 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:16.450406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:20:16.450561 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:20:16.450682 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:20:17.446921 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:20:17.450990 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:20:17.459337 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:20:17.459337 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:20:17.464301 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:20:17.464301 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.471737 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.476107 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.487120 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.487120 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.487120 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.487120 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.487120 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:20:17.487348 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.487348 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.487348 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.487348 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.487348 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:20:17.491896 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.491896 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.491896 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.491896 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.491896 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:20:17.492017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.492017 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.492017 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.492017 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.492017 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:20:17.521332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.40.100,3260]
May 28 03:20:17.521332 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.40.100,3260] successful.
May 28 03:20:17.521332 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.530326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.50.100,3260]
May 28 03:20:17.530326 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.50.100,3260] successful.
May 28 03:20:17.530326 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.535733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.543365 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:20:17.555545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.555545 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.555545 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.555545 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.555545 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.555545 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.555545 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:20:17.555792 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.555792 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.555792 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.555792 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.555792 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.555792 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.555792 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:20:17.556082 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.133s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:20:17.556082 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:20:17.556809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('11', '-', '-', 0) found on session 213 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:20:17.556894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:20:17.561483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.561483 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.561483 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.561483 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.561483 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.561483 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.561483 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:20:17.561651 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.561651 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:20:17.561651 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.561651 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:20:17.561651 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.561651 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:20:17.561651 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:20:17.561809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:20:17.562026 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:20:17.562583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('12', '-', '-', 0) found on session 214 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:20:17.562798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:20:17.574963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 213 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:20:17.574963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:20:17.585818 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 214 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:20:17.585818 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:20:17.657082 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:18.393778 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:18.423953 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:20:19.439801 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 3300000003dcd77be for multipath device dm-4 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:20:19.440150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:20:19.440197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000003dcd77be', 'path': '/dev/dm-4', 'multipath_id': '3300000003dcd77be'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:20:19.440349 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003dcd77be', 'path': '/dev/dm-4', 'multipath_id': '3300000003dcd77be'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:20:19.728397 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:19.746250 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:19.747239 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:19.765929 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:19.885973 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d83d93ad-b8ce-4ce7-929f-6528f80db692 req-ef87bf0b-1199-4749-a67c-94a3e7641dd6 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:19.887330 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d83d93ad-b8ce-4ce7-929f-6528f80db692 req-ef87bf0b-1199-4749-a67c-94a3e7641dd6 service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:19.887396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d83d93ad-b8ce-4ce7-929f-6528f80db692 req-ef87bf0b-1199-4749-a67c-94a3e7641dd6 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:19.887538 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d83d93ad-b8ce-4ce7-929f-6528f80db692 req-ef87bf0b-1199-4749-a67c-94a3e7641dd6 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:19.887679 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d83d93ad-b8ce-4ce7-929f-6528f80db692 req-ef87bf0b-1199-4749-a67c-94a3e7641dd6 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] No waiting events found dispatching network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:20:19.887816 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-d83d93ad-b8ce-4ce7-929f-6528f80db692 req-ef87bf0b-1199-4749-a67c-94a3e7641dd6 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received unexpected event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba for instance with vm_state active and task_state reboot_started.
May 28 03:20:19.945100 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121835496',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121835496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-image-snapshot-server-121835496',id=73,image_ref='ab047014-a1a9-4a0e-992f-98bcf2fe7659',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnOHscAGNDn0V6p2a6N3gYxi+vhJEwtCnuMsDHUtmU9AQqn9f6jJ5WPZStFR7n6WqKNW0qy3lOAP+q5vk3nU2hYkPBX8NjKCJU2X0qW/2EJpY1Yzd4KD6+0CFmNrjZEFw==',key_name='tempest-keypair-1113370069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-f6nc6q0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-273662808',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=92bfc823-f4ab-4b8e-a91d-0428c149556f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:20:19.945451 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:20:19.946102 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:70,bridge_name='br-int',has_traffic_filtering=True,id=c6e26856-9990-4b8f-a7d9-a30410109037,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6e26856-99') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:20:19.946744 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid 92bfc823-f4ab-4b8e-a91d-0428c149556f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:20:20.071534 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999605649999921 future=<Future at 0x7e4b644cc590 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:20:20.071971 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999087578999934 future=<Future at 0x7e4b644cc590 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:20:20.072097 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.9989237650002 future=<Future at 0x7e4b644cc590 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:20:20.341892 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance shutdown successfully.
May 28 03:20:20.449854 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] End _get_guest_xml xml=<domain type="qemu">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <uuid>92bfc823-f4ab-4b8e-a91d-0428c149556f</uuid>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <name>instance-00000049</name>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-121835496</nova:name>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:20:16</nova:creationTime>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:diskFormat>raw</nova:diskFormat>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="hw_machine_type">pc</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="hw_video_model">virtio</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="img_bdm_v2">True</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid=""/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         <nova:port uuid="c6e26856-9990-4b8f-a7d9-a30410109037">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <system>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <entry name="serial">92bfc823-f4ab-4b8e-a91d-0428c149556f</entry>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <entry name="uuid">92bfc823-f4ab-4b8e-a91d-0428c149556f</entry>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </system>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <os>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   </os>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <features>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   </features>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   <devices>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f/disk.config"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </disk>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <alias name="ua-d2687de9-8590-4df6-8b45-82527ebee9c4"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-4"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <serial>d2687de9-8590-4df6-8b45-82527ebee9c4</serial>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </disk>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:91:57:70"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <target dev="tapc6e26856-99"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </interface>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f/console.log" append="off"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </serial>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <video>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </video>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </rng>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:   </devices>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]: </domain>
May 28 03:20:20.449854 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:20:20.452259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Preparing to wait for external event network-vif-plugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:20:20.452259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:20.452259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:20.452259 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:20.452259 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121835496',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121835496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-image-snapshot-server-121835496',id=73,image_ref='ab047014-a1a9-4a0e-992f-98bcf2fe7659',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnOHscAGNDn0V6p2a6N3gYxi+vhJEwtCnuMsDHUtmU9AQqn9f6jJ5WPZStFR7n6WqKNW0qy3lOAP+q5vk3nU2hYkPBX8NjKCJU2X0qW/2EJpY1Yzd4KD6+0CFmNrjZEFw==',key_name='tempest-keypair-1113370069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-f6nc6q0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-273662808',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=92bfc823-f4ab-4b8e-a91d-0428c149556f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:20:20.452259 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:20:20.452259 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:70,bridge_name='br-int',has_traffic_filtering=True,id=c6e26856-9990-4b8f-a7d9-a30410109037,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6e26856-99') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:20:20.452542 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:70,bridge_name='br-int',has_traffic_filtering=True,id=c6e26856-9990-4b8f-a7d9-a30410109037,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6e26856-99') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:20:20.452950 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.453276 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:20:20.453542 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:20:20.454346 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.454536 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3267f23-fe88-51d4-addf-0bf09c1b8893', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:20:20.455308 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.456173 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:20:20.460764 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.462787 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.462992 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6e26856-99, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:20:20.463421 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc6e26856-99, col_values=(('qos', UUID('26a99041-58fa-405b-8605-599c7a595f1a')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:20:20.463598 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc6e26856-99, col_values=(('external_ids', {'iface-id': 'c6e26856-9990-4b8f-a7d9-a30410109037', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:57:70', 'vm-uuid': '92bfc823-f4ab-4b8e-a91d-0428c149556f'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:20:20.464347 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.465401 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:20:20.474018 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.475282 np0000001589 nova-compute[98297]: INFO os_vif [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:57:70,bridge_name='br-int',has_traffic_filtering=True,id=c6e26856-9990-4b8f-a7d9-a30410109037,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6e26856-99')
May 28 03:20:20.734995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.751368 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:20.832093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:21.040484 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:21.046492 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:21.047907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:21.065034 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:21.069322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:21.380417 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Removed pending STOPPED event for 1fa7922a-c053-4633-bd71-4818cfae11d5 due to new event <LifecycleEvent: 1779938421.379984, 1fa7922a-c053-4633-bd71-4818cfae11d5 => Resumed> {{(pid=98297) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 28 03:20:21.380549 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938421.379984, 1fa7922a-c053-4633-bd71-4818cfae11d5 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:20:21.380661 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] VM Resumed (Lifecycle Event)
May 28 03:20:21.385103 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance running successfully.
May 28 03:20:21.385667 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance soft rebooted successfully.
May 28 03:20:21.385864 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:21.884382 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:21.886301 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:20:21.892970 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-8104a5d5-4182-4edb-9988-bee4f9b30e2b tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.054s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:21.951843 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:21.952176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:21.952497 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:21.952618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:21.952775 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] No waiting events found dispatching network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:20:21.952871 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received unexpected event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba for instance with vm_state active and task_state None.
May 28 03:20:21.952973 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:21.953083 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:21.953249 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:21.953407 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:21.953476 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] No waiting events found dispatching network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:20:21.953543 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received unexpected event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba for instance with vm_state active and task_state None.
May 28 03:20:21.953625 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:21.953741 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:21.953853 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:21.953958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:21.954383 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] No waiting events found dispatching network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:20:21.954610 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-23f7435e-7f38-471f-abda-51971c94e9f3 req-d4b1b575-aec7-448c-8499-e1aa8427e1b0 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received unexpected event network-vif-plugged-edb6970b-a010-4425-8374-736296d41cba for instance with vm_state active and task_state None.
May 28 03:20:21.990145 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:20:21.990282 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:20:21.990346 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:91:57:70, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:20:21.990769 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Using config drive
May 28 03:20:22.389840 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938422.3885825, 1fa7922a-c053-4633-bd71-4818cfae11d5 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:20:22.389840 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] VM Started (Lifecycle Event)
May 28 03:20:22.496001 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:22.600574 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Creating config drive at /opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f/disk.config
May 28 03:20:22.604298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzo0gn3xe {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:20:22.659649 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzo0gn3xe" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:20:22.892094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:22.899322 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:20:23.032740 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:23.049268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:23.139445 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:23.175265 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0b9273fa-69a7-4081-aed7-786e93abc170 req-665aa2f3-9bdf-4cf7-a079-c4814a45e7d4 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-vif-plugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:23.175786 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0b9273fa-69a7-4081-aed7-786e93abc170 req-665aa2f3-9bdf-4cf7-a079-c4814a45e7d4 service nova] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:23.175958 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0b9273fa-69a7-4081-aed7-786e93abc170 req-665aa2f3-9bdf-4cf7-a079-c4814a45e7d4 service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:23.176077 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0b9273fa-69a7-4081-aed7-786e93abc170 req-665aa2f3-9bdf-4cf7-a079-c4814a45e7d4 service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:23.176189 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0b9273fa-69a7-4081-aed7-786e93abc170 req-665aa2f3-9bdf-4cf7-a079-c4814a45e7d4 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Processing event network-vif-plugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:20:23.198522 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:23.199195 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:23.395445 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:23.688883 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938423.6883855, 92bfc823-f4ab-4b8e-a91d-0428c149556f => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:20:23.689344 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:20:23.689519 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] VM Started (Lifecycle Event)
May 28 03:20:23.695152 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:20:23.698147 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Instance spawned successfully.
May 28 03:20:23.698463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:20:23.701500 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:20:23.701783 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:20:24.192692 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:24.194632 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:20:24.206569 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Took 7.82 seconds to spawn the instance on the hypervisor.
May 28 03:20:24.206741 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:24.697002 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:20:24.697201 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938424.6970165, 92bfc823-f4ab-4b8e-a91d-0428c149556f => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:20:24.697328 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] VM Paused (Lifecycle Event)
May 28 03:20:24.715166 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Took 17.59 seconds to build instance.
May 28 03:20:25.199572 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:25.201613 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938425.201342, 92bfc823-f4ab-4b8e-a91d-0428c149556f => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:20:25.201710 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] VM Resumed (Lifecycle Event)
May 28 03:20:25.216734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.100s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:25.228714 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a6f22506-2218-4d96-bd2e-789650109650 req-66f6112b-0326-494d-a07d-a7b9b011bb2d service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-vif-plugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:25.229110 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a6f22506-2218-4d96-bd2e-789650109650 req-66f6112b-0326-494d-a07d-a7b9b011bb2d service nova] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:25.229287 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a6f22506-2218-4d96-bd2e-789650109650 req-66f6112b-0326-494d-a07d-a7b9b011bb2d service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:25.229419 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a6f22506-2218-4d96-bd2e-789650109650 req-66f6112b-0326-494d-a07d-a7b9b011bb2d service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:25.229544 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a6f22506-2218-4d96-bd2e-789650109650 req-66f6112b-0326-494d-a07d-a7b9b011bb2d service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] No waiting events found dispatching network-vif-plugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:20:25.229658 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-a6f22506-2218-4d96-bd2e-789650109650 req-66f6112b-0326-494d-a07d-a7b9b011bb2d service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received unexpected event network-vif-plugged-c6e26856-9990-4b8f-a7d9-a30410109037 for instance with vm_state active and task_state None.
May 28 03:20:25.472208 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:25.703873 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:20:25.705734 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:20:25.913838 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-changed-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:25.914014 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Refreshing instance network info cache due to event network-changed-c6e26856-9990-4b8f-a7d9-a30410109037. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:20:25.914147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] Acquiring lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:20:25.914348 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] Acquired lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:20:25.914704 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Refreshing network info cache for port c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:20:26.416445 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:26.748567 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:26.867983 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Updated VIF entry in instance network info cache for port c6e26856-9990-4b8f-a7d9-a30410109037. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:20:26.868268 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Updating instance_info_cache with network_info: [{"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:20:27.369956 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2d8d2144-795e-4cac-bc00-f4001aed3893 req-45d7a683-dc8c-42a5-ac1f-ee6ee0eaa33c service nova] Releasing lock "refresh_cache-92bfc823-f4ab-4b8e-a91d-0428c149556f" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:20:28.396944 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:30.473995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:33.398026 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:35.071473 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00038773200003561215 future=<Future at 0x7e4b644cc590 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:20:35.071905 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:20:35.489171 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:38.399085 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:39.137682 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:39.138008 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:20:40.492614 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:43.137649 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:43.400672 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:43.641878 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:43.642161 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:43.642339 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:43.642509 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:20:44.663718 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:20:44.665260 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:20:44.754464 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:20:44.754957 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:20:44.842529 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:20:44.843095 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:20:44.848130 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:20:44.849913 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:20:44.851216 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:20:44.902297 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.051s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:20:44.902684 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13041MB free_disk=72.6220932006836GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:20:44.902866 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:44.903080 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:45.493941 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:45.955974 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 365e0b89-d6ac-4681-ae36-1ca287152972 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:20:45.957265 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 1fa7922a-c053-4633-bd71-4818cfae11d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:20:45.957265 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 92bfc823-f4ab-4b8e-a91d-0428c149556f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:20:45.957265 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:20:45.957265 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:20:44 up 48 min,  2 users,  load average: 2.30, 4.09, 4.35\n', 'num_instances': '3', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '3', 'num_proj_26deda1c00a84355951239b1a62997e8': '2', 'io_workload': '0', 'num_proj_6b78a160e3c24b99b0760e4c18e688e3': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:20:46.117489 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:20:46.117707 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:20:46.620564 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:20:47.128287 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:20:47.128734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.225s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:20:47.128874 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:20:48.403268 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:49.128989 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:49.129696 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:49.129879 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:49.130015 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:20:49.130216 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.01 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:20:50.497582 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:51.138943 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:51.139235 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:20:53.133985 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:53.134497 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:20:53.404500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:55.499908 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:56.137740 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:20:56.138011 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:20:58.295984 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:58.404980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:20:58.457656 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-changed-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:58.457775 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing instance network info cache due to event network-changed-edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:20:58.457952 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] Acquiring lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:20:58.458102 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] Acquired lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:20:58.458171 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing network info cache for port edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:20:58.842712 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-changed-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:20:58.842897 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing instance network info cache due to event network-changed-edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:20:58.843078 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] Acquiring lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:20:58.961093 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:59.198122 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:20:59.303274 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updated VIF entry in instance network info cache for port edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:20:59.303736 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:20:59.385370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:20:59.385370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:20:59.805591 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cd767ccb-f0c9-447a-bbf0-f9f6229bb1b4 req-7c915825-10e8-44da-9f88-2edd82724c8e service nova] Releasing lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:20:59.806279 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] Acquired lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:20:59.806279 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Refreshing network info cache for port edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:20:59.887152 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Detaching volume a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f
May 28 03:20:59.921864 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Attempting to driver detach volume a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f from mountpoint /dev/vdb
May 28 03:20:59.925581 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Found disk vdb by alias ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:20:59.926612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Found disk vdb by alias ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:20:59.926719 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Attempting to detach device vdb from instance 1fa7922a-c053-4633-bd71-4818cfae11d5 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:20:59.926953 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:20:59.926953 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:20:59.926953 np0000001589 nova-compute[98297]:   <alias name="ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f"/>
May 28 03:20:59.926953 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-3"/>
May 28 03:20:59.926953 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:20:59.926953 np0000001589 nova-compute[98297]:   <serial>a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f</serial>
May 28 03:20:59.926953 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:20:59.926953 np0000001589 nova-compute[98297]: </disk>
May 28 03:20:59.926953 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:20:59.931240 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully detached device vdb from instance 1fa7922a-c053-4633-bd71-4818cfae11d5 from the persistent domain config.
May 28 03:20:59.931367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] (1/8): Attempting to detach device vdb with device alias ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f from instance 1fa7922a-c053-4633-bd71-4818cfae11d5 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:20:59.931590 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:20:59.931590 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:20:59.931590 np0000001589 nova-compute[98297]:   <alias name="ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f"/>
May 28 03:20:59.931590 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-3"/>
May 28 03:20:59.931590 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:20:59.931590 np0000001589 nova-compute[98297]:   <serial>a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f</serial>
May 28 03:20:59.931590 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:20:59.931590 np0000001589 nova-compute[98297]: </disk>
May 28 03:20:59.931590 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:21:00.308161 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:00.424981 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779938460.4246726, 1fa7922a-c053-4633-bd71-4818cfae11d5 => ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:21:00.425934 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f for instance 1fa7922a-c053-4633-bd71-4818cfae11d5 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:21:00.428318 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully detached device vdb from instance 1fa7922a-c053-4633-bd71-4818cfae11d5 from the live domain config.
May 28 03:21:00.429350 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:21:00.429775 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:21:00.429953 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:21:00.430382 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:21:00.430780 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:21:00.430963 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:21:00.454252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:00.454252 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:00.454252 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:21:00.454252 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:21:00.454252 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:00.454252 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:00.454252 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:21:00.454464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:00.454464 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:00.454464 np0000001589 nova-compute[98297]: tcp: [211] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:21:00.454464 np0000001589 nova-compute[98297]: tcp: [212] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f (non-flash)
May 28 03:21:00.454464 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:00.454464 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:00.454464 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:21:00.454576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', '211'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', '212'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', '214')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:21:00.454576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', '211')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:21:00.455436 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f', '212')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:21:00.456078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b64587380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:21:00.456267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:21:00.456483 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Flush multipath device 3300000007f0363d9 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:21:00.499894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:21:00.502562 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:00.536638 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:21:00.554172 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:00.580487 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:21:00.580641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:21:00.581619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:21:00.593386 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:21:00.593645 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:21:00.603437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:00.628886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.40.100,3260]
May 28 03:21:00.628886 np0000001589 nova-compute[98297]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.40.100,3260] successful.
May 28 03:21:00.628886 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:00.643055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:00.654140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:00.669029 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updated VIF entry in instance network info cache for port edb6970b-a010-4425-8374-736296d41cba. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:21:00.669309 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [{"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:21:00.684765 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.50.100,3260]
May 28 03:21:00.684765 np0000001589 nova-compute[98297]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-a250b0e1-ffd6-4b48-b2e5-0f81e4b8e29f, portal: 192.168.50.100,3260] successful.
May 28 03:21:00.684765 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:00.700296 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:00.700545 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:21:00.700708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] <== disconnect_volume: return (271ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:21:00.700870 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:21:01.171106 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-854568d8-efe5-47b0-9e2e-cb370d638a3c req-998a9a7a-1489-4e3e-aa03-f32b1ef1d6bb service nova] Releasing lock "refresh_cache-1fa7922a-c053-4633-bd71-4818cfae11d5" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:21:01.239914 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'flavor' on Instance uuid 1fa7922a-c053-4633-bd71-4818cfae11d5 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:21:02.245520 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2f81c221-b4fd-4215-b1dc-2859ef7822b7 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.860s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:02.543527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:02.543677 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:02.543827 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:02.543935 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:02.544039 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:02.545778 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Terminating instance
May 28 03:21:03.048342 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:21:03.084176 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.085750 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.098594 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.230990 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.235564 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.244269 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e6da95f-93da-472b-9d87-c4b8afac914a req-71191729-f532-42d5-900f-3d6a1ef23474 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-vif-unplugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:03.244589 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e6da95f-93da-472b-9d87-c4b8afac914a req-71191729-f532-42d5-900f-3d6a1ef23474 service nova] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:03.244807 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e6da95f-93da-472b-9d87-c4b8afac914a req-71191729-f532-42d5-900f-3d6a1ef23474 service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:03.244981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-0e6da95f-93da-472b-9d87-c4b8afac914a req-71191729-f532-42d5-900f-3d6a1ef23474 service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:03.245162 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e6da95f-93da-472b-9d87-c4b8afac914a req-71191729-f532-42d5-900f-3d6a1ef23474 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] No waiting events found dispatching network-vif-unplugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:21:03.245361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0e6da95f-93da-472b-9d87-c4b8afac914a req-71191729-f532-42d5-900f-3d6a1ef23474 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-vif-unplugged-c6e26856-9990-4b8f-a7d9-a30410109037 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:21:03.364528 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999702137999975 future=<Future at 0x7e4b407b4740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:03.364924 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999376753999968 future=<Future at 0x7e4b407b4740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:03.364972 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999209012999927 future=<Future at 0x7e4b407b4740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:03.366813 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Instance destroyed successfully.
May 28 03:21:03.367278 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid 92bfc823-f4ab-4b8e-a91d-0428c149556f {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:21:03.406261 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.688664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:03.688803 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:03.688934 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:03.688981 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:03.689087 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:03.690862 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Terminating instance
May 28 03:21:03.869694 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:20:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-121835496',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-121835496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-image-snapshot-server-121835496',id=73,image_ref='ab047014-a1a9-4a0e-992f-98bcf2fe7659',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnOHscAGNDn0V6p2a6N3gYxi+vhJEwtCnuMsDHUtmU9AQqn9f6jJ5WPZStFR7n6WqKNW0qy3lOAP+q5vk3nU2hYkPBX8NjKCJU2X0qW/2EJpY1Yzd4KD6+0CFmNrjZEFw==',key_name='tempest-keypair-1113370069',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:20:24Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-f6nc6q0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-273662808',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=92bfc823-f4ab-4b8e-a91d-0428c149556f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:21:03.869948 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "c6e26856-9990-4b8f-a7d9-a30410109037", "address": "fa:16:3e:91:57:70", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6e26856-99", "ovs_interfaceid": "c6e26856-9990-4b8f-a7d9-a30410109037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:21:03.870641 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:70,bridge_name='br-int',has_traffic_filtering=True,id=c6e26856-9990-4b8f-a7d9-a30410109037,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6e26856-99') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:21:03.870907 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:70,bridge_name='br-int',has_traffic_filtering=True,id=c6e26856-9990-4b8f-a7d9-a30410109037,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6e26856-99') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:21:03.872593 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.872737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6e26856-99, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:03.873662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.874446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:03.875152 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.875338 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26a99041-58fa-405b-8605-599c7a595f1a) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:03.875772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.876194 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:03.876379 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:03.877841 np0000001589 nova-compute[98297]: INFO os_vif [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:57:70,bridge_name='br-int',has_traffic_filtering=True,id=c6e26856-9990-4b8f-a7d9-a30410109037,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6e26856-99')
May 28 03:21:03.879386 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:21:03.879717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:21:03.879868 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:21:03.880202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:21:03.880563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd2687de9-8590-4df6-8b45-82527ebee9c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:21:03.880717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: tcp: [213] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]: tcp: [214] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4 (non-flash)
May 28 03:21:03.903295 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:21:03.903690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '210'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', '213'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', '214')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:21:03.903690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', '213')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:21:03.904519 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4', '214')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:21:03.905208 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40586520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'): ({'sdg'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:21:03.905454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdf, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:21:03.905687 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 3300000003dcd77be {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:21:03.968451 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:21:04.000393 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:21:04.059459 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:21:04.059583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:21:04.060286 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:21:04.070168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:21:04.070375 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:21:04.080362 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:04.109838 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.40.100,3260]
May 28 03:21:04.109838 np0000001589 nova-compute[98297]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.40.100,3260] successful.
May 28 03:21:04.109838 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:04.122798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:04.132624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:04.166851 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.50.100,3260]
May 28 03:21:04.166851 np0000001589 nova-compute[98297]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-d2687de9-8590-4df6-8b45-82527ebee9c4, portal: 192.168.50.100,3260] successful.
May 28 03:21:04.166851 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:04.177623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:04.177819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:21:04.177927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (298ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:21:04.178031 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:21:04.178275 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Deleting instance files /opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f_del
May 28 03:21:04.178729 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Deletion of /opt/stack/data/nova/instances/92bfc823-f4ab-4b8e-a91d-0428c149556f_del complete
May 28 03:21:04.193244 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:21:04.215179 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:04.228660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:04.230446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:04.248804 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:04.340258 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9e542931-16c7-4b8c-917e-e00103e3e410 req-cb45013b-fddd-4e8d-aaa5-48b5e8672f9d service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:04.340558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9e542931-16c7-4b8c-917e-e00103e3e410 req-cb45013b-fddd-4e8d-aaa5-48b5e8672f9d service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:04.341183 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9e542931-16c7-4b8c-917e-e00103e3e410 req-cb45013b-fddd-4e8d-aaa5-48b5e8672f9d service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:04.341183 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-9e542931-16c7-4b8c-917e-e00103e3e410 req-cb45013b-fddd-4e8d-aaa5-48b5e8672f9d service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:04.341183 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9e542931-16c7-4b8c-917e-e00103e3e410 req-cb45013b-fddd-4e8d-aaa5-48b5e8672f9d service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] No waiting events found dispatching network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:21:04.341183 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-9e542931-16c7-4b8c-917e-e00103e3e410 req-cb45013b-fddd-4e8d-aaa5-48b5e8672f9d service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:21:04.491376 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:04.513815 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999762398999792 future=<Future at 0x7e4b40615940 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:04.516039 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Instance destroyed successfully.
May 28 03:21:04.516556 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lazy-loading 'resources' on Instance uuid 1fa7922a-c053-4633-bd71-4818cfae11d5 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:21:04.683932 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Took 1.64 seconds to destroy the instance on the hypervisor.
May 28 03:21:04.684942 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:21:04.685204 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:21:04.685314 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:21:04.685530 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:04.736100 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:05.018759 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:19:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-833059047',display_name='tempest-TestMinimumBasicScenario-server-833059047',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testminimumbasicscenario-server-833059047',id=72,image_ref='8128eb85-abf4-4a30-8857-903ca87c5a97',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGajBPgwQA/weAFew3BohQfGwDTnusOoPoQPEjhds82CO01bjVWh4SARr0yui/91swcSrsv7wdAFqgQFDDQhjPWx/BjjhuvxIZX9/ZQ+rK7VpGWaJgOKmwxnEzvpjuG/zw==',key_name='tempest-TestMinimumBasicScenario-463016163',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:19:41Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6b78a160e3c24b99b0760e4c18e688e3',ramdisk_id='',reservation_id='r-lmuhwuy3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='8128eb85-abf4-4a30-8857-903ca87c5a97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-62402083',owner_user_name='tempest-TestMinimumBasicScenario-62402083-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:20:21Z,user_data=None,user_id='bc6820ff3bfd4e90a108c237bcfb235d',uuid=1fa7922a-c053-4633-bd71-4818cfae11d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:21:05.019031 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converting VIF {"id": "edb6970b-a010-4425-8374-736296d41cba", "address": "fa:16:3e:13:77:e5", "network": {"id": "56a412d4-b9bc-432f-8f04-4ce470cbcc8d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1639986245-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6b78a160e3c24b99b0760e4c18e688e3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedb6970b-a0", "ovs_interfaceid": "edb6970b-a010-4425-8374-736296d41cba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:21:05.019552 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:77:e5,bridge_name='br-int',has_traffic_filtering=True,id=edb6970b-a010-4425-8374-736296d41cba,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb6970b-a0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:21:05.019888 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:77:e5,bridge_name='br-int',has_traffic_filtering=True,id=edb6970b-a010-4425-8374-736296d41cba,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb6970b-a0') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:21:05.020757 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:05.020969 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedb6970b-a0, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:05.021948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:05.022670 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:05.023097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:05.023693 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:05.023819 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fcde2b5-c23e-4076-99f6-cffdaf04e89f) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:05.024244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:05.024660 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:05.024920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:05.026342 np0000001589 nova-compute[98297]: INFO os_vif [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:77:e5,bridge_name='br-int',has_traffic_filtering=True,id=edb6970b-a010-4425-8374-736296d41cba,network=Network(56a412d4-b9bc-432f-8f04-4ce470cbcc8d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedb6970b-a0')
May 28 03:21:05.026581 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Deleting instance files /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5_del
May 28 03:21:05.027192 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Deletion of /opt/stack/data/nova/instances/1fa7922a-c053-4633-bd71-4818cfae11d5_del complete
May 28 03:21:05.295375 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-33c55a0a-5090-4483-8e46-f9c7e9210724 req-700a8e2f-68f2-48dd-891e-daeba6e922ed service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-vif-unplugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:05.295543 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-33c55a0a-5090-4483-8e46-f9c7e9210724 req-700a8e2f-68f2-48dd-891e-daeba6e922ed service nova] Acquiring lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:05.295683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-33c55a0a-5090-4483-8e46-f9c7e9210724 req-700a8e2f-68f2-48dd-891e-daeba6e922ed service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:05.295799 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-33c55a0a-5090-4483-8e46-f9c7e9210724 req-700a8e2f-68f2-48dd-891e-daeba6e922ed service nova] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:05.295914 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-33c55a0a-5090-4483-8e46-f9c7e9210724 req-700a8e2f-68f2-48dd-891e-daeba6e922ed service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] No waiting events found dispatching network-vif-unplugged-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:21:05.296019 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-33c55a0a-5090-4483-8e46-f9c7e9210724 req-700a8e2f-68f2-48dd-891e-daeba6e922ed service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-vif-unplugged-c6e26856-9990-4b8f-a7d9-a30410109037 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:21:05.532309 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 03:21:05.532758 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:21:05.533038 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:21:05.533135 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:21:05.533366 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:05.571712 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:21:05.592742 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:05.822331 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cea13f8f-436e-4eb5-b306-162861607360 req-883709c4-716f-40ce-b287-0463d67e288d service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-deleted-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:05.822460 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-cea13f8f-436e-4eb5-b306-162861607360 req-883709c4-716f-40ce-b287-0463d67e288d service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Neutron deleted interface edb6970b-a010-4425-8374-736296d41cba; detaching it from the instance and deleting it from the info cache
May 28 03:21:05.824128 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cea13f8f-436e-4eb5-b306-162861607360 req-883709c4-716f-40ce-b287-0463d67e288d service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Detach interface failed, port_id=edb6970b-a010-4425-8374-736296d41cba, reason: Instance 1fa7922a-c053-4633-bd71-4818cfae11d5 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:21:06.073502 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Took 1.39 seconds to deallocate network for instance.
May 28 03:21:06.280823 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:21:06.390937 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d359e319-9b0b-4ca4-bed9-c45330192b03 req-68cf6871-5eb6-4b2c-b054-9160143646b1 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:06.391018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d359e319-9b0b-4ca4-bed9-c45330192b03 req-68cf6871-5eb6-4b2c-b054-9160143646b1 service nova] Acquiring lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:06.391153 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d359e319-9b0b-4ca4-bed9-c45330192b03 req-68cf6871-5eb6-4b2c-b054-9160143646b1 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:06.391283 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-d359e319-9b0b-4ca4-bed9-c45330192b03 req-68cf6871-5eb6-4b2c-b054-9160143646b1 service nova] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:06.391654 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d359e319-9b0b-4ca4-bed9-c45330192b03 req-68cf6871-5eb6-4b2c-b054-9160143646b1 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] No waiting events found dispatching network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:21:06.391796 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d359e319-9b0b-4ca4-bed9-c45330192b03 req-68cf6871-5eb6-4b2c-b054-9160143646b1 service nova] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Received event network-vif-unplugged-edb6970b-a010-4425-8374-736296d41cba for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:21:06.391977 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-d359e319-9b0b-4ca4-bed9-c45330192b03 req-68cf6871-5eb6-4b2c-b054-9160143646b1 service nova] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Received event network-vif-deleted-c6e26856-9990-4b8f-a7d9-a30410109037 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:06.614271 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:21:06.615881 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Deleting volume: d2687de9-8590-4df6-8b45-82527ebee9c4 {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:21:06.782642 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Took 1.25 seconds to deallocate network for instance.
May 28 03:21:07.152862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:07.152997 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:07.289353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:07.305077 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:21:07.305276 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:21:07.807649 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:21:08.313693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.161s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:08.315173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.026s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:08.371694 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance 92bfc823-f4ab-4b8e-a91d-0428c149556f
May 28 03:21:08.452408 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:21:08.452601 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:21:08.955082 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:21:09.383787 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fea27874-acc4-4d07-9fb8-ef0686d97920 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "92bfc823-f4ab-4b8e-a91d-0428c149556f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.840s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:09.460861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.146s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:09.501151 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Deleted allocations for instance 1fa7922a-c053-4633-bd71-4818cfae11d5
May 28 03:21:10.025247 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:10.507873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-2b731eab-5e9b-46d8-8ce1-c77913c883e2 tempest-TestMinimumBasicScenario-62402083 tempest-TestMinimumBasicScenario-62402083-project-member] Lock "1fa7922a-c053-4633-bd71-4818cfae11d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.819s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:11.629735 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:11.630260 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:11.630523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:11.630741 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:11.630909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:11.633198 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Terminating instance
May 28 03:21:12.136400 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:21:12.151317 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.154615 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.166664 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.171015 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.189433 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.287239 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-22aeb03d-a26d-41fb-8ee8-461719af259a req-8d961c04-54a1-427c-a61e-1fb8343c27f0 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-vif-unplugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:12.287462 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-22aeb03d-a26d-41fb-8ee8-461719af259a req-8d961c04-54a1-427c-a61e-1fb8343c27f0 service nova] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:12.287612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-22aeb03d-a26d-41fb-8ee8-461719af259a req-8d961c04-54a1-427c-a61e-1fb8343c27f0 service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:12.287719 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-22aeb03d-a26d-41fb-8ee8-461719af259a req-8d961c04-54a1-427c-a61e-1fb8343c27f0 service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:12.288179 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-22aeb03d-a26d-41fb-8ee8-461719af259a req-8d961c04-54a1-427c-a61e-1fb8343c27f0 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] No waiting events found dispatching network-vif-unplugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:21:12.288329 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-22aeb03d-a26d-41fb-8ee8-461719af259a req-8d961c04-54a1-427c-a61e-1fb8343c27f0 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-vif-unplugged-e240ecf4-625f-4e00-9f47-9157297f9694 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:21:12.442557 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999672051999823 future=<Future at 0x7e4b781da240 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:12.446251 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Instance destroyed successfully.
May 28 03:21:12.446801 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid 365e0b89-d6ac-4681-ae36-1ca287152972 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:21:12.520737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.949342 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:19:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1140268347',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1140268347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-volume-backed-server-1140268347',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4hPrcIqAwrjoopjDKT6Y8OCEEQKKukoVBQVGJx0OI/3weeVUTcC0CsvQZh5cF1D1nM/xrOtxdycd7AoEkli3oo9QuBMjYw7K/eBqcJeMKYS80TYdwiuVAlvNyi4gReDA==',key_name='tempest-keypair-887840945',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:19:37Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-y81o2nrd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:19:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=365e0b89-d6ac-4681-ae36-1ca287152972,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:21:12.949776 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "e240ecf4-625f-4e00-9f47-9157297f9694", "address": "fa:16:3e:99:d6:cf", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape240ecf4-62", "ovs_interfaceid": "e240ecf4-625f-4e00-9f47-9157297f9694", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:21:12.950009 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:d6:cf,bridge_name='br-int',has_traffic_filtering=True,id=e240ecf4-625f-4e00-9f47-9157297f9694,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240ecf4-62') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:21:12.950173 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:d6:cf,bridge_name='br-int',has_traffic_filtering=True,id=e240ecf4-625f-4e00-9f47-9157297f9694,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240ecf4-62') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:21:12.951126 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.951379 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape240ecf4-62, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:12.968977 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.969735 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:12.970352 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.971092 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.971219 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=caaaaced-e44c-4230-af9a-7c0bea1ed710) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:12.971622 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.972154 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:12.972497 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:12.974977 np0000001589 nova-compute[98297]: INFO os_vif [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:d6:cf,bridge_name='br-int',has_traffic_filtering=True,id=e240ecf4-625f-4e00-9f47-9157297f9694,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape240ecf4-62')
May 28 03:21:12.976466 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:21:12.976742 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:21:12.977312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:21:12.977312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:21:12.977415 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:21:12.977520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:21:12.999511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:12.999511 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:12.999511 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:21:12.999703 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:12.999703 np0000001589 nova-compute[98297]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 (non-flash)
May 28 03:21:12.999703 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:21:12.999703 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '210')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:21:12.999922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '209')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:21:13.000484 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26', '210')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:21:13.001019 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40544220>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:21:13.001168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:21:13.001369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 33000000013d37eef {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:21:13.056642 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:21:13.105683 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:21:13.156800 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:21:13.156974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:21:13.157692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:21:13.168015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:21:13.168239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:21:13.178701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:13.202804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.40.100,3260]
May 28 03:21:13.202804 np0000001589 nova-compute[98297]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.40.100,3260] successful.
May 28 03:21:13.202804 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:13.213166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:13.222809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:13.247901 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.50.100,3260]
May 28 03:21:13.247901 np0000001589 nova-compute[98297]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26, portal: 192.168.50.100,3260] successful.
May 28 03:21:13.247901 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:13.258875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:13.258875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:21:13.258875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (282ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:21:13.258875 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:21:13.259086 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Deleting instance files /opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972_del
May 28 03:21:13.259411 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Deletion of /opt/stack/data/nova/instances/365e0b89-d6ac-4681-ae36-1ca287152972_del complete
May 28 03:21:13.764994 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Took 1.63 seconds to destroy the instance on the hypervisor.
May 28 03:21:13.765599 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:21:13.765896 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:21:13.766022 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:21:13.766223 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:13.818268 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:13.952367 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:14.175948 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8aff8d60-507c-4d25-90ff-c63af7d056ff req-4db173c3-fc16-4209-a0b2-36733be87d54 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-vif-deleted-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:14.176069 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-8aff8d60-507c-4d25-90ff-c63af7d056ff req-4db173c3-fc16-4209-a0b2-36733be87d54 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Neutron deleted interface e240ecf4-625f-4e00-9f47-9157297f9694; detaching it from the instance and deleting it from the info cache
May 28 03:21:14.177684 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8aff8d60-507c-4d25-90ff-c63af7d056ff req-4db173c3-fc16-4209-a0b2-36733be87d54 service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Detach interface failed, port_id=e240ecf4-625f-4e00-9f47-9157297f9694, reason: Instance 365e0b89-d6ac-4681-ae36-1ca287152972 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:21:14.339331 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1bd362de-d21f-4e7b-9d88-15743193a976 req-4091bcc3-848b-4457-bfa2-8a67359cce2f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-vif-unplugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:14.339517 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1bd362de-d21f-4e7b-9d88-15743193a976 req-4091bcc3-848b-4457-bfa2-8a67359cce2f service nova] Acquiring lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:14.339650 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1bd362de-d21f-4e7b-9d88-15743193a976 req-4091bcc3-848b-4457-bfa2-8a67359cce2f service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:14.339759 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1bd362de-d21f-4e7b-9d88-15743193a976 req-4091bcc3-848b-4457-bfa2-8a67359cce2f service nova] Lock "365e0b89-d6ac-4681-ae36-1ca287152972-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:14.339875 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1bd362de-d21f-4e7b-9d88-15743193a976 req-4091bcc3-848b-4457-bfa2-8a67359cce2f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] No waiting events found dispatching network-vif-unplugged-e240ecf4-625f-4e00-9f47-9157297f9694 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:21:14.339977 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1bd362de-d21f-4e7b-9d88-15743193a976 req-4091bcc3-848b-4457-bfa2-8a67359cce2f service nova] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Received event network-vif-unplugged-e240ecf4-625f-4e00-9f47-9157297f9694 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:21:14.631101 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:21:15.133487 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Took 1.37 seconds to deallocate network for instance.
May 28 03:21:15.673819 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:21:15.675602 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Deleting volume: c9df9c05-6ab5-4bf0-a2c5-dc92072f1a26 {{(pid=98297) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 28 03:21:16.208121 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:16.208717 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:16.286736 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:21:16.286932 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:21:16.789314 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:21:17.295657 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.087s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:17.338022 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance 365e0b89-d6ac-4681-ae36-1ca287152972
May 28 03:21:17.973130 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:18.345247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-22353f3f-b4ed-4495-95e1-55ea4ff14758 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "365e0b89-d6ac-4681-ae36-1ca287152972" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.715s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:18.364519 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003074999999626016 future=<Future at 0x7e4b407b4740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:18.364596 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:18.365293 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938463.3641312, 92bfc823-f4ab-4b8e-a91d-0428c149556f => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:21:18.365430 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.1481223239998144 future=<Future at 0x7e4b40615940 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:18.365560 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] VM Stopped (Lifecycle Event)
May 28 03:21:18.366382 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=1.147179726000104 future=<Future at 0x7e4b40615940 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:18.867557 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 92bfc823-f4ab-4b8e-a91d-0428c149556f] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:21:19.513934 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003027110001312394 future=<Future at 0x7e4b40615940 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:19.514391 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938464.513503, 1fa7922a-c053-4633-bd71-4818cfae11d5 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:21:19.514540 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:19.514705 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] VM Stopped (Lifecycle Event)
May 28 03:21:19.515610 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.926521008999771 future=<Future at 0x7e4b781da240 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:19.515710 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=7.926406376999694 future=<Future at 0x7e4b781da240 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:20.016891 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 1fa7922a-c053-4633-bd71-4818cfae11d5] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:21:22.399471 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:22.399909 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:22.901652 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:21:22.974713 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:23.443987 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:23.444297 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:23.446835 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:21:23.446988 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Claim successful on node np0000001589
May 28 03:21:24.528528 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:21:24.528812 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:21:25.030970 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:21:25.537353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.093s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:25.537611 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:21:26.042473 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:21:26.042734 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:21:26.042975 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:26.043212 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:26.101374 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:21:26.513360 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Successfully created port: ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:21:26.545443 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:21:26.930724 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Successfully updated port: ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:21:26.969050 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-changed-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:26.969191 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Refreshing instance network info cache due to event network-changed-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:21:26.970007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] Acquiring lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:21:26.970007 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] Acquired lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:21:26.970007 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Refreshing network info cache for port ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:21:27.048014 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:21:27.432700 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:21:27.442525 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003590440001062234 future=<Future at 0x7e4b781da240 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:27.442824 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938472.4420602, 365e0b89-d6ac-4681-ae36-1ca287152972 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:21:27.442924 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:21:27.443027 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] VM Stopped (Lifecycle Event)
May 28 03:21:27.471422 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:27.522854 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:21:27.551627 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Booting with volume f77902b2-75cb-417b-84e1-de1be4d40f2c at /dev/vda
May 28 03:21:27.584429 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:21:27.595410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:21:27.616747 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:21:27.648930 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:21:27.661979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:21:27.662366 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:21:27.671554 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:21:27.672247 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40'] 
May 28 03:21:27.672358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:21:27.672451 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:21:27.672749 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:21:27.672848 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Updating existing volume attachment record: 65c8cd4b-72c2-4911-92b9-b6cc56e82805 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:21:27.945468 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 365e0b89-d6ac-4681-ae36-1ca287152972] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:21:27.975649 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:28.152508 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b01cf9be-7076-4976-b126-07aa9fe8610e req-9ecaa950-dc19-40dc-a850-cc6c052a4c95 service nova] Releasing lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:21:28.153084 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:21:28.153339 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:21:28.708016 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:21:28.841129 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:28.946239 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Updating instance_info_cache with network_info: [{"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:21:29.447907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:21:29.448244 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Instance network_info: |[{"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:21:29.753751 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:21:29.755459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:21:29.755770 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Creating image(s)
May 28 03:21:29.756163 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:21:29.756379 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Ensure instance console log exists: /opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:21:29.756683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:29.756957 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:29.757140 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:29.757760 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Start _get_guest_xml network_info=[{"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '65c8cd4b-72c2-4911-92b9-b6cc56e82805', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'be3885fa-e626-44da-b935-85b52b277b5a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'serial': 'f77902b2-75cb-417b-84e1-de1be4d40f2c'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:21:29.760468 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:21:29.761835 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1164142962', uuid='be3885fa-e626-44da-b935-85b52b277b5a'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938489.7614305) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:21:29.763080 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:21:29.763485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:21:29.764640 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:21:29.764868 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:21:29.765955 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:21:29.766210 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:21:29.766362 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:21:29.766448 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:21:29.766558 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:21:29.766637 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:21:29.766744 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:21:29.766890 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:21:29.766981 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:21:29.767077 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:21:29.767168 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:21:29.767306 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:21:29.779540 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:21:29.779991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:21:29.780197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:21:29.780679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:21:29.780940 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:21:29.791970 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:21:29.792862 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:21:29.793253 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:21:29.794509 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:21:29.795193 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:21:29.795435 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:21:29.803900 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:21:29.803900 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:29.811543 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:21:29.811543 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:29.818060 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c] added
May 28 03:21:29.818060 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:21:29.818060 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:21:29.818060 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:21:29.818060 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:21:29.818060 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:21:29.818060 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:29.818368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:21:29.819436 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0253(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:21:29.819436 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:21:29.827629 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c] added
May 28 03:21:29.827629 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:21:29.827629 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:21:29.827629 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:21:29.827629 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:21:29.827629 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:21:29.827629 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:29.827850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:21:29.827890 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:21:29.828013 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:21:30.819239 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:21:30.828569 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:21:30.830785 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:21:30.830785 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:21:30.841359 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:21:30.841359 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:30.845923 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:30.852439 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:30.857442 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:21:30.857442 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:21:30.857569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:21:30.857569 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:21:30.857660 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:21:30.857660 np0000001589 nova-compute[98297]: 
May 28 03:21:30.863117 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:21:30.863117 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:21:30.863276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:21:30.863276 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:21:30.863375 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:21:30.863375 np0000001589 nova-compute[98297]: 
May 28 03:21:31.887619 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260]
May 28 03:21:31.887619 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260] successful.
May 28 03:21:31.887619 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:31.892888 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260]
May 28 03:21:31.892888 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260] successful.
May 28 03:21:31.892888 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:31.898706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:31.903593 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:21:31.910701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.910701 np0000001589 nova-compute[98297]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.910701 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:21:31.910833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.910833 np0000001589 nova-compute[98297]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.910833 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:21:31.911154 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.118s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:21:31.911341 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:21:31.911914 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('7', '-', '-', 0) found on session 215 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:21:31.912086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:21:31.916722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.916722 np0000001589 nova-compute[98297]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.916722 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:21:31.916872 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.916872 np0000001589 nova-compute[98297]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:21:31.916872 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:21:31.917041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.122s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:21:31.917145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:21:31.917573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('8', '-', '-', 0) found on session 216 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:21:31.917646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:21:31.926598 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 215 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:21:31.926598 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:21:31.931762 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 216 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:21:32.930855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 216 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:21:32.931293 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:21:32.976928 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:33.808955 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 33000000017c711b5 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:21:33.809101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:21:33.809242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '33000000017c711b5', 'path': '/dev/dm-0', 'multipath_id': '33000000017c711b5'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:21:33.809368 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000017c711b5', 'path': '/dev/dm-0', 'multipath_id': '33000000017c711b5'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:21:34.313845 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1164142962',display_name='tempest-TestVolumeBootPattern-server-1164142962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1164142962',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-y07be1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:21:27Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=be3885fa-e626-44da-b935-85b52b277b5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:21:34.314408 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:21:34.314739 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea39ca54-ae') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:21:34.315315 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid be3885fa-e626-44da-b935-85b52b277b5a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:21:34.818020 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] End _get_guest_xml xml=<domain type="qemu">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <uuid>be3885fa-e626-44da-b935-85b52b277b5a</uuid>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <name>instance-0000004a</name>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-1164142962</nova:name>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:21:29</nova:creationTime>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         <nova:port uuid="ea39ca54-aec0-43a3-91a7-c2a7c3d6388d">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <system>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <entry name="serial">be3885fa-e626-44da-b935-85b52b277b5a</entry>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <entry name="uuid">be3885fa-e626-44da-b935-85b52b277b5a</entry>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </system>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <os>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   </os>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <features>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   </features>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   <devices>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a/disk.config"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </disk>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <alias name="ua-f77902b2-75cb-417b-84e1-de1be4d40f2c"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <serial>f77902b2-75cb-417b-84e1-de1be4d40f2c</serial>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </disk>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:f6:cc:ff"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <target dev="tapea39ca54-ae"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </interface>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a/console.log" append="off"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </serial>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <video>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </video>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </rng>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:   </devices>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]: </domain>
May 28 03:21:34.818020 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:21:34.820308 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Preparing to wait for external event network-vif-plugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:21:34.820308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:34.820308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:34.820308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:34.820308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1164142962',display_name='tempest-TestVolumeBootPattern-server-1164142962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1164142962',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-y07be1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:21:27Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=be3885fa-e626-44da-b935-85b52b277b5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:21:34.820308 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:21:34.820308 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea39ca54-ae') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:21:34.821023 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea39ca54-ae') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:21:34.821023 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:34.821206 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:34.821505 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:21:34.822065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:34.822246 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '128934e9-5e91-5b4d-8392-c8b40b4accc9', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:34.822956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:34.823686 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:34.823852 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:34.825858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:34.825999 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea39ca54-ae, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:34.826324 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea39ca54-ae, col_values=(('qos', UUID('1ba8db3a-bffb-4cdc-a163-e45a4a188444')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:34.826492 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea39ca54-ae, col_values=(('external_ids', {'iface-id': 'ea39ca54-aec0-43a3-91a7-c2a7c3d6388d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:cc:ff', 'vm-uuid': 'be3885fa-e626-44da-b935-85b52b277b5a'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:21:34.827155 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:34.828691 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:21:34.832468 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:34.833154 np0000001589 nova-compute[98297]: INFO os_vif [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea39ca54-ae')
May 28 03:21:36.348592 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:21:36.349015 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:21:36.349015 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:f6:cc:ff, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:21:36.349094 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Using config drive
May 28 03:21:36.854554 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:36.972238 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Creating config drive at /opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a/disk.config
May 28 03:21:36.975131 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6ir4v470 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:21:37.026647 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6ir4v470" returned: 0 in 0.051s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:21:37.388833 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:37.405267 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:37.406523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:37.481354 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:37.531094 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-38f9ec82-5d95-4f75-a2a8-381bc912b1d3 req-3a92956e-1f67-4b56-9550-263773d12dc4 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-vif-plugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:37.531138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-38f9ec82-5d95-4f75-a2a8-381bc912b1d3 req-3a92956e-1f67-4b56-9550-263773d12dc4 service nova] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:37.531390 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-38f9ec82-5d95-4f75-a2a8-381bc912b1d3 req-3a92956e-1f67-4b56-9550-263773d12dc4 service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:37.531607 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-38f9ec82-5d95-4f75-a2a8-381bc912b1d3 req-3a92956e-1f67-4b56-9550-263773d12dc4 service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:37.531691 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-38f9ec82-5d95-4f75-a2a8-381bc912b1d3 req-3a92956e-1f67-4b56-9550-263773d12dc4 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Processing event network-vif-plugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:21:37.723897 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:37.728348 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:37.740725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:38.044039 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938498.0436292, be3885fa-e626-44da-b935-85b52b277b5a => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:21:38.044583 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:21:38.044763 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] VM Started (Lifecycle Event)
May 28 03:21:38.047130 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:21:38.050001 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Instance spawned successfully.
May 28 03:21:38.050288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:21:38.417891 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:38.549438 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:21:38.554361 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:21:38.557476 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:21:38.559253 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:21:38.559253 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:21:38.559253 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:21:38.559253 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:21:38.559253 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:21:39.057395 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:21:39.057525 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938499.0573986, be3885fa-e626-44da-b935-85b52b277b5a => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:21:39.057656 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] VM Paused (Lifecycle Event)
May 28 03:21:39.063552 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Took 9.31 seconds to spawn the instance on the hypervisor.
May 28 03:21:39.063748 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:21:39.137698 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:39.138036 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:39.559782 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:21:39.564252 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938499.562255, be3885fa-e626-44da-b935-85b52b277b5a => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:21:39.564252 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] VM Resumed (Lifecycle Event)
May 28 03:21:39.571485 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Took 16.17 seconds to build instance.
May 28 03:21:39.579273 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c7969f98-cc00-4982-9713-0ec755580040 req-e8639206-5649-42ea-a23c-1d60da806863 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-vif-plugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:39.579436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7969f98-cc00-4982-9713-0ec755580040 req-e8639206-5649-42ea-a23c-1d60da806863 service nova] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:39.579578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7969f98-cc00-4982-9713-0ec755580040 req-e8639206-5649-42ea-a23c-1d60da806863 service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:39.579676 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c7969f98-cc00-4982-9713-0ec755580040 req-e8639206-5649-42ea-a23c-1d60da806863 service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:39.579780 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c7969f98-cc00-4982-9713-0ec755580040 req-e8639206-5649-42ea-a23c-1d60da806863 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] No waiting events found dispatching network-vif-plugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:21:39.579890 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c7969f98-cc00-4982-9713-0ec755580040 req-e8639206-5649-42ea-a23c-1d60da806863 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received unexpected event network-vif-plugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d for instance with vm_state active and task_state None.
May 28 03:21:39.828741 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:40.064742 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:21:40.066537 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:21:40.074964 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ff1e5351-2062-409f-80d0-760cdc3aa502 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.675s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:41.640077 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-changed-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:21:41.640538 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Refreshing instance network info cache due to event network-changed-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:21:41.640668 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] Acquiring lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:21:41.640768 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] Acquired lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:21:41.640893 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Refreshing network info cache for port ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:21:42.142756 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:42.437575 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:21:42.549564 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Updated VIF entry in instance network info cache for port ea39ca54-aec0-43a3-91a7-c2a7c3d6388d. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:21:42.549798 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Updating instance_info_cache with network_info: [{"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:21:43.051559 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-374280d7-318a-4692-935f-ae870653f07d req-5c5069bb-92c0-474f-a9ec-7df7f7ebbd3a service nova] Releasing lock "refresh_cache-be3885fa-e626-44da-b935-85b52b277b5a" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:21:43.427955 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:44.830813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:45.137691 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:45.137839 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:21:45.138015 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:45.642849 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:45.643070 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:45.643275 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:45.643429 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:21:46.662616 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:21:46.664169 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:21:46.665025 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:21:46.714275 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:21:46.714678 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13728MB free_disk=72.65866088867188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:21:46.714821 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:21:46.715060 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:21:47.765866 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance be3885fa-e626-44da-b935-85b52b277b5a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:21:47.766146 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:21:47.766146 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:21:46 up 49 min,  2 users,  load average: 1.93, 3.68, 4.19\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_26deda1c00a84355951239b1a62997e8': '1', 'io_workload': '0'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:21:47.844456 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:21:47.844650 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:21:48.346933 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:21:48.439918 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:48.852710 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:21:48.853188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:21:48.853188 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:49.832723 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:50.853290 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:50.853689 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:50.853689 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.28 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:51.138205 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:51.138510 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:51.780502 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:52.134122 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:52.134635 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:53.455915 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:54.134115 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:54.134489 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:54.834888 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:58.137753 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:21:58.138191 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 43.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:21:58.470847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:21:59.836828 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:03.480956 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:04.838785 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:08.490908 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.030804 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:09.031018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:09.031177 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:09.031338 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:09.031447 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:09.034195 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Terminating instance
May 28 03:22:09.537074 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:22:09.562879 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.564556 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.576201 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.579714 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.595888 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.676363 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-02f3ffae-f57b-409f-ae99-5e7b8546f855 req-5e54342e-b02f-4e33-b82d-54646e53285d service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-vif-unplugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:22:09.676602 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-02f3ffae-f57b-409f-ae99-5e7b8546f855 req-5e54342e-b02f-4e33-b82d-54646e53285d service nova] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:09.677056 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-02f3ffae-f57b-409f-ae99-5e7b8546f855 req-5e54342e-b02f-4e33-b82d-54646e53285d service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:09.677368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-02f3ffae-f57b-409f-ae99-5e7b8546f855 req-5e54342e-b02f-4e33-b82d-54646e53285d service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:09.677443 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-02f3ffae-f57b-409f-ae99-5e7b8546f855 req-5e54342e-b02f-4e33-b82d-54646e53285d service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] No waiting events found dispatching network-vif-unplugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:22:09.677563 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-02f3ffae-f57b-409f-ae99-5e7b8546f855 req-5e54342e-b02f-4e33-b82d-54646e53285d service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-vif-unplugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:22:09.738644 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.824093 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.830813 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.839119 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:09.853785 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999716810999871 future=<Future at 0x7e4b4068fd70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:22:09.854098 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999398536000172 future=<Future at 0x7e4b4068fd70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:22:09.854359 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999115746999905 future=<Future at 0x7e4b4068fd70 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:22:09.856323 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Instance destroyed successfully.
May 28 03:22:09.856685 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid be3885fa-e626-44da-b935-85b52b277b5a {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:22:10.358974 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1164142962',display_name='tempest-TestVolumeBootPattern-server-1164142962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1164142962',id=74,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:21:39Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-y07be1uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:21:39Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=be3885fa-e626-44da-b935-85b52b277b5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:22:10.359319 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "address": "fa:16:3e:f6:cc:ff", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapea39ca54-ae", "ovs_interfaceid": "ea39ca54-aec0-43a3-91a7-c2a7c3d6388d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:22:10.360443 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea39ca54-ae') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:22:10.360710 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea39ca54-ae') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:22:10.361881 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:10.362096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea39ca54-ae, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:22:10.363038 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:10.363871 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:22:10.364595 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:10.364725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1ba8db3a-bffb-4cdc-a163-e45a4a188444) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:22:10.365138 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:10.365635 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:22:10.367154 np0000001589 nova-compute[98297]: INFO os_vif [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:cc:ff,bridge_name='br-int',has_traffic_filtering=True,id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea39ca54-ae')
May 28 03:22:10.368478 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:22:10.368770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:22:10.368895 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:22:10.369291 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:22:10.369586 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:22:10.369709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:22:10.391969 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:10.391969 np0000001589 nova-compute[98297]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:10.391969 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:22:10.392213 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [215] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:10.392213 np0000001589 nova-compute[98297]: tcp: [216] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:10.392213 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:22:10.392331 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '215'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '216')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:22:10.392478 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '215')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:22:10.393240 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '216')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:22:10.393854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646d2340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:22:10.394036 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:22:10.394258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 33000000017c711b5 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:22:10.443537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:22:10.492648 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:22:10.527531 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:22:10.527708 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:22:10.528406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:22:10.538508 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:22:10.538886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:22:10.549086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:10.579127 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260]
May 28 03:22:10.579127 np0000001589 nova-compute[98297]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260] successful.
May 28 03:22:10.579127 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:10.590552 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:10.602240 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:10.630209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260]
May 28 03:22:10.630209 np0000001589 nova-compute[98297]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260] successful.
May 28 03:22:10.630209 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:10.640454 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:10.640709 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:22:10.640839 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (272ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:22:10.640950 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:22:10.641235 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Deleting instance files /opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a_del
May 28 03:22:10.641713 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Deletion of /opt/stack/data/nova/instances/be3885fa-e626-44da-b935-85b52b277b5a_del complete
May 28 03:22:11.147028 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Took 1.61 seconds to destroy the instance on the hypervisor.
May 28 03:22:11.147570 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:22:11.147904 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:22:11.148054 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: be3885fa-e626-44da-b935-85b52b277b5a] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:22:11.148354 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:11.203348 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:11.582788 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3aa382ac-9280-42fc-8cf2-e32632bed2cd req-049e8a1d-7b02-4a9f-88f6-be33f42a2a79 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-vif-deleted-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:22:11.583131 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-3aa382ac-9280-42fc-8cf2-e32632bed2cd req-049e8a1d-7b02-4a9f-88f6-be33f42a2a79 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Neutron deleted interface ea39ca54-aec0-43a3-91a7-c2a7c3d6388d; detaching it from the instance and deleting it from the info cache
May 28 03:22:11.584656 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-3aa382ac-9280-42fc-8cf2-e32632bed2cd req-049e8a1d-7b02-4a9f-88f6-be33f42a2a79 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Detach interface failed, port_id=ea39ca54-aec0-43a3-91a7-c2a7c3d6388d, reason: Instance be3885fa-e626-44da-b935-85b52b277b5a could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:22:11.728872 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bb598f9d-7c93-45b4-89f4-41f589228b1d req-3bf414c4-4495-436e-9df0-f3c7f97eb6c8 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-vif-unplugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:22:11.729008 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bb598f9d-7c93-45b4-89f4-41f589228b1d req-3bf414c4-4495-436e-9df0-f3c7f97eb6c8 service nova] Acquiring lock "be3885fa-e626-44da-b935-85b52b277b5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:11.729176 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bb598f9d-7c93-45b4-89f4-41f589228b1d req-3bf414c4-4495-436e-9df0-f3c7f97eb6c8 service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:11.729316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-bb598f9d-7c93-45b4-89f4-41f589228b1d req-3bf414c4-4495-436e-9df0-f3c7f97eb6c8 service nova] Lock "be3885fa-e626-44da-b935-85b52b277b5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:11.729429 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bb598f9d-7c93-45b4-89f4-41f589228b1d req-3bf414c4-4495-436e-9df0-f3c7f97eb6c8 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] No waiting events found dispatching network-vif-unplugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:22:11.729528 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bb598f9d-7c93-45b4-89f4-41f589228b1d req-3bf414c4-4495-436e-9df0-f3c7f97eb6c8 service nova] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Received event network-vif-unplugged-ea39ca54-aec0-43a3-91a7-c2a7c3d6388d for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:22:12.040062 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:22:12.541789 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Took 1.39 seconds to deallocate network for instance.
May 28 03:22:13.085155 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:22:13.499999 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:13.590291 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:13.590445 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:13.666218 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:22:13.666434 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:22:14.168643 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:22:14.675302 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.085s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:14.717155 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance be3885fa-e626-44da-b935-85b52b277b5a
May 28 03:22:15.365719 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:15.723939 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-0efcfcca-3248-40cc-9832-bc6596389337 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "be3885fa-e626-44da-b935-85b52b277b5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.693s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:16.635174 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:16.635566 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:17.136807 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:22:17.680273 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:17.680599 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:17.683796 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:22:17.683935 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Claim successful on node np0000001589
May 28 03:22:18.766973 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:22:18.767288 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:22:19.269793 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:22:19.775603 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.095s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:19.776058 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:22:20.281449 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:22:20.281733 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:22:20.281990 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:20.282196 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:20.345037 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:22:20.367254 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:20.741795 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Successfully created port: 928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:22:20.784604 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:22:21.142929 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Successfully updated port: 928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:22:21.185158 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-changed-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:22:21.185548 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Refreshing instance network info cache due to event network-changed-928499be-9583-40ad-bff6-51f72f17d7e6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:22:21.185877 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] Acquiring lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:22:21.186316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] Acquired lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:22:21.187215 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Refreshing network info cache for port 928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:22:21.288377 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:22:21.644660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:22:21.689360 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:21.740129 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:22:21.792482 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Booting with volume f77902b2-75cb-417b-84e1-de1be4d40f2c at /dev/vda
May 28 03:22:21.827420 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:22:21.838861 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:22:21.855271 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:22:21.859089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:22:21.904701 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:22:21.904965 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:22:21.912855 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:22:21.913677 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40'] 
May 28 03:22:21.913778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:22:21.913887 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:22:21.914106 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:22:21.914340 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updating existing volume attachment record: c7a92feb-7312-4530-bd70-ccbe3cec17cf {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:22:22.357368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a50c15df-58f8-4d0e-b4f0-60c8704e9f7e req-46dc794f-b09c-4d61-a151-fab7cd3833e5 service nova] Releasing lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:22:22.357812 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:22:22.357973 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:22:22.911325 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:22:23.038979 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:23.147162 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updating instance_info_cache with network_info: [{"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:22:23.654450 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:22:23.654450 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Instance network_info: |[{"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:22:23.995506 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:22:23.996681 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:22:23.996912 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Creating image(s)
May 28 03:22:23.997180 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:22:23.997325 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Ensure instance console log exists: /opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:22:23.997550 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:23.997861 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:23.997979 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:23.998413 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Start _get_guest_xml network_info=[{"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'c7a92feb-7312-4530-bd70-ccbe3cec17cf', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '2a80e751-6fc9-466a-baea-e49c3585f705', 'attached_at': '', 'detached_at': '', 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'serial': 'f77902b2-75cb-417b-84e1-de1be4d40f2c'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:22:24.002341 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:22:24.003297 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1311825354', uuid='2a80e751-6fc9-466a-baea-e49c3585f705'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938544.0029683) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:22:24.004365 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:22:24.004644 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:22:24.005551 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:22:24.005723 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:22:24.006520 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:22:24.006770 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:22:24.006933 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:22:24.006990 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:22:24.007086 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:22:24.007161 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:22:24.007301 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:22:24.007445 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:22:24.007538 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:22:24.007640 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:22:24.007763 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:22:24.007870 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:22:24.016815 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:22:24.017094 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:22:24.017204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:22:24.017534 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:22:24.017732 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:22:24.028828 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:22:24.029395 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:22:24.029842 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:22:24.030043 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:22:24.030646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:22:24.030807 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:22:24.040624 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:22:24.040624 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:24.044580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:22:24.044580 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:24.051363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c] added
May 28 03:22:24.051363 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:22:24.051363 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:22:24.051363 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:22:24.051363 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:22:24.051363 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:22:24.051363 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:24.051527 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:22:24.051675 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0216(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:22:24.051821 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:22:24.055172 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c] added
May 28 03:22:24.055172 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:22:24.055172 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:22:24.055172 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:22:24.055172 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:22:24.055172 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:22:24.055172 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:24.055351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:22:24.055476 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:22:24.055595 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:22:24.853883 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003720669997164805 future=<Future at 0x7e4b4068fd70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:22:24.854325 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938529.8534038, be3885fa-e626-44da-b935-85b52b277b5a => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:22:24.854456 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] VM Stopped (Lifecycle Event)
May 28 03:22:24.855014 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:22:25.052247 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:22:25.056016 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:22:25.065390 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:22:25.065390 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:22:25.070769 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:22:25.070769 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:25.076845 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:25.085009 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:25.089312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:22:25.089312 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:22:25.089440 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:22:25.089440 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:22:25.089560 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:22:25.089560 np0000001589 nova-compute[98297]: 
May 28 03:22:25.096993 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:22:25.096993 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:22:25.097084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:22:25.097084 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:22:25.097174 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:22:25.097174 np0000001589 nova-compute[98297]: 
May 28 03:22:25.357567 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-c2ce8e68-a752-4fe1-96b8-5a775ca42219 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: be3885fa-e626-44da-b935-85b52b277b5a] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:22:25.368094 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:22:25.368430 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:22:25.368561 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=98297) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 03:22:25.368561 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:22:25.369004 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:25.369170 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:22:26.122485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260]
May 28 03:22:26.122485 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260] successful.
May 28 03:22:26.122485 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:26.123171 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260]
May 28 03:22:26.123171 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260] successful.
May 28 03:22:26.123171 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:26.134196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:26.139795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:22:26.146679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.146679 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.146679 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:22:26.146841 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.146841 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.146841 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:22:26.147049 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.117s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:22:26.147164 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:22:26.147663 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('7', '-', '-', 0) found on session 217 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:22:26.147771 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:22:26.152058 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.152058 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.152058 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:22:26.152196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.152196 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:22:26.152196 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:22:26.152380 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.122s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:22:26.152466 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:22:26.152818 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('8', '-', '-', 0) found on session 218 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:22:26.152895 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:22:26.161461 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 217 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:22:26.161644 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:22:26.167101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 218 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:22:27.166043 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 218 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:22:27.166479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:22:28.045374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 33000000017c711b5 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:22:28.045602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:22:28.045759 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (4028ms) {'type': 'block', 'scsi_wwn': '33000000017c711b5', 'path': '/dev/dm-0', 'multipath_id': '33000000017c711b5'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:22:28.045865 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000017c711b5', 'path': '/dev/dm-0', 'multipath_id': '33000000017c711b5'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:22:28.551002 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1311825354',display_name='tempest-TestVolumeBootPattern-server-1311825354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1311825354',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-p3knrqwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:22:21Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=2a80e751-6fc9-466a-baea-e49c3585f705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:22:28.551495 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:22:28.552091 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:93,bridge_name='br-int',has_traffic_filtering=True,id=928499be-9583-40ad-bff6-51f72f17d7e6,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928499be-95') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:22:28.552888 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a80e751-6fc9-466a-baea-e49c3585f705 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:22:29.055424 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] End _get_guest_xml xml=<domain type="qemu">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <uuid>2a80e751-6fc9-466a-baea-e49c3585f705</uuid>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <name>instance-0000004b</name>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-1311825354</nova:name>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:22:24</nova:creationTime>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         <nova:port uuid="928499be-9583-40ad-bff6-51f72f17d7e6">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <system>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <entry name="serial">2a80e751-6fc9-466a-baea-e49c3585f705</entry>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <entry name="uuid">2a80e751-6fc9-466a-baea-e49c3585f705</entry>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </system>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <os>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   </os>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <features>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   </features>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   <devices>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705/disk.config"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </disk>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <alias name="ua-f77902b2-75cb-417b-84e1-de1be4d40f2c"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <serial>f77902b2-75cb-417b-84e1-de1be4d40f2c</serial>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </disk>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:2a:3a:93"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <target dev="tap928499be-95"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </interface>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705/console.log" append="off"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </serial>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <video>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </video>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </rng>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:   </devices>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]: </domain>
May 28 03:22:29.055424 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:22:29.057334 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Preparing to wait for external event network-vif-plugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:22:29.057334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:29.057334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:29.057334 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:29.057334 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1311825354',display_name='tempest-TestVolumeBootPattern-server-1311825354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1311825354',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-p3knrqwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:22:21Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=2a80e751-6fc9-466a-baea-e49c3585f705,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:22:29.057334 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:22:29.057334 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:93,bridge_name='br-int',has_traffic_filtering=True,id=928499be-9583-40ad-bff6-51f72f17d7e6,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928499be-95') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:22:29.057606 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:93,bridge_name='br-int',has_traffic_filtering=True,id=928499be-9583-40ad-bff6-51f72f17d7e6,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928499be-95') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:22:29.057811 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:29.058125 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:22:29.058448 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:22:29.058951 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:29.059120 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dadca5b0-15f4-5f54-9fc5-9ea2740ff2ef', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:22:29.059920 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:29.060595 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:22:29.062155 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:29.062336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap928499be-95, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:22:29.062725 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap928499be-95, col_values=(('qos', UUID('406b8cbe-7462-4c0a-b025-f3935cf3ab7b')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:22:29.062966 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap928499be-95, col_values=(('external_ids', {'iface-id': '928499be-9583-40ad-bff6-51f72f17d7e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:3a:93', 'vm-uuid': '2a80e751-6fc9-466a-baea-e49c3585f705'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:22:29.064021 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:29.064619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:22:29.068987 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:29.069866 np0000001589 nova-compute[98297]: INFO os_vif [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:3a:93,bridge_name='br-int',has_traffic_filtering=True,id=928499be-9583-40ad-bff6-51f72f17d7e6,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928499be-95')
May 28 03:22:30.583720 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:22:30.584201 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:22:30.584201 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:2a:3a:93, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:22:30.584476 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Using config drive
May 28 03:22:31.090450 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:31.199678 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Creating config drive at /opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705/disk.config
May 28 03:22:31.202487 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpydiq0nkk {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:22:31.256725 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpydiq0nkk" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:22:31.616500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:31.631923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:31.717120 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:31.722390 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:31.764738 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-94733898-b770-4151-bca8-49042d5815ed req-c0031144-244d-4647-9217-502a35cef10e service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-vif-plugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:22:31.765527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94733898-b770-4151-bca8-49042d5815ed req-c0031144-244d-4647-9217-502a35cef10e service nova] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:31.765527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94733898-b770-4151-bca8-49042d5815ed req-c0031144-244d-4647-9217-502a35cef10e service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:31.765527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94733898-b770-4151-bca8-49042d5815ed req-c0031144-244d-4647-9217-502a35cef10e service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:31.765527 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-94733898-b770-4151-bca8-49042d5815ed req-c0031144-244d-4647-9217-502a35cef10e service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Processing event network-vif-plugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:22:31.930479 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:31.934589 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:31.946425 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:32.260609 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938552.2602174, 2a80e751-6fc9-466a-baea-e49c3585f705 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:22:32.261106 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:22:32.261276 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] VM Started (Lifecycle Event)
May 28 03:22:32.263272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:22:32.265685 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Instance spawned successfully.
May 28 03:22:32.265969 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:22:32.763978 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:22:32.766198 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:22:32.772004 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:22:32.772245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:22:32.772417 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:22:32.773612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:22:32.773612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:22:32.773612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:22:33.270158 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:22:33.270417 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938553.2702541, 2a80e751-6fc9-466a-baea-e49c3585f705 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:22:33.270518 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] VM Paused (Lifecycle Event)
May 28 03:22:33.277594 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Took 9.28 seconds to spawn the instance on the hypervisor.
May 28 03:22:33.277758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:22:33.520995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:33.772569 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:22:33.774632 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938553.7744083, 2a80e751-6fc9-466a-baea-e49c3585f705 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:22:33.774766 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] VM Resumed (Lifecycle Event)
May 28 03:22:33.785786 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Took 16.15 seconds to build instance.
May 28 03:22:33.825888 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c23eb027-033b-4f9e-8a43-172b61d17d9d req-7814059b-41a4-4b40-97ea-b4dc2a164dd4 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-vif-plugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:22:33.826300 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c23eb027-033b-4f9e-8a43-172b61d17d9d req-7814059b-41a4-4b40-97ea-b4dc2a164dd4 service nova] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:33.826464 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c23eb027-033b-4f9e-8a43-172b61d17d9d req-7814059b-41a4-4b40-97ea-b4dc2a164dd4 service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:33.826571 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-c23eb027-033b-4f9e-8a43-172b61d17d9d req-7814059b-41a4-4b40-97ea-b4dc2a164dd4 service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:33.826701 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-c23eb027-033b-4f9e-8a43-172b61d17d9d req-7814059b-41a4-4b40-97ea-b4dc2a164dd4 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] No waiting events found dispatching network-vif-plugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:22:33.826805 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-c23eb027-033b-4f9e-8a43-172b61d17d9d req-7814059b-41a4-4b40-97ea-b4dc2a164dd4 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received unexpected event network-vif-plugged-928499be-9583-40ad-bff6-51f72f17d7e6 for instance with vm_state active and task_state None.
May 28 03:22:34.065144 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:34.276983 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:22:34.278860 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:22:34.289223 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.654s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:35.622095 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-changed-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:22:35.622413 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Refreshing instance network info cache due to event network-changed-928499be-9583-40ad-bff6-51f72f17d7e6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:22:35.622457 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] Acquiring lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:22:35.622527 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] Acquired lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:22:35.622648 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Refreshing network info cache for port 928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:22:36.124755 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:36.385853 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:22:36.505175 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updated VIF entry in instance network info cache for port 928499be-9583-40ad-bff6-51f72f17d7e6. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:22:36.505487 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updating instance_info_cache with network_info: [{"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:22:37.007346 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f520285d-ab3a-4a49-95c4-0048051fc446 req-117143f8-0360-4bca-9180-277e585939f7 service nova] Releasing lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:22:38.541355 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:39.066730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:41.137693 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:41.138392 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:22:43.552189 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:44.067443 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:47.137712 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:47.138140 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:22:47.138140 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:47.642020 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:47.642322 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:47.642478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:47.642610 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:22:48.570346 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:48.659283 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:22:48.660875 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:22:48.662093 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:22:48.709738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:22:48.710399 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13762MB free_disk=72.65565490722656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:22:48.710399 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:22:48.710523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:22:49.068657 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:49.760283 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 2a80e751-6fc9-466a-baea-e49c3585f705 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:22:49.760720 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:22:49.760720 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:22:48 up 50 min,  2 users,  load average: 1.14, 3.09, 3.95\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_26deda1c00a84355951239b1a62997e8': '1', 'io_workload': '0'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:22:49.835479 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:22:49.835692 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:22:50.338178 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:22:50.844296 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:22:50.844677 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.134s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:22:50.844725 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:51.346416 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:22:52.346427 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:52.346971 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:52.346971 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:52.347197 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.79 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:22:53.584315 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:54.069347 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:55.134343 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:55.134823 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:22:57.137836 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:57.138287 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98297) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 03:22:57.639697 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:22:58.602595 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:59.070421 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:22:59.639562 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:22:59.640020 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:03.137766 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:03.138251 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 03:23:03.609199 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:03.639808 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] There are 0 instances to clean {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 03:23:03.640022 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 39.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:04.071356 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:08.625178 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:09.072134 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:13.638249 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:14.073273 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:15.691289 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:15.691289 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:16.192779 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:23:16.735858 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:16.736154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:16.738773 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:23:16.738919 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Claim successful on node np0000001589
May 28 03:23:17.853912 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:23:17.854246 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:23:18.356360 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:23:18.862113 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.126s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:18.862515 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:23:19.074620 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:19.367534 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:23:19.367946 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:23:19.368285 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:23:19.368583 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:23:19.428961 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e2ca3a798ab496688b9e1eff9490c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26deda1c00a84355951239b1a62997e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:23:19.831851 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Successfully created port: 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:23:19.868505 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:23:20.022092 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:20.244553 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Successfully updated port: 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:23:20.286654 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-changed-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:23:20.286954 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Refreshing instance network info cache due to event network-changed-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:23:20.287104 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] Acquiring lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:23:20.287179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] Acquired lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:23:20.287308 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Refreshing network info cache for port 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:23:20.371803 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:23:20.746405 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:23:20.788895 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:23:20.841189 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:23:20.876626 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Booting with volume ac823d0d-897c-49e5-9665-26c6f5c4b8cb at /dev/vda
May 28 03:23:20.910315 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:23:20.920527 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:23:20.939492 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:23:20.967207 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:23:20.982893 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:23:20.983130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:23:20.991166 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:23:20.992103 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe2a:3a93', 'fe80::f861:80ff:fe4e:b461'] 
May 28 03:23:20.993475 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:23:20.993617 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:23:20.993839 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:23:20.994016 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updating existing volume attachment record: 752a58d5-b08a-43ac-a97c-01eb3ec8e948 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:23:21.470734 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4ae1f977-10ce-4056-a40d-368569c58cd1 req-ee9b6337-6047-4fe9-90a4-6acbbe53cf9f service nova] Releasing lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:23:21.471115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquired lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:23:21.471271 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:23:22.024728 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:23:22.164710 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:23:22.272568 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updating instance_info_cache with network_info: [{"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:23:22.774243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Releasing lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:23:22.774609 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Instance network_info: |[{"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:23:23.083088 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:23:23.084182 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:23:23.084461 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Creating image(s)
May 28 03:23:23.084763 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:23:23.084897 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Ensure instance console log exists: /opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:23:23.085117 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:23.085323 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:23.085440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:23.085855 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Start _get_guest_xml network_info=[{"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '752a58d5-b08a-43ac-a97c-01eb3ec8e948', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '83270ace-cb03-4552-9941-abcb51b8cca8', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'serial': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:23:23.089425 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:23:23.090397 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1892436298', uuid='83270ace-cb03-4552-9941-abcb51b8cca8'), owner=OwnerMeta(userid='7e2ca3a798ab496688b9e1eff9490c2d', username='tempest-TestVolumeBootPattern-273662808-project-member', projectid='26deda1c00a84355951239b1a62997e8', projectname='tempest-TestVolumeBootPattern-273662808'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938603.0900795) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:23:23.091453 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:23:23.092148 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:23:23.092775 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:23:23.092921 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:23:23.093731 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:23:23.093969 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:23:23.094088 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:23:23.094175 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:23:23.094305 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:23:23.094382 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:23:23.094466 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:23:23.094614 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:23:23.094703 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:23:23.094803 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:23:23.094896 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:23:23.095014 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:23:23.104365 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:23:23.104699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:23:23.104827 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:23:23.105158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:23:23.105348 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:23:23.116609 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:23:23.117039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:23:23.117277 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:23:23.117881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:23:23.118320 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:23:23.118494 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:23:23.128077 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:23:23.128077 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:23.132162 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:23:23.132162 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:23.138884 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb] added
May 28 03:23:23.138884 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:23:23.138884 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:23:23.138884 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:23:23.138884 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:23:23.138884 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:23:23.138884 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:23.139141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:23:23.139429 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.022(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:23:23.139673 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:23:23.142054 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb] added
May 28 03:23:23.142054 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:23:23.142054 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:23:23.142054 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:23:23.142054 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:23:23.142054 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:23:23.142054 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:23.142303 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:23:23.142349 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:23:23.142467 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:23:24.075597 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:24.140206 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:23:24.142930 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:23:24.152201 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:23:24.152201 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:23:24.158437 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:23:24.158437 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.163290 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.169372 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.176197 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.176197 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.176197 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:23:24.176361 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.176361 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.176361 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:23:24.181795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.181795 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.181795 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:23:24.181795 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.181795 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.181795 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:23:24.205604 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.40.100,3260]
May 28 03:23:24.205604 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.40.100,3260] successful.
May 28 03:23:24.205604 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.215424 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.216511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.50.100,3260]
May 28 03:23:24.216511 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.50.100,3260] successful.
May 28 03:23:24.216511 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.228491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.228491 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.228491 np0000001589 nova-compute[98297]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.228491 np0000001589 nova-compute[98297]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.228491 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:23:24.228656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.228656 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.228656 np0000001589 nova-compute[98297]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.228656 np0000001589 nova-compute[98297]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.228656 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:23:24.228946 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.112s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:23:24.229084 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:23:24.229690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('9', '-', '-', 0) found on session 219 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:23:24.229828 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:23:24.234150 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:23:24.243542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 219 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:23:24.243542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:23:24.246623 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.246623 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.246623 np0000001589 nova-compute[98297]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.246623 np0000001589 nova-compute[98297]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.246623 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:23:24.246785 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.246785 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:23:24.246785 np0000001589 nova-compute[98297]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.246785 np0000001589 nova-compute[98297]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:23:24.246785 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:23:24.246982 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:23:24.247074 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:23:24.247566 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] HCTL ('10', '-', '-', 0) found on session 220 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:23:24.247673 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:23:24.260159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Searching for a device in session 220 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:23:24.260159 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:23:25.119086 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:23:26.133573 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Found WWN 3300000001768c1a9 for multipath device dm-3 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:23:26.133984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:23:26.134041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000001768c1a9', 'path': '/dev/dm-3', 'multipath_id': '3300000001768c1a9'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:23:26.134196 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001768c1a9', 'path': '/dev/dm-3', 'multipath_id': '3300000001768c1a9'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:23:26.638928 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1892436298',display_name='tempest-TestVolumeBootPattern-server-1892436298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1892436298',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-br055tc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:23:20Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=83270ace-cb03-4552-9941-abcb51b8cca8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:23:26.639117 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:23:26.639644 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:9a,bridge_name='br-int',has_traffic_filtering=True,id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7f68b-a8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:23:26.640297 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'pci_devices' on Instance uuid 83270ace-cb03-4552-9941-abcb51b8cca8 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:23:27.142571 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] End _get_guest_xml xml=<domain type="qemu">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <uuid>83270ace-cb03-4552-9941-abcb51b8cca8</uuid>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <name>instance-0000004c</name>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPattern-server-1892436298</nova:name>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:23:23</nova:creationTime>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:user uuid="7e2ca3a798ab496688b9e1eff9490c2d">tempest-TestVolumeBootPattern-273662808-project-member</nova:user>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:project uuid="26deda1c00a84355951239b1a62997e8">tempest-TestVolumeBootPattern-273662808</nova:project>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         <nova:port uuid="1cf7f68b-a87d-40cb-b19c-bfa2dee7815c">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <system>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <entry name="serial">83270ace-cb03-4552-9941-abcb51b8cca8</entry>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <entry name="uuid">83270ace-cb03-4552-9941-abcb51b8cca8</entry>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </system>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <os>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   </os>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <features>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   </features>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   <devices>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8/disk.config"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </disk>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <alias name="ua-ac823d0d-897c-49e5-9665-26c6f5c4b8cb"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-3"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <serial>ac823d0d-897c-49e5-9665-26c6f5c4b8cb</serial>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </disk>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d1:ae:9a"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <target dev="tap1cf7f68b-a8"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </interface>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8/console.log" append="off"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </serial>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <video>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </video>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </rng>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:   </devices>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]: </domain>
May 28 03:23:27.142571 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Preparing to wait for external event network-vif-plugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1892436298',display_name='tempest-TestVolumeBootPattern-server-1892436298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1892436298',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-br055tc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:23:20Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=83270ace-cb03-4552-9941-abcb51b8cca8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:9a,bridge_name='br-int',has_traffic_filtering=True,id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7f68b-a8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:9a,bridge_name='br-int',has_traffic_filtering=True,id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7f68b-a8') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:23:27.144862 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:27.145199 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:23:27.145373 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:23:27.145865 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:27.146004 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2d42be8-67ef-584e-84de-5f5adfcbbc10', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:23:27.146702 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:27.147327 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:23:27.147786 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:27.149115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:27.149237 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cf7f68b-a8, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:23:27.149508 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cf7f68b-a8, col_values=(('qos', UUID('3db7177e-5436-4e1d-a691-221db77f5b1c')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:23:27.149664 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cf7f68b-a8, col_values=(('external_ids', {'iface-id': '1cf7f68b-a87d-40cb-b19c-bfa2dee7815c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:ae:9a', 'vm-uuid': '83270ace-cb03-4552-9941-abcb51b8cca8'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:23:27.150264 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:27.151781 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:23:27.155323 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:27.155887 np0000001589 nova-compute[98297]: INFO os_vif [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:ae:9a,bridge_name='br-int',has_traffic_filtering=True,id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7f68b-a8')
May 28 03:23:28.668908 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:23:28.669329 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:23:28.669329 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] No VIF found with MAC fa:16:3e:d1:ae:9a, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:23:28.669392 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Using config drive
May 28 03:23:29.173972 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:23:29.275118 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Creating config drive at /opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8/disk.config
May 28 03:23:29.277905 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl9nw098d {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:23:29.332295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpl9nw098d" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:23:29.718720 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:29.733751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:29.734812 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:29.821069 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:29.846714 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-94c2befe-0655-474a-8e60-407ece237f39 req-f28304a5-120f-49fa-ac0f-dec806c240c6 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-vif-plugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:23:29.847344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94c2befe-0655-474a-8e60-407ece237f39 req-f28304a5-120f-49fa-ac0f-dec806c240c6 service nova] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:29.847660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94c2befe-0655-474a-8e60-407ece237f39 req-f28304a5-120f-49fa-ac0f-dec806c240c6 service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:29.847660 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-94c2befe-0655-474a-8e60-407ece237f39 req-f28304a5-120f-49fa-ac0f-dec806c240c6 service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:29.847736 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-94c2befe-0655-474a-8e60-407ece237f39 req-f28304a5-120f-49fa-ac0f-dec806c240c6 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Processing event network-vif-plugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:23:29.863730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:29.864381 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:30.360745 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938610.3603003, 83270ace-cb03-4552-9941-abcb51b8cca8 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:23:30.361176 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:23:30.361360 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] VM Started (Lifecycle Event)
May 28 03:23:30.363266 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:23:30.366176 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Instance spawned successfully.
May 28 03:23:30.366461 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:23:30.865173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:23:30.867106 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:23:30.871765 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:23:30.871886 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:23:30.872140 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:23:30.872417 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:23:30.872886 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:23:30.873143 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:23:31.371043 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:23:31.371330 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938611.3711088, 83270ace-cb03-4552-9941-abcb51b8cca8 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:23:31.371443 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] VM Paused (Lifecycle Event)
May 28 03:23:31.377370 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Took 8.29 seconds to spawn the instance on the hypervisor.
May 28 03:23:31.377524 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:23:31.873764 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:23:31.875678 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938611.875415, 83270ace-cb03-4552-9941-abcb51b8cca8 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:23:31.875832 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] VM Resumed (Lifecycle Event)
May 28 03:23:31.898465 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-51d57cd9-c22d-4b66-83e2-ae6e019816f7 req-0baaa289-4853-4218-a15f-9a14ba5fabcc service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-vif-plugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:23:31.898686 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-51d57cd9-c22d-4b66-83e2-ae6e019816f7 req-0baaa289-4853-4218-a15f-9a14ba5fabcc service nova] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:31.901943 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-51d57cd9-c22d-4b66-83e2-ae6e019816f7 req-0baaa289-4853-4218-a15f-9a14ba5fabcc service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:31.902198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-51d57cd9-c22d-4b66-83e2-ae6e019816f7 req-0baaa289-4853-4218-a15f-9a14ba5fabcc service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:31.902392 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-51d57cd9-c22d-4b66-83e2-ae6e019816f7 req-0baaa289-4853-4218-a15f-9a14ba5fabcc service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] No waiting events found dispatching network-vif-plugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:23:31.903104 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Took 15.21 seconds to build instance.
May 28 03:23:31.904044 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-51d57cd9-c22d-4b66-83e2-ae6e019816f7 req-0baaa289-4853-4218-a15f-9a14ba5fabcc service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received unexpected event network-vif-plugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c for instance with vm_state active and task_state None.
May 28 03:23:32.150788 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:32.378211 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:23:32.380241 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:23:32.405069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-83b1b7ac-34e2-4838-a12f-de7413fd625a tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.714s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:33.648407 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:33.962625 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-changed-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:23:33.962787 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Refreshing instance network info cache due to event network-changed-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:23:33.962947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] Acquiring lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:23:33.963021 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] Acquired lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:23:33.963163 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Refreshing network info cache for port 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:23:34.468108 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:23:34.727899 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:23:34.838828 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updated VIF entry in instance network info cache for port 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:23:34.839167 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updating instance_info_cache with network_info: [{"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:23:35.341059 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-62175c74-7b5b-43e3-9a55-59d77c26c5b1 req-60c3637b-ddc2-4541-ac64-9e006fead0ed service nova] Releasing lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:23:37.153238 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:38.663708 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:42.155189 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:42.640086 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:42.640433 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:43.672439 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:47.157256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:48.137681 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:48.137833 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:23:48.138060 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:48.693556 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:49.137594 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:49.641440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:49.641594 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:49.641742 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:49.641883 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:23:50.662004 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:23:50.663270 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:23:50.664819 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:23:50.665564 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:23:50.713481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:23:50.713905 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13455MB free_disk=72.64531707763672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:23:50.714080 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:23:50.714389 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:23:51.782796 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:51.900726 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 2a80e751-6fc9-466a-baea-e49c3585f705 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:23:51.900883 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 83270ace-cb03-4552-9941-abcb51b8cca8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:23:51.901041 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:23:51.901169 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:23:50 up 51 min,  2 users,  load average: 0.83, 2.65, 3.74\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_26deda1c00a84355951239b1a62997e8': '2', 'io_workload': '0'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:23:51.939608 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Refreshing inventories for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 03:23:51.977823 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Updating ProviderTree inventory for provider 672703c4-2150-4765-9740-44d3bdb44a8c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 03:23:51.978125 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 03:23:52.015370 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Refreshing aggregate associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, aggregates: None {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 03:23:52.056937 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Refreshing trait associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, traits: COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 03:23:52.159204 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:52.171768 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:23:52.172037 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:23:52.674641 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:23:53.182010 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:23:53.182456 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.468s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:23:53.182456 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:53.710597 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:54.182569 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:54.183011 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:54.183011 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:54.183141 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:54.183408 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.95 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:55.134482 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:55.134806 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:23:57.161442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:58.722616 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:23:59.137696 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:23:59.137982 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:24:02.163477 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:03.732474 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:07.165284 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:10.692490 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:10.814661 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-changed-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:10.814825 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Refreshing instance network info cache due to event network-changed-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:24:10.815030 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] Acquiring lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:24:10.815162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] Acquired lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:24:10.815245 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Refreshing network info cache for port 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:24:11.317608 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:11.328434 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:11.328612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:11.328784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:11.328926 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:11.329025 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:11.333111 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Terminating instance
May 28 03:24:11.567144 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:11.687881 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updated VIF entry in instance network info cache for port 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:24:11.688131 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updating instance_info_cache with network_info: [{"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:24:11.836113 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:24:11.851016 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:11.853305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:11.864612 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:11.971104 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-89f92aff-2c33-451c-ac03-1a5790c78b68 req-1780163f-a669-40a7-aad0-1dcccd258d86 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-vif-unplugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:11.971353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-89f92aff-2c33-451c-ac03-1a5790c78b68 req-1780163f-a669-40a7-aad0-1dcccd258d86 service nova] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:11.971840 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-89f92aff-2c33-451c-ac03-1a5790c78b68 req-1780163f-a669-40a7-aad0-1dcccd258d86 service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:11.972044 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-89f92aff-2c33-451c-ac03-1a5790c78b68 req-1780163f-a669-40a7-aad0-1dcccd258d86 service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:11.972215 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-89f92aff-2c33-451c-ac03-1a5790c78b68 req-1780163f-a669-40a7-aad0-1dcccd258d86 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] No waiting events found dispatching network-vif-unplugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:24:11.972412 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-89f92aff-2c33-451c-ac03-1a5790c78b68 req-1780163f-a669-40a7-aad0-1dcccd258d86 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-vif-unplugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:24:12.119641 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.123054 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.161492 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999625400999776 future=<Future at 0x7e4b4064e180 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:12.162393 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998685868999928 future=<Future at 0x7e4b4064e180 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:12.162541 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99851524099995 future=<Future at 0x7e4b4064e180 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:12.163713 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Instance destroyed successfully.
May 28 03:24:12.164250 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid 83270ace-cb03-4552-9941-abcb51b8cca8 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:24:12.166241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.190074 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-4c86c08f-62c7-4177-8fd1-b6c6191e7d1b req-7d706b13-fad7-4112-976f-0681c9f37e9f service nova] Releasing lock "refresh_cache-83270ace-cb03-4552-9941-abcb51b8cca8" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:24:12.666610 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1892436298',display_name='tempest-TestVolumeBootPattern-server-1892436298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1892436298',id=76,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:23:31Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-br055tc4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:23:31Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=83270ace-cb03-4552-9941-abcb51b8cca8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:24:12.666828 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "address": "fa:16:3e:d1:ae:9a", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7f68b-a8", "ovs_interfaceid": "1cf7f68b-a87d-40cb-b19c-bfa2dee7815c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:24:12.667529 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ae:9a,bridge_name='br-int',has_traffic_filtering=True,id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7f68b-a8') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:24:12.667803 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ae:9a,bridge_name='br-int',has_traffic_filtering=True,id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7f68b-a8') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:24:12.669212 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.669551 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cf7f68b-a8, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:12.670604 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.671603 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:24:12.672366 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.672523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3db7177e-5436-4e1d-a691-221db77f5b1c) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:12.673215 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.673530 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:24:12.673684 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:12.675283 np0000001589 nova-compute[98297]: INFO os_vif [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:ae:9a,bridge_name='br-int',has_traffic_filtering=True,id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7f68b-a8')
May 28 03:24:12.676616 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:24:12.676898 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:24:12.677024 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:24:12.677360 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:24:12.677634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:24:12.677758 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:24:12.700413 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:12.700413 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:12.700413 np0000001589 nova-compute[98297]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:24:12.700413 np0000001589 nova-compute[98297]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:24:12.700413 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:24:12.700628 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:12.700628 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:12.700628 np0000001589 nova-compute[98297]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:24:12.700628 np0000001589 nova-compute[98297]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb (non-flash)
May 28 03:24:12.700628 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:24:12.700740 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', '220')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:24:12.700740 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', '219')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:24:12.701542 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb', '220')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:24:12.702153 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646d0ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:24:12.702342 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:24:12.702550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 3300000001768c1a9 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:24:12.765400 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:24:12.805582 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:24:12.841435 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:24:12.841749 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:24:12.842568 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:24:12.852167 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:24:12.852328 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:24:12.862346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:12.892811 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.40.100,3260]
May 28 03:24:12.892811 np0000001589 nova-compute[98297]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.40.100,3260] successful.
May 28 03:24:12.892811 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:12.904458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:12.916249 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:12.944679 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.50.100,3260]
May 28 03:24:12.944679 np0000001589 nova-compute[98297]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-ac823d0d-897c-49e5-9665-26c6f5c4b8cb, portal: 192.168.50.100,3260] successful.
May 28 03:24:12.944679 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:12.957662 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:12.957846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:24:12.957978 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (281ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:24:12.958077 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:24:12.958346 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Deleting instance files /opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8_del
May 28 03:24:12.958764 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Deletion of /opt/stack/data/nova/instances/83270ace-cb03-4552-9941-abcb51b8cca8_del complete
May 28 03:24:13.464472 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Took 1.63 seconds to destroy the instance on the hypervisor.
May 28 03:24:13.465109 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:24:13.465344 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:24:13.465454 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:24:13.465699 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:13.556592 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:13.733734 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:13.781370 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0424b168-0f8f-470b-be9f-7bc70e583afc req-007fef1f-8fc1-492f-9a53-d1f032919009 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-vif-deleted-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:13.781584 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-0424b168-0f8f-470b-be9f-7bc70e583afc req-007fef1f-8fc1-492f-9a53-d1f032919009 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Neutron deleted interface 1cf7f68b-a87d-40cb-b19c-bfa2dee7815c; detaching it from the instance and deleting it from the info cache
May 28 03:24:13.783092 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-0424b168-0f8f-470b-be9f-7bc70e583afc req-007fef1f-8fc1-492f-9a53-d1f032919009 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Detach interface failed, port_id=1cf7f68b-a87d-40cb-b19c-bfa2dee7815c, reason: Instance 83270ace-cb03-4552-9941-abcb51b8cca8 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:24:14.020373 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-85044f75-1322-475e-ac9c-35271a752551 req-46cbdbba-0f56-4065-9642-f03d794a8a51 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-vif-unplugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:14.020683 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85044f75-1322-475e-ac9c-35271a752551 req-46cbdbba-0f56-4065-9642-f03d794a8a51 service nova] Acquiring lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:14.020817 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85044f75-1322-475e-ac9c-35271a752551 req-46cbdbba-0f56-4065-9642-f03d794a8a51 service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:14.020949 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85044f75-1322-475e-ac9c-35271a752551 req-46cbdbba-0f56-4065-9642-f03d794a8a51 service nova] Lock "83270ace-cb03-4552-9941-abcb51b8cca8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:14.021057 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-85044f75-1322-475e-ac9c-35271a752551 req-46cbdbba-0f56-4065-9642-f03d794a8a51 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] No waiting events found dispatching network-vif-unplugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:24:14.021154 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-85044f75-1322-475e-ac9c-35271a752551 req-46cbdbba-0f56-4065-9642-f03d794a8a51 service nova] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Received event network-vif-unplugged-1cf7f68b-a87d-40cb-b19c-bfa2dee7815c for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:24:14.241519 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:24:14.743407 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Took 1.28 seconds to deallocate network for instance.
May 28 03:24:15.286503 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:24:15.791584 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:15.791727 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:15.903076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:24:15.903272 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:24:16.405628 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:24:16.911851 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.120s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:16.953441 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance 83270ace-cb03-4552-9941-abcb51b8cca8
May 28 03:24:17.673798 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:17.960906 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-97539133-2e6a-4aa8-aa28-5838fe333f46 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "83270ace-cb03-4552-9941-abcb51b8cca8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.632s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:20.188606 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-changed-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:20.189000 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Refreshing instance network info cache due to event network-changed-928499be-9583-40ad-bff6-51f72f17d7e6. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:24:20.189138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] Acquiring lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:24:20.189276 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] Acquired lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:24:20.189366 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Refreshing network info cache for port 928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:24:20.691103 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:20.707298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:20.707298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:20.707298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:20.707298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:20.707298 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:20.709096 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Terminating instance
May 28 03:24:20.937207 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:21.055032 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updated VIF entry in instance network info cache for port 928499be-9583-40ad-bff6-51f72f17d7e6. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:24:21.055333 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updating instance_info_cache with network_info: [{"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:24:21.211847 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:24:21.246243 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:21.247781 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:21.259090 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:21.263197 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:21.281954 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:21.527966 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999738022000201 future=<Future at 0x7e4b404c9610 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:21.529096 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Instance destroyed successfully.
May 28 03:24:21.529501 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lazy-loading 'resources' on Instance uuid 2a80e751-6fc9-466a-baea-e49c3585f705 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:24:21.557239 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ee783c9f-ca57-45ad-8f6f-009eb8cf9055 req-938f4e42-eb39-41e9-91f1-6a46cec0da46 service nova] Releasing lock "refresh_cache-2a80e751-6fc9-466a-baea-e49c3585f705" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:24:22.031782 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1311825354',display_name='tempest-TestVolumeBootPattern-server-1311825354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpattern-server-1311825354',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC7UrnHlSBzaQRslIbGoDZLb/eRhUlSnq6q9+swFAwb+wC2wtKhaC1hMfnVsTFJ2F47+q1nLgFGqL6viyZTq9c7zoshyhYSDlIqX7CaXGHvgMaI7tpMYYhYyW1wwzaqgVg==',key_name='tempest-TestVolumeBootPattern-449055664',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:22:33Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26deda1c00a84355951239b1a62997e8',ramdisk_id='',reservation_id='r-p3knrqwi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-273662808',owner_user_name='tempest-TestVolumeBootPattern-273662808-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:22:33Z,user_data=None,user_id='7e2ca3a798ab496688b9e1eff9490c2d',uuid=2a80e751-6fc9-466a-baea-e49c3585f705,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:24:22.032026 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converting VIF {"id": "928499be-9583-40ad-bff6-51f72f17d7e6", "address": "fa:16:3e:2a:3a:93", "network": {"id": "e68b380a-7fa9-4d6e-944d-3e91c75b693e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-324221143-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.5", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "26deda1c00a84355951239b1a62997e8", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap928499be-95", "ovs_interfaceid": "928499be-9583-40ad-bff6-51f72f17d7e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:24:22.032479 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3a:93,bridge_name='br-int',has_traffic_filtering=True,id=928499be-9583-40ad-bff6-51f72f17d7e6,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928499be-95') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:24:22.032666 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3a:93,bridge_name='br-int',has_traffic_filtering=True,id=928499be-9583-40ad-bff6-51f72f17d7e6,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928499be-95') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:24:22.033605 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:22.033848 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap928499be-95, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:22.034898 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:22.036010 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:24:22.036717 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:22.036835 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=406b8cbe-7462-4c0a-b025-f3935cf3ab7b) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:22.037286 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:22.037837 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:24:22.039514 np0000001589 nova-compute[98297]: INFO os_vif [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:3a:93,bridge_name='br-int',has_traffic_filtering=True,id=928499be-9583-40ad-bff6-51f72f17d7e6,network=Network(e68b380a-7fa9-4d6e-944d-3e91c75b693e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap928499be-95')
May 28 03:24:22.040911 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:24:22.041141 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:24:22.041267 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:24:22.041633 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:24:22.041854 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f77902b2-75cb-417b-84e1-de1be4d40f2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:24:22.041976 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:24:22.062059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:22.062059 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:22.062059 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:24:22.062203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsi session list stdout=tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:22.062203 np0000001589 nova-compute[98297]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c (non-flash)
May 28 03:24:22.062203 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:24:22.062301 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '218')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:24:22.062368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '217')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:24:22.062991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c', '218')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:24:22.063540 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40675440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'): ({'sdc'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:24:22.063696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:24:22.063865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Flush multipath device 33000000017c711b5 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:24:22.109137 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:24:22.145519 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:24:22.191428 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:24:22.191675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:24:22.192445 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:24:22.203119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:24:22.203405 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:24:22.213950 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:22.240115 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-vif-unplugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:22.240194 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:22.240436 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:22.240546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:22.240655 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] No waiting events found dispatching network-vif-unplugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:24:22.241295 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-vif-unplugged-928499be-9583-40ad-bff6-51f72f17d7e6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:24:22.241466 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-vif-unplugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:22.241521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] Acquiring lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:22.241654 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:22.241998 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260]
May 28 03:24:22.241998 np0000001589 nova-compute[98297]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.40.100,3260] successful.
May 28 03:24:22.241998 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:22.242195 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] Lock "2a80e751-6fc9-466a-baea-e49c3585f705-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:22.242390 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] No waiting events found dispatching network-vif-unplugged-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:24:22.242611 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a3144085-9d12-47e5-828a-9028a053d529 req-43066faf-7bc5-4afb-b87d-e4f171a311dc service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-vif-unplugged-928499be-9583-40ad-bff6-51f72f17d7e6 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:24:22.251977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:22.261654 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:22.287370 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260]
May 28 03:24:22.287370 np0000001589 nova-compute[98297]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-f77902b2-75cb-417b-84e1-de1be4d40f2c, portal: 192.168.50.100,3260] successful.
May 28 03:24:22.287370 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:22.296764 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:22.296988 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.255s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:24:22.297095 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] <== disconnect_volume: return (255ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:24:22.297287 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:24:22.297591 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Deleting instance files /opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705_del
May 28 03:24:22.298132 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Deletion of /opt/stack/data/nova/instances/2a80e751-6fc9-466a-baea-e49c3585f705_del complete
May 28 03:24:22.803423 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Took 1.59 seconds to destroy the instance on the hypervisor.
May 28 03:24:22.803834 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:24:22.804018 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:24:22.804126 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:24:22.804360 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:22.884819 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:23.546476 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:24:24.048652 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Took 1.24 seconds to deallocate network for instance.
May 28 03:24:24.291155 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a1d243fd-f788-4ca3-95be-d908b327956f req-d14c53ff-84bf-44cc-8ed2-fabe8547462f service nova] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Received event network-vif-deleted-928499be-9583-40ad-bff6-51f72f17d7e6 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:24.589501 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:24:25.094364 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:25.094522 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:25.180804 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:24:25.181012 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:24:25.683337 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:24:26.189126 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.094s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:26.229339 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Deleted allocations for instance 2a80e751-6fc9-466a-baea-e49c3585f705
May 28 03:24:27.038024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:27.161512 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0004000399999313231 future=<Future at 0x7e4b4064e180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:27.162043 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938652.160983, 83270ace-cb03-4552-9941-abcb51b8cca8 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:24:27.162210 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:27.162399 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] VM Stopped (Lifecycle Event)
May 28 03:24:27.162517 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.365174514000046 future=<Future at 0x7e4b404c9610 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:27.162628 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.365062526000202 future=<Future at 0x7e4b404c9610 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:27.236251 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ae81a1b1-e1c2-437f-87a4-e6935ecf3559 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Lock "2a80e751-6fc9-466a-baea-e49c3585f705" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.529s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:27.665171 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 83270ace-cb03-4552-9941-abcb51b8cca8] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:24:29.841980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:31.734115 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:32.039686 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:34.838217 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:36.528059 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00034103400003004936 future=<Future at 0x7e4b404c9610 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:36.528515 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938661.5276072, 2a80e751-6fc9-466a-baea-e49c3585f705 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:24:36.528674 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:24:36.528810 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] VM Stopped (Lifecycle Event)
May 28 03:24:36.616446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:37.031162 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-816ff140-4950-4e97-9d84-222cfde5a85e tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 2a80e751-6fc9-466a-baea-e49c3585f705] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:24:37.040555 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:38.739442 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:40.560204 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:42.041267 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:43.137618 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:24:43.138137 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:24:43.756747 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:44.216088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:44.216513 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:44.717772 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:24:45.258818 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:45.259113 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:45.261693 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:24:45.261812 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Claim successful on node np0000001589
May 28 03:24:46.357807 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:24:46.358087 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:24:46.860265 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:24:47.042693 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:47.366150 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.107s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:47.366719 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:24:47.871244 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:24:47.871427 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:24:47.871649 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:47.871838 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:47.931841 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '052e09fc1fe54c2d8d325f6fb32a482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db67427fcf5b43bfbd3bad3aeccdef20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:24:48.246386 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Successfully created port: 314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:24:48.373771 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:24:48.614302 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Successfully updated port: 314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:24:48.658209 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-changed-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:48.658593 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Refreshing instance network info cache due to event network-changed-314334ec-c09e-450a-a8be-5b6fc9ad3172. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:24:48.658740 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] Acquiring lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:24:48.658824 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] Acquired lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:24:48.658938 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Refreshing network info cache for port 314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:24:48.770846 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:48.877276 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:24:49.116115 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:24:49.137637 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:24:49.137788 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:24:49.137969 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:24:49.160644 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:49.212070 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:24:49.326912 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:24:49.380454 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Booting with volume 1cd83f50-cd83-46ed-833a-42092027809c at /dev/vda
May 28 03:24:49.412202 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:24:49.424631 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:24:49.445167 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:24:49.493737 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:24:49.494112 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:24:49.502814 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:24:49.503991 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40'] 
May 28 03:24:49.504239 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:24:49.504420 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:24:49.504769 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:24:49.505085 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Updating existing volume attachment record: 73ff4dbb-c36d-441a-bb2b-c5cd81141d0c {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:24:49.642403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:49.642598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:49.642759 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:49.642897 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:24:49.655053 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:24:49.655842 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:24:49.700934 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:24:49.701302 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=14068MB free_disk=72.64066314697266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:24:49.701482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:49.701671 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:49.828891 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-5c17164d-a2b2-4216-a183-2ee9a0c60745 req-841579c0-d17f-457e-beee-f504ac8f9590 service nova] Releasing lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:24:49.829528 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquired lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:24:49.829738 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:24:50.386787 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:24:50.514390 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:50.638535 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Updating instance_info_cache with network_info: [{"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:24:50.749138 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 912d0a97-5d11-4483-b87a-0408f6db2569 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:24:50.749333 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:24:50.749486 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:24:49 up 52 min,  2 users,  load average: 1.17, 2.36, 3.56\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_os_type_None': '1', 'num_proj_db67427fcf5b43bfbd3bad3aeccdef20': '1', 'io_workload': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:24:50.830555 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:24:50.830790 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:24:51.140454 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Releasing lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:24:51.140729 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Instance network_info: |[{"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:24:51.333290 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:24:51.593808 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:24:51.594819 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:24:51.595035 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Creating image(s)
May 28 03:24:51.595324 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:24:51.595444 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Ensure instance console log exists: /opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:24:51.595645 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:51.595785 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:51.595925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:51.596409 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Start _get_guest_xml network_info=[{"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '73ff4dbb-c36d-441a-bb2b-c5cd81141d0c', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '912d0a97-5d11-4483-b87a-0408f6db2569', 'attached_at': '', 'detached_at': '', 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'serial': '1cd83f50-cd83-46ed-833a-42092027809c'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:24:51.598656 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:24:51.599605 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-162011668', uuid='912d0a97-5d11-4483-b87a-0408f6db2569'), owner=OwnerMeta(userid='052e09fc1fe54c2d8d325f6fb32a482a', username='tempest-TestVolumeBootPatternV346-548403211-project-member', projectid='db67427fcf5b43bfbd3bad3aeccdef20', projectname='tempest-TestVolumeBootPatternV346-548403211'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938691.5993207) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:24:51.600672 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:24:51.600959 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:24:51.601892 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:24:51.602064 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:24:51.602827 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:24:51.603065 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:24:51.603205 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:24:51.603317 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:24:51.603434 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:24:51.603514 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:24:51.603605 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:24:51.603737 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:24:51.603832 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:24:51.603937 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:24:51.604035 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:24:51.604163 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:24:51.613433 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:24:51.613730 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:24:51.613853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:24:51.614188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:24:51.614383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:24:51.625374 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:24:51.625938 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:24:51.626419 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:24:51.626617 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:24:51.627196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:24:51.627619 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:24:51.636482 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:24:51.636482 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:51.641972 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:24:51.641972 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:51.647549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c] added
May 28 03:24:51.647549 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:24:51.647549 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:24:51.647549 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:24:51.647549 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:24:51.647549 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:24:51.647549 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:51.647735 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:24:51.647881 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:24:51.648018 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:24:51.652333 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c] added
May 28 03:24:51.652333 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:24:51.652333 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:24:51.652333 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:24:51.652333 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:24:51.652333 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:24:51.652333 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:51.652486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:24:51.652647 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:24:51.652765 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:24:51.839261 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:24:51.839403 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:51.839638 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:24:52.043636 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:52.648484 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:24:52.653175 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:24:52.661630 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:24:52.661630 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:24:52.667804 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:24:52.667804 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:52.674460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:52.679696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:52.686391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:24:52.686391 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:24:52.686391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:24:52.686391 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:24:52.686521 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:24:52.686521 np0000001589 nova-compute[98297]: 
May 28 03:24:52.691424 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:24:52.691424 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:24:52.691538 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:24:52.691538 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:24:52.691632 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:24:52.691632 np0000001589 nova-compute[98297]: 
May 28 03:24:52.839711 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:24:52.839985 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.30 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:24:53.137962 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:24:53.138276 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:24:53.718276 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.40.100,3260]
May 28 03:24:53.718276 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.40.100,3260] successful.
May 28 03:24:53.718276 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:53.718656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.50.100,3260]
May 28 03:24:53.718656 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.50.100,3260] successful.
May 28 03:24:53.718656 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:53.728918 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:53.732757 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:24:53.739241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.739241 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.739241 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:24:53.739406 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.739406 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.739406 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:24:53.739636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.113s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:24:53.739745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:24:53.740188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] HCTL ('8', '-', '-', 0) found on session 222 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:24:53.740340 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:24:53.744069 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.744069 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.744069 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:24:53.744242 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.744242 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:24:53.744242 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:24:53.744428 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.118s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:24:53.744524 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:24:53.744860 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] HCTL ('7', '-', '-', 0) found on session 221 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:24:53.744952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:24:53.753579 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 222 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:24:53.753579 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:24:53.758743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 221 and hctl ['7', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:24:53.771690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:54.137645 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:24:54.137913 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:24:54.757837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 221 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:24:54.758324 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:24:55.133938 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:24:55.134341 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:24:55.643220 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Found WWN 33000000036913385 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:24:55.643561 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:24:55.643735 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== connect_volume: return (4030ms) {'type': 'block', 'scsi_wwn': '33000000036913385', 'path': '/dev/dm-0', 'multipath_id': '33000000036913385'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:24:55.643875 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000036913385', 'path': '/dev/dm-0', 'multipath_id': '33000000036913385'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:24:56.149021 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-162011668',display_name='tempest-TestVolumeBootPatternV346-server-162011668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-162011668',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNYBVxCSbZYk2LG0rFTuTTc8WLLgrX56LmT7hYbtQ6r5x1z4dKwUR/uqPzltwFlk4lVw7/mlNNibks+Hfp62siJvmFHQvUJoCrgrUVzJXjyo0ElFbLK4SJrpd3pReLSag==',key_name='tempest-keypair-5272716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-9ei0ivhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:24:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=912d0a97-5d11-4483-b87a-0408f6db2569,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:24:56.149725 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:24:56.149876 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:58:b5,bridge_name='br-int',has_traffic_filtering=True,id=314334ec-c09e-450a-a8be-5b6fc9ad3172,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314334ec-c0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:24:56.150421 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lazy-loading 'pci_devices' on Instance uuid 912d0a97-5d11-4483-b87a-0408f6db2569 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:24:56.652995 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] End _get_guest_xml xml=<domain type="qemu">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <uuid>912d0a97-5d11-4483-b87a-0408f6db2569</uuid>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <name>instance-0000004d</name>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPatternV346-server-162011668</nova:name>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:24:51</nova:creationTime>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:user uuid="052e09fc1fe54c2d8d325f6fb32a482a">tempest-TestVolumeBootPatternV346-548403211-project-member</nova:user>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:project uuid="db67427fcf5b43bfbd3bad3aeccdef20">tempest-TestVolumeBootPatternV346-548403211</nova:project>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         <nova:port uuid="314334ec-c09e-450a-a8be-5b6fc9ad3172">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <system>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <entry name="serial">912d0a97-5d11-4483-b87a-0408f6db2569</entry>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <entry name="uuid">912d0a97-5d11-4483-b87a-0408f6db2569</entry>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </system>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <os>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   </os>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <features>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   </features>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   <devices>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569/disk.config"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </disk>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <alias name="ua-1cd83f50-cd83-46ed-833a-42092027809c"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-0"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <serial>1cd83f50-cd83-46ed-833a-42092027809c</serial>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </disk>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:6a:58:b5"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <target dev="tap314334ec-c0"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </interface>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569/console.log" append="off"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </serial>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <video>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </video>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </rng>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:   </devices>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]: </domain>
May 28 03:24:56.652995 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:24:56.654933 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Preparing to wait for external event network-vif-plugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:24:56.654933 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:56.654933 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:56.654933 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:56.654933 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-162011668',display_name='tempest-TestVolumeBootPatternV346-server-162011668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-162011668',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNYBVxCSbZYk2LG0rFTuTTc8WLLgrX56LmT7hYbtQ6r5x1z4dKwUR/uqPzltwFlk4lVw7/mlNNibks+Hfp62siJvmFHQvUJoCrgrUVzJXjyo0ElFbLK4SJrpd3pReLSag==',key_name='tempest-keypair-5272716',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-9ei0ivhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:24:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=912d0a97-5d11-4483-b87a-0408f6db2569,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:24:56.654933 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:24:56.654933 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:58:b5,bridge_name='br-int',has_traffic_filtering=True,id=314334ec-c09e-450a-a8be-5b6fc9ad3172,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314334ec-c0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:24:56.655339 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:58:b5,bridge_name='br-int',has_traffic_filtering=True,id=314334ec-c09e-450a-a8be-5b6fc9ad3172,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314334ec-c0') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:24:56.655464 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:56.655671 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:56.655914 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:24:56.656348 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:56.656481 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9f28a0b-87d4-5011-b6ba-171e20991e5b', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:56.657303 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:56.657858 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:24:56.659522 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:56.659641 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap314334ec-c0, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:56.659895 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap314334ec-c0, col_values=(('qos', UUID('4735c90e-6bd4-472d-8901-387ed7b21c3d')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:56.660037 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap314334ec-c0, col_values=(('external_ids', {'iface-id': '314334ec-c09e-450a-a8be-5b6fc9ad3172', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:58:b5', 'vm-uuid': '912d0a97-5d11-4483-b87a-0408f6db2569'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:24:56.660706 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:56.661741 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:24:56.665607 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:56.666312 np0000001589 nova-compute[98297]: INFO os_vif [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:58:b5,bridge_name='br-int',has_traffic_filtering=True,id=314334ec-c09e-450a-a8be-5b6fc9ad3172,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314334ec-c0')
May 28 03:24:58.180041 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:24:58.180488 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:24:58.180488 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No VIF found with MAC fa:16:3e:6a:58:b5, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:24:58.180674 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Using config drive
May 28 03:24:58.685286 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:24:58.784496 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Creating config drive at /opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569/disk.config
May 28 03:24:58.784811 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:58.789288 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplm40r3wj {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:24:58.843430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplm40r3wj" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:24:59.196445 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:59.209171 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:59.312248 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:59.337862 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-24c8f2a1-e0b0-41d3-9f6b-fbbab2695258 req-e4d94efa-5369-4da2-b24b-87dfa0a2c26b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-vif-plugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:24:59.338097 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-24c8f2a1-e0b0-41d3-9f6b-fbbab2695258 req-e4d94efa-5369-4da2-b24b-87dfa0a2c26b service nova] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:24:59.338283 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-24c8f2a1-e0b0-41d3-9f6b-fbbab2695258 req-e4d94efa-5369-4da2-b24b-87dfa0a2c26b service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:24:59.338319 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-24c8f2a1-e0b0-41d3-9f6b-fbbab2695258 req-e4d94efa-5369-4da2-b24b-87dfa0a2c26b service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:24:59.338519 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-24c8f2a1-e0b0-41d3-9f6b-fbbab2695258 req-e4d94efa-5369-4da2-b24b-87dfa0a2c26b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Processing event network-vif-plugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:24:59.506826 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:59.509567 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:59.521308 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:24:59.846914 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938699.8465343, 912d0a97-5d11-4483-b87a-0408f6db2569 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:24:59.847414 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:24:59.847585 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] VM Started (Lifecycle Event)
May 28 03:24:59.849536 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:24:59.852125 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Instance spawned successfully.
May 28 03:24:59.852820 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:25:00.351012 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:25:00.352839 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:25:00.358240 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:25:00.358373 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:25:00.358617 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:25:00.358823 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:25:00.359036 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:25:00.359258 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:25:00.857688 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:25:00.857965 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938700.8577838, 912d0a97-5d11-4483-b87a-0408f6db2569 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:25:00.858075 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] VM Paused (Lifecycle Event)
May 28 03:25:00.863480 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Took 9.27 seconds to spawn the instance on the hypervisor.
May 28 03:25:00.863673 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:25:01.137816 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:01.138100 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:25:01.363001 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:25:01.365222 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938701.3649547, 912d0a97-5d11-4483-b87a-0408f6db2569 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:25:01.365388 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] VM Resumed (Lifecycle Event)
May 28 03:25:01.371407 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Took 16.15 seconds to build instance.
May 28 03:25:01.414005 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-923d6a47-2ac7-49e6-ab8b-e4afac991f25 req-d5057b13-c81e-4820-9dbf-b14557d3035b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-vif-plugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:25:01.414005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-923d6a47-2ac7-49e6-ab8b-e4afac991f25 req-d5057b13-c81e-4820-9dbf-b14557d3035b service nova] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:01.414005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-923d6a47-2ac7-49e6-ab8b-e4afac991f25 req-d5057b13-c81e-4820-9dbf-b14557d3035b service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:01.414005 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-923d6a47-2ac7-49e6-ab8b-e4afac991f25 req-d5057b13-c81e-4820-9dbf-b14557d3035b service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:01.414005 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-923d6a47-2ac7-49e6-ab8b-e4afac991f25 req-d5057b13-c81e-4820-9dbf-b14557d3035b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] No waiting events found dispatching network-vif-plugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:25:01.414005 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-923d6a47-2ac7-49e6-ab8b-e4afac991f25 req-d5057b13-c81e-4820-9dbf-b14557d3035b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received unexpected event network-vif-plugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 for instance with vm_state active and task_state None.
May 28 03:25:01.660841 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:01.867705 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:25:01.869350 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:25:01.872928 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d019a00-99f5-4505-b56c-7ffea4ff2e66 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.656s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:03.467101 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-changed-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:25:03.467536 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Refreshing instance network info cache due to event network-changed-314334ec-c09e-450a-a8be-5b6fc9ad3172. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:25:03.467684 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] Acquiring lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:25:03.467774 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] Acquired lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:25:03.467896 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Refreshing network info cache for port 314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:25:03.784101 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:03.971743 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:25:04.243250 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:25:04.353487 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Updated VIF entry in instance network info cache for port 314334ec-c09e-450a-a8be-5b6fc9ad3172. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:25:04.353824 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Updating instance_info_cache with network_info: [{"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:25:04.855570 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-87428b12-dc00-491e-a2a8-893edf7f3939 req-eff78916-cd6e-463f-897e-f4f20a8a8d3b service nova] Releasing lock "refresh_cache-912d0a97-5d11-4483-b87a-0408f6db2569" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:25:06.660937 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:08.785969 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:11.662195 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:13.787808 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:16.667010 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:18.788261 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:21.680142 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:23.789639 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:26.693907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:28.791256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:31.707106 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:36.710756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:25:36.710756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:25:36.710756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=98297) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 03:25:36.710756 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:25:36.720196 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:36.720196 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:25:38.791726 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:41.729990 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:42.564097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:43.792751 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:44.292471 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:44.292619 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:44.794563 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:25:45.137711 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:45.137983 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:25:45.338147 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:45.338401 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:45.341769 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:25:45.341897 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Claim successful on node np0000001589
May 28 03:25:46.459979 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:25:46.460326 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:25:46.743958 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:46.962427 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:25:47.468041 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.130s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:47.468497 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:25:47.973726 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:25:47.974002 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:25:47.974236 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:25:47.974444 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:25:48.055584 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '052e09fc1fe54c2d8d325f6fb32a482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db67427fcf5b43bfbd3bad3aeccdef20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:25:48.406599 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Successfully created port: f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:25:48.476088 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:25:48.813862 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Successfully updated port: f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:25:48.862258 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-changed-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:25:48.862576 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Refreshing instance network info cache due to event network-changed-f5845eab-c92f-461f-99f4-e5fb607de388. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:25:48.862795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] Acquiring lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:25:48.862902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] Acquired lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:25:48.863164 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Refreshing network info cache for port f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:25:48.978911 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:25:49.137598 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:49.137755 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:25:49.138723 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:25:49.315820 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:25:49.364650 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:25:49.416048 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:25:49.482783 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Booting with volume 46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 at /dev/vda
May 28 03:25:49.518308 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:25:49.528615 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:25:49.535140 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:25:49.548638 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:25:49.591751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:25:49.592101 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:25:49.600691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:25:49.601594 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe6a:58b5', 'fe80::b04f:fbff:fedd:a3c0'] 
May 28 03:25:49.601696 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:25:49.601793 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:25:49.602050 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:25:49.602280 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Updating existing volume attachment record: ffc1ca82-6ccf-4c66-a8c2-e6603c4da253 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:25:50.037478 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-15717ccb-be6b-4d21-8c87-e454334350f1 req-68f266b6-1680-4315-9026-d83514e4a0df service nova] Releasing lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:25:50.037915 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquired lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:25:50.038142 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:25:50.137781 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:50.592178 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:25:50.644644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:50.644927 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:50.645102 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:50.645295 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:25:50.727757 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:25:50.835064 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Updating instance_info_cache with network_info: [{"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:25:51.336811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Releasing lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:25:51.337137 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Instance network_info: |[{"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:25:51.664124 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:25:51.665750 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:25:51.666664 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:25:51.695333 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:25:51.697650 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:25:51.698003 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Creating image(s)
May 28 03:25:51.698485 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:25:51.698662 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Ensure instance console log exists: /opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:25:51.699021 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:51.699382 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:51.699552 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:51.700410 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Start _get_guest_xml network_info=[{"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': 'ffc1ca82-6ccf-4c66-a8c2-e6603c4da253', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e1317970-b47b-43df-853a-ce29f491d580', 'attached_at': '', 'detached_at': '', 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'serial': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:25:51.705472 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:25:51.706777 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-598858517', uuid='e1317970-b47b-43df-853a-ce29f491d580'), owner=OwnerMeta(userid='052e09fc1fe54c2d8d325f6fb32a482a', username='tempest-TestVolumeBootPatternV346-548403211-project-member', projectid='db67427fcf5b43bfbd3bad3aeccdef20', projectname='tempest-TestVolumeBootPatternV346-548403211'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938751.7063384) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:25:51.707741 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:25:51.708101 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:25:51.709001 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:25:51.709177 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:25:51.710200 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:25:51.710566 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:25:51.710731 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:25:51.710841 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:25:51.710979 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:25:51.711070 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:25:51.711182 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:25:51.711376 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:25:51.711486 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:25:51.711611 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:25:51.711968 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:25:51.712101 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:25:51.721801 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:25:51.722634 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13739MB free_disk=72.62987899780273GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:25:51.722791 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:51.723038 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:51.725511 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:25:51.725848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:25:51.725975 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:25:51.727678 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:25:51.727852 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:25:51.738668 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:25:51.739661 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:25:51.740248 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:25:51.740421 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:25:51.740766 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:25:51.740982 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:25:51.746147 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:51.750161 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:25:51.750161 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:51.754270 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:25:51.754270 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:51.760773 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2] added
May 28 03:25:51.760773 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:25:51.760773 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:25:51.760773 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:25:51.760773 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:25:51.760773 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:25:51.760773 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:51.760935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:25:51.761094 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0206(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:25:51.761220 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:25:51.763954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2] added
May 28 03:25:51.763954 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:25:51.763954 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:25:51.763954 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:25:51.763954 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:25:51.763954 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:25:51.763954 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:51.764209 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:25:51.764292 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0233(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:25:51.764469 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:25:51.784730 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:25:52.761780 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:25:52.764844 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:25:52.773823 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:25:52.773823 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.777397 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 912d0a97-5d11-4483-b87a-0408f6db2569 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:25:52.777497 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance e1317970-b47b-43df-853a-ce29f491d580 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:25:52.777648 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:25:52.777902 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:25:51 up 53 min,  2 users,  load average: 0.89, 2.05, 3.38\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_db67427fcf5b43bfbd3bad3aeccdef20': '2', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:25:52.780363 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:25:52.780363 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.786641 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.792942 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.799350 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.799350 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.799350 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:25:52.799580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.799580 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.799580 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:25:52.806582 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.806582 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.806582 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:25:52.806826 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.806826 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.806826 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:25:52.832816 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.50.100,3260]
May 28 03:25:52.832816 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.50.100,3260] successful.
May 28 03:25:52.832816 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.846292 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.852781 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.40.100,3260]
May 28 03:25:52.852781 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.40.100,3260] successful.
May 28 03:25:52.852781 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.862665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:25:52.867744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.867744 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.867744 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.867744 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.867744 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:25:52.867885 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.867885 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.867885 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.867885 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.867885 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:25:52.868316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:25:52.868316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:25:52.873014 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] HCTL ('9', '-', '-', 0) found on session 223 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:25:52.873189 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:25:52.877961 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.877961 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.877961 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.877961 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.877961 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:25:52.878185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.878185 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:25:52.878185 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.878185 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:25:52.878185 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:25:52.878497 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:25:52.878582 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:25:52.879132 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] HCTL ('10', '-', '-', 0) found on session 224 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:25:52.879281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:25:52.887076 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 223 and hctl ['9', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:25:52.896117 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 224 and hctl ['10', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:25:52.916430 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:25:52.916745 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:25:53.419404 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:25:53.887646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 223 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:25:53.887931 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:25:53.895424 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 224 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:25:53.895550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:25:53.925341 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:25:53.925468 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.202s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:53.925744 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:25:54.739976 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:25:55.755700 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Found WWN 3300000000fb1bd29 for multipath device dm-3 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:25:55.756196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:25:55.756196 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== connect_volume: return (4030ms) {'type': 'block', 'scsi_wwn': '3300000000fb1bd29', 'path': '/dev/dm-3', 'multipath_id': '3300000000fb1bd29'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:25:55.756328 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000fb1bd29', 'path': '/dev/dm-3', 'multipath_id': '3300000000fb1bd29'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:25:55.925669 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:55.925890 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:55.926090 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:55.926310 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:55.926501 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:25:55.926734 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.21 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:25:56.261568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-598858517',display_name='tempest-TestVolumeBootPatternV346-server-598858517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-598858517',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEjI1lis5G9QoDIuJg/49T1+OQdTifTSztkBQTKAnqchN++G0z+YX8cHJsUR92py0h0Yt+KLF5zKUu7Y3AWj8167HwWr9WDSm1MG82s5k2frf9wzQTOib1YnBE7luVLYA==',key_name='tempest-keypair-1811695906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-hsk2cuyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=e1317970-b47b-43df-853a-ce29f491d580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:25:56.261761 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:25:56.262443 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:10:ca,bridge_name='br-int',has_traffic_filtering=True,id=f5845eab-c92f-461f-99f4-e5fb607de388,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845eab-c9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:25:56.263192 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lazy-loading 'pci_devices' on Instance uuid e1317970-b47b-43df-853a-ce29f491d580 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:25:56.751730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:25:56.751975 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:25:56.751975 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98297) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 03:25:56.751975 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:25:56.757712 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.758113 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:25:56.765702 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] End _get_guest_xml xml=<domain type="qemu">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <uuid>e1317970-b47b-43df-853a-ce29f491d580</uuid>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <name>instance-0000004e</name>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPatternV346-server-598858517</nova:name>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:25:51</nova:creationTime>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:user uuid="052e09fc1fe54c2d8d325f6fb32a482a">tempest-TestVolumeBootPatternV346-548403211-project-member</nova:user>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:project uuid="db67427fcf5b43bfbd3bad3aeccdef20">tempest-TestVolumeBootPatternV346-548403211</nova:project>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         <nova:port uuid="f5845eab-c92f-461f-99f4-e5fb607de388">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <system>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <entry name="serial">e1317970-b47b-43df-853a-ce29f491d580</entry>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <entry name="uuid">e1317970-b47b-43df-853a-ce29f491d580</entry>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </system>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <os>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   </os>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <features>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   </features>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   <devices>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580/disk.config"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </disk>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <alias name="ua-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-3"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <serial>46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2</serial>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </disk>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:d5:10:ca"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <target dev="tapf5845eab-c9"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </interface>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580/console.log" append="off"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </serial>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <video>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </video>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </rng>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:   </devices>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]: </domain>
May 28 03:25:56.765702 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:25:56.767460 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Preparing to wait for external event network-vif-plugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:25:56.767460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:56.767460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:56.767460 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:56.767460 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-598858517',display_name='tempest-TestVolumeBootPatternV346-server-598858517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-598858517',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEjI1lis5G9QoDIuJg/49T1+OQdTifTSztkBQTKAnqchN++G0z+YX8cHJsUR92py0h0Yt+KLF5zKUu7Y3AWj8167HwWr9WDSm1MG82s5k2frf9wzQTOib1YnBE7luVLYA==',key_name='tempest-keypair-1811695906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-hsk2cuyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=e1317970-b47b-43df-853a-ce29f491d580,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:25:56.767460 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:25:56.768002 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:10:ca,bridge_name='br-int',has_traffic_filtering=True,id=f5845eab-c92f-461f-99f4-e5fb607de388,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845eab-c9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:25:56.768002 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:10:ca,bridge_name='br-int',has_traffic_filtering=True,id=f5845eab-c92f-461f-99f4-e5fb607de388,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845eab-c9') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:25:56.768348 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.768445 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:25:56.768745 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:25:56.769315 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.769488 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2840c95b-b190-5162-949a-1792eaeac467', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:25:56.770105 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.770766 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:25:56.771141 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.772611 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.772742 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5845eab-c9, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:25:56.773014 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5845eab-c9, col_values=(('qos', UUID('c0c9cd86-8d6c-40c7-8399-060768f69962')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:25:56.773159 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5845eab-c9, col_values=(('external_ids', {'iface-id': 'f5845eab-c92f-461f-99f4-e5fb607de388', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:10:ca', 'vm-uuid': 'e1317970-b47b-43df-853a-ce29f491d580'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:25:56.773819 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.774873 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:25:56.779188 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:56.779950 np0000001589 nova-compute[98297]: INFO os_vif [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:10:ca,bridge_name='br-int',has_traffic_filtering=True,id=f5845eab-c92f-461f-99f4-e5fb607de388,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845eab-c9')
May 28 03:25:58.295167 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:25:58.295565 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:25:58.295565 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No VIF found with MAC fa:16:3e:d5:10:ca, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:25:58.295846 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Using config drive
May 28 03:25:58.801106 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:25:58.901282 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Creating config drive at /opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580/disk.config
May 28 03:25:58.904713 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpozx82n1p {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:25:58.958583 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpozx82n1p" returned: 0 in 0.054s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:25:59.334563 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:59.348772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:59.350505 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:59.435898 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:59.487690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:59.487690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:25:59.494962 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-009006ee-0ec3-4f12-a76d-da493e27c2aa req-b0c66cec-47ed-4863-b755-be6a655b202d service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-vif-plugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:25:59.496019 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-009006ee-0ec3-4f12-a76d-da493e27c2aa req-b0c66cec-47ed-4863-b755-be6a655b202d service nova] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:25:59.496270 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-009006ee-0ec3-4f12-a76d-da493e27c2aa req-b0c66cec-47ed-4863-b755-be6a655b202d service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:25:59.496419 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-009006ee-0ec3-4f12-a76d-da493e27c2aa req-b0c66cec-47ed-4863-b755-be6a655b202d service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:25:59.496615 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-009006ee-0ec3-4f12-a76d-da493e27c2aa req-b0c66cec-47ed-4863-b755-be6a655b202d service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Processing event network-vif-plugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:25:59.970705 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938759.9701722, e1317970-b47b-43df-853a-ce29f491d580 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:25:59.970916 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] VM Started (Lifecycle Event)
May 28 03:25:59.972498 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:25:59.975130 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:25:59.978104 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e1317970-b47b-43df-853a-ce29f491d580] Instance spawned successfully.
May 28 03:25:59.979038 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:26:00.474417 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:26:00.476410 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:26:00.483770 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:00.483921 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:00.484215 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:00.484486 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:00.484762 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:00.485044 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:00.978622 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:26:00.978889 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938760.9787214, e1317970-b47b-43df-853a-ce29f491d580 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:26:00.978985 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] VM Paused (Lifecycle Event)
May 28 03:26:00.990540 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Took 9.29 seconds to spawn the instance on the hypervisor.
May 28 03:26:00.990665 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:26:01.481219 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:26:01.483094 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938761.4828792, e1317970-b47b-43df-853a-ce29f491d580 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:26:01.483212 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] VM Resumed (Lifecycle Event)
May 28 03:26:01.497932 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Took 16.20 seconds to build instance.
May 28 03:26:01.546384 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-668e938f-6145-47d8-b05e-4f973ca4e5a6 req-5678d841-5ea9-4cb0-ad7f-c66556291d6b service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-vif-plugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:26:01.546569 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-668e938f-6145-47d8-b05e-4f973ca4e5a6 req-5678d841-5ea9-4cb0-ad7f-c66556291d6b service nova] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:01.549037 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-668e938f-6145-47d8-b05e-4f973ca4e5a6 req-5678d841-5ea9-4cb0-ad7f-c66556291d6b service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:01.549037 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-668e938f-6145-47d8-b05e-4f973ca4e5a6 req-5678d841-5ea9-4cb0-ad7f-c66556291d6b service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:01.549037 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-668e938f-6145-47d8-b05e-4f973ca4e5a6 req-5678d841-5ea9-4cb0-ad7f-c66556291d6b service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] No waiting events found dispatching network-vif-plugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:26:01.549037 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-668e938f-6145-47d8-b05e-4f973ca4e5a6 req-5678d841-5ea9-4cb0-ad7f-c66556291d6b service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received unexpected event network-vif-plugged-f5845eab-c92f-461f-99f4-e5fb607de388 for instance with vm_state active and task_state None.
May 28 03:26:01.786339 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:01.985615 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:26:01.987970 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: e1317970-b47b-43df-853a-ce29f491d580] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:26:01.999361 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.707s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:02.138004 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:02.138437 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:26:02.769062 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-changed-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:26:02.769436 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Refreshing instance network info cache due to event network-changed-f5845eab-c92f-461f-99f4-e5fb607de388. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:26:02.769631 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] Acquiring lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:26:02.769721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] Acquired lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:26:02.769801 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Refreshing network info cache for port f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:26:03.271522 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:26:03.538922 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:26:03.648517 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Updated VIF entry in instance network info cache for port f5845eab-c92f-461f-99f4-e5fb607de388. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:26:03.648757 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Updating instance_info_cache with network_info: [{"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:26:03.797013 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:04.150512 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-66db27a8-44b7-412b-b7ee-4a3bdc293b68 req-69a53824-7a25-45a8-8abc-c5f0d1aeb7b8 service nova] Releasing lock "refresh_cache-e1317970-b47b-43df-853a-ce29f491d580" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:26:06.799948 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:08.798440 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:11.815555 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:13.800292 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:16.824075 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:18.800457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:21.843148 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:23.800941 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:26.858207 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:28.802472 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:31.869258 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:33.803774 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:36.882083 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:38.804024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:41.896416 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:42.696933 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:43.805241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:44.357091 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:44.357343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:44.858921 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:26:45.399950 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:45.400123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:45.403061 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:26:45.403199 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Claim successful on node np0000001589
May 28 03:26:46.137684 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:46.138102 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:26:46.557241 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:26:46.557443 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:26:46.922418 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:47.059819 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:26:47.567092 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.167s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:47.567509 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:26:48.072241 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:26:48.072472 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:26:48.072766 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:26:48.072998 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:26:48.132179 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '052e09fc1fe54c2d8d325f6fb32a482a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db67427fcf5b43bfbd3bad3aeccdef20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:26:48.542611 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Successfully created port: f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:26:48.575399 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:26:49.079005 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:26:49.374144 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Successfully updated port: f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:26:49.452420 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-changed-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:26:49.452567 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Refreshing instance network info cache due to event network-changed-f503969f-6976-4f0e-9fdd-39c13fa9c8f9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:26:49.452693 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] Acquiring lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:26:49.452789 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] Acquired lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:26:49.453068 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Refreshing network info cache for port f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:26:49.583630 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Booting with volume fcc8644e-012f-452c-b5da-879f4ccd3af0 at /dev/vda
May 28 03:26:49.620003 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:26:49.630262 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:26:49.651112 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:26:49.698210 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:26:49.698526 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:26:49.706480 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:26:49.708807 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fe6a:58b5', 'fe80::b04f:fbff:fedd:a3c0', 'fe80::fc16:3eff:fed5:10ca'] 
May 28 03:26:49.708947 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:26:49.709091 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:26:49.709403 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:26:49.709668 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Updating existing volume attachment record: 5850fdfa-585e-461f-a184-69c4f3382cb1 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:26:49.876347 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:26:49.954878 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:26:50.015570 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:26:50.135317 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:26:50.637409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-1fb8c17e-a783-4f4d-8e1a-a8d5c96a3bf6 req-dcab79cc-929e-4b9d-b642-ef1352795d92 service nova] Releasing lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:26:50.637873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquired lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:26:50.637993 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:26:51.137868 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:51.138022 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:26:51.138160 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:51.201108 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:26:51.325783 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:26:51.439332 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Updating instance_info_cache with network_info: [{"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:26:51.644388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:51.644934 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:51.644934 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:51.645104 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:26:51.794765 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:26:51.795834 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:26:51.795989 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Creating image(s)
May 28 03:26:51.796220 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Did not create local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 28 03:26:51.796351 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Ensure instance console log exists: /opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:26:51.796536 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:51.796694 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:51.796813 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:51.925877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:51.941214 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Releasing lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:26:51.941489 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Instance network_info: |[{"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:26:51.942295 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Start _get_guest_xml network_info=[{"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'attachment_id': '5850fdfa-585e-461f-a184-69c4f3382cb1', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b88b0f00-e92b-4eeb-afce-7662c0451b28', 'attached_at': '', 'detached_at': '', 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'serial': 'fcc8644e-012f-452c-b5da-879f4ccd3af0'}, 'delete_on_termination': False, 'boot_index': 0, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:26:51.944510 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:26:51.945504 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-57861150', uuid='b88b0f00-e92b-4eeb-afce-7662c0451b28'), owner=OwnerMeta(userid='052e09fc1fe54c2d8d325f6fb32a482a', username='tempest-TestVolumeBootPatternV346-548403211-project-member', projectid='db67427fcf5b43bfbd3bad3aeccdef20', projectname='tempest-TestVolumeBootPatternV346-548403211'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938811.9451897) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:26:51.946444 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:26:51.946726 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:26:51.947568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:26:51.947722 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:26:51.948472 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:26:51.948743 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:26:51.948882 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:26:51.948968 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:26:51.949074 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:26:51.949149 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:26:51.949250 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:26:51.949385 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:26:51.949477 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:26:51.949594 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:26:51.949730 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:26:51.949877 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:26:51.959619 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:26:51.959913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:26:51.960030 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:26:51.960336 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:26:51.960493 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:26:51.970747 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:26:51.971268 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:26:51.971699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:26:51.971877 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:26:51.972201 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:26:51.973029 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:26:51.981425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:26:51.981425 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:51.986418 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:26:51.986418 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:51.993047 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0] added
May 28 03:26:51.993047 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:26:51.993047 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:26:51.993047 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:26:51.993047 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:26:51.993047 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:26:51.993047 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:51.993351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:26:51.993466 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0215(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:26:51.993658 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:26:51.997151 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0] added
May 28 03:26:51.997151 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:26:51.997151 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:26:51.997151 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:26:51.997151 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:26:51.997151 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:26:51.997151 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:51.997339 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:26:51.997466 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:26:51.997587 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:26:52.663615 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:26:52.665017 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:26:52.666353 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:26:52.667091 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:26:52.715165 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:26:52.715569 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13412MB free_disk=72.62685775756836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:26:52.715729 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:52.715978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:52.994261 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:26:52.998671 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:26:53.006177 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:26:53.006177 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:26:53.012067 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:26:53.012067 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.017720 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.023140 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.030382 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.030382 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.030382 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.030382 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.030382 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:26:53.030575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.030575 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.030575 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.030575 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.030575 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:26:53.036317 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.036317 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.036317 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.036317 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.036317 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:26:53.036486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.036486 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.036486 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.036486 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.036486 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:26:53.062538 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.40.100,3260]
May 28 03:26:53.062538 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.40.100,3260] successful.
May 28 03:26:53.062538 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.071549 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.50.100,3260]
May 28 03:26:53.071549 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.50.100,3260] successful.
May 28 03:26:53.071549 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.075743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.082724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:26:53.091158 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.091158 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.091158 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.091158 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.091158 np0000001589 nova-compute[98297]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.091158 np0000001589 nova-compute[98297]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.091158 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:26:53.091456 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.091456 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.091456 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.091456 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.091456 np0000001589 nova-compute[98297]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.091456 np0000001589 nova-compute[98297]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.091456 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:26:53.091844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.120s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:26:53.092023 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:26:53.093369 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] HCTL ('11', '-', '-', 0) found on session 225 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:26:53.093515 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:26:53.099351 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.099351 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.099351 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.099351 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.099351 np0000001589 nova-compute[98297]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.099351 np0000001589 nova-compute[98297]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.099351 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:26:53.099580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.099580 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:26:53.099580 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.099580 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:26:53.099580 np0000001589 nova-compute[98297]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.099580 np0000001589 nova-compute[98297]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:26:53.099580 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:26:53.099844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.128s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:26:53.099998 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:26:53.100736 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] HCTL ('12', '-', '-', 0) found on session 226 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:26:53.100869 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:26:53.107377 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 225 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:26:53.107377 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:26:53.114010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 226 and hctl ['12', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:26:53.778168 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 912d0a97-5d11-4483-b87a-0408f6db2569 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:26:53.778467 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance e1317970-b47b-43df-853a-ce29f491d580 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:26:53.778467 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance b88b0f00-e92b-4eeb-afce-7662c0451b28 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:26:53.778554 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:26:53.778685 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:26:52 up 54 min,  2 users,  load average: 0.55, 1.73, 3.19\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_db67427fcf5b43bfbd3bad3aeccdef20': '3', 'io_workload': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:26:53.945661 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:26:53.945933 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:26:54.114312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Searching for a device in session 226 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:26:54.114465 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:26:54.448666 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:26:54.954104 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:26:54.954571 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.238s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:54.954571 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:26:54.986550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Found WWN 330000000e46da4b2 for multipath device dm-6 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:26:54.987315 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.027s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:26:54.987315 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '330000000e46da4b2', 'path': '/dev/dm-6', 'multipath_id': '330000000e46da4b2'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:26:54.987315 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e46da4b2', 'path': '/dev/dm-6', 'multipath_id': '330000000e46da4b2'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:26:55.491982 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-57861150',display_name='tempest-TestVolumeBootPatternV346-server-57861150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-57861150',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyzAO+lxN7LsCrJLCCk2zRdySgDL1f9PRREBL0OhnLXs4i4VsMTfMxQPf0ZhH5VuHrYfZhsavqBhRKzyKMDltVjiQEbiGXr2zHvRjqbWW7O2Rf6X34mqPrdsToeOCWdBQ==',key_name='tempest-keypair-49666251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-c38xgwyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=b88b0f00-e92b-4eeb-afce-7662c0451b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:26:55.492216 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:26:55.492717 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:2d,bridge_name='br-int',has_traffic_filtering=True,id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf503969f-69') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:26:55.493319 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lazy-loading 'pci_devices' on Instance uuid b88b0f00-e92b-4eeb-afce-7662c0451b28 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:26:55.995841 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] End _get_guest_xml xml=<domain type="qemu">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <uuid>b88b0f00-e92b-4eeb-afce-7662c0451b28</uuid>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <name>instance-0000004f</name>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:name>tempest-TestVolumeBootPatternV346-server-57861150</nova:name>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:26:51</nova:creationTime>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:image uuid="">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:user uuid="052e09fc1fe54c2d8d325f6fb32a482a">tempest-TestVolumeBootPatternV346-548403211-project-member</nova:user>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:project uuid="db67427fcf5b43bfbd3bad3aeccdef20">tempest-TestVolumeBootPatternV346-548403211</nova:project>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:root type="volume" uuid=""/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         <nova:port uuid="f503969f-6976-4f0e-9fdd-39c13fa9c8f9">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <system>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <entry name="serial">b88b0f00-e92b-4eeb-afce-7662c0451b28</entry>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <entry name="uuid">b88b0f00-e92b-4eeb-afce-7662c0451b28</entry>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </system>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <os>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   </os>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <features>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   </features>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   <devices>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28/disk.config"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </disk>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <disk type="block" device="disk">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <alias name="ua-fcc8644e-012f-452c-b5da-879f4ccd3af0"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <source dev="/dev/dm-6"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <serial>fcc8644e-012f-452c-b5da-879f4ccd3af0</serial>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </disk>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:44:5f:2d"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <target dev="tapf503969f-69"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </interface>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28/console.log" append="off"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </serial>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <video>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </video>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </rng>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:   </devices>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]: </domain>
May 28 03:26:55.995841 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Preparing to wait for external event network-vif-plugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-57861150',display_name='tempest-TestVolumeBootPatternV346-server-57861150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-57861150',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyzAO+lxN7LsCrJLCCk2zRdySgDL1f9PRREBL0OhnLXs4i4VsMTfMxQPf0ZhH5VuHrYfZhsavqBhRKzyKMDltVjiQEbiGXr2zHvRjqbWW7O2Rf6X34mqPrdsToeOCWdBQ==',key_name='tempest-keypair-49666251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-c38xgwyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:26:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=b88b0f00-e92b-4eeb-afce-7662c0451b28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:2d,bridge_name='br-int',has_traffic_filtering=True,id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf503969f-69') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:26:55.997994 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:2d,bridge_name='br-int',has_traffic_filtering=True,id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf503969f-69') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:26:55.998375 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:55.998642 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:26:55.998972 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:26:55.999491 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:55.999629 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48f70598-60d5-5f7d-b928-e1441bc21daf', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:26:56.000271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:56.000914 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:26:56.001204 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:56.002608 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:56.002729 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf503969f-69, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:26:56.002982 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf503969f-69, col_values=(('qos', UUID('223e664d-835c-4ece-b02f-9029b03ef8f3')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:26:56.003116 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf503969f-69, col_values=(('external_ids', {'iface-id': 'f503969f-6976-4f0e-9fdd-39c13fa9c8f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:5f:2d', 'vm-uuid': 'b88b0f00-e92b-4eeb-afce-7662c0451b28'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:26:56.003691 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:56.004656 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:26:56.008447 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:56.009154 np0000001589 nova-compute[98297]: INFO os_vif [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:5f:2d,bridge_name='br-int',has_traffic_filtering=True,id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf503969f-69')
May 28 03:26:56.954465 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:56.954701 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:56.954972 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:56.955244 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.18 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:26:57.137672 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:26:57.138069 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:26:57.522677 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:26:57.522772 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:26:57.522878 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] No VIF found with MAC fa:16:3e:44:5f:2d, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:26:57.523206 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Using config drive
May 28 03:26:58.028919 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:26:58.140445 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Creating config drive at /opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28/disk.config
May 28 03:26:58.144051 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp88i31_d5 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:26:58.204775 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp88i31_d5" returned: 0 in 0.060s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:26:58.562478 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:58.580704 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:58.675080 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:58.758693 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8d332490-ea97-49bd-8c75-f96cd150ad0c req-c500e944-8734-44be-9ab8-fa0097b1a9b9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-vif-plugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:26:58.759216 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8d332490-ea97-49bd-8c75-f96cd150ad0c req-c500e944-8734-44be-9ab8-fa0097b1a9b9 service nova] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:26:58.759435 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8d332490-ea97-49bd-8c75-f96cd150ad0c req-c500e944-8734-44be-9ab8-fa0097b1a9b9 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:26:58.759578 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-8d332490-ea97-49bd-8c75-f96cd150ad0c req-c500e944-8734-44be-9ab8-fa0097b1a9b9 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:26:58.759728 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-8d332490-ea97-49bd-8c75-f96cd150ad0c req-c500e944-8734-44be-9ab8-fa0097b1a9b9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Processing event network-vif-plugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:26:58.808864 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:58.848026 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:58.848921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:26:59.208606 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938819.208206, b88b0f00-e92b-4eeb-afce-7662c0451b28 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:26:59.208998 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:26:59.209102 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] VM Started (Lifecycle Event)
May 28 03:26:59.212893 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:26:59.216137 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Instance spawned successfully.
May 28 03:26:59.216801 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:26:59.711758 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:26:59.713788 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:26:59.723008 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:59.723163 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:59.723455 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:59.723702 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:59.723984 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:26:59.724896 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:27:00.215908 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:27:00.216322 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938820.215991, b88b0f00-e92b-4eeb-afce-7662c0451b28 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:27:00.216322 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] VM Paused (Lifecycle Event)
May 28 03:27:00.229046 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Took 8.43 seconds to spawn the instance on the hypervisor.
May 28 03:27:00.229428 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:27:00.718369 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:27:00.720308 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938820.7200944, b88b0f00-e92b-4eeb-afce-7662c0451b28 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:27:00.720421 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] VM Resumed (Lifecycle Event)
May 28 03:27:00.736247 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Took 15.37 seconds to build instance.
May 28 03:27:00.805826 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-06172985-b8f4-4e0d-9379-918e964c4bab req-eb893553-945a-4f95-9f6f-3298ab9d24c9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-vif-plugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:00.806068 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-06172985-b8f4-4e0d-9379-918e964c4bab req-eb893553-945a-4f95-9f6f-3298ab9d24c9 service nova] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:00.806219 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-06172985-b8f4-4e0d-9379-918e964c4bab req-eb893553-945a-4f95-9f6f-3298ab9d24c9 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:00.806389 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-06172985-b8f4-4e0d-9379-918e964c4bab req-eb893553-945a-4f95-9f6f-3298ab9d24c9 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:00.806503 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-06172985-b8f4-4e0d-9379-918e964c4bab req-eb893553-945a-4f95-9f6f-3298ab9d24c9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] No waiting events found dispatching network-vif-plugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:27:00.806612 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-06172985-b8f4-4e0d-9379-918e964c4bab req-eb893553-945a-4f95-9f6f-3298ab9d24c9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received unexpected event network-vif-plugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 for instance with vm_state active and task_state None.
May 28 03:27:01.005904 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:01.222475 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:27:01.224299 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:27:01.237655 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-de9bcc3c-9485-4c5a-8721-f18cf0df46af tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.880s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:01.611629 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-changed-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:01.611795 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Refreshing instance network info cache due to event network-changed-f503969f-6976-4f0e-9fdd-39c13fa9c8f9. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:27:01.611993 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] Acquiring lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:27:01.612127 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] Acquired lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:27:01.612273 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Refreshing network info cache for port f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:27:02.113982 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:02.378271 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:02.495364 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Updated VIF entry in instance network info cache for port f503969f-6976-4f0e-9fdd-39c13fa9c8f9. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:27:02.495659 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Updating instance_info_cache with network_info: [{"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:27:02.998034 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-e1e24013-ee60-480b-8975-eb4fd6b0220f req-14be07ec-f069-4e9d-b169-5bb92076bbb9 service nova] Releasing lock "refresh_cache-b88b0f00-e92b-4eeb-afce-7662c0451b28" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:27:03.810424 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:04.137958 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:04.138210 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:27:06.007871 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:08.813342 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:11.009911 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:13.815032 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:16.011885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:18.816266 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:21.014024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:23.817680 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:26.016907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:28.821163 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:31.018865 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:33.821072 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:36.021095 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:38.285434 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:38.285856 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:38.285856 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:38.285923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:38.286023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:38.288541 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Terminating instance
May 28 03:27:38.791514 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:27:38.806899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:38.808453 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:38.821789 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:38.925247 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b721208a-eb72-485b-ac0c-6f4c3bddd199 req-9a91209a-1ae9-4a0c-99f1-27c822524110 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-vif-unplugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:38.925428 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b721208a-eb72-485b-ac0c-6f4c3bddd199 req-9a91209a-1ae9-4a0c-99f1-27c822524110 service nova] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:38.925566 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b721208a-eb72-485b-ac0c-6f4c3bddd199 req-9a91209a-1ae9-4a0c-99f1-27c822524110 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:38.925731 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b721208a-eb72-485b-ac0c-6f4c3bddd199 req-9a91209a-1ae9-4a0c-99f1-27c822524110 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:38.925818 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b721208a-eb72-485b-ac0c-6f4c3bddd199 req-9a91209a-1ae9-4a0c-99f1-27c822524110 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] No waiting events found dispatching network-vif-unplugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:27:38.925922 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b721208a-eb72-485b-ac0c-6f4c3bddd199 req-9a91209a-1ae9-4a0c-99f1-27c822524110 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-vif-unplugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:27:38.958774 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:38.963981 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:39.106682 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999688119999973 future=<Future at 0x7e4b40467650 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:39.107123 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999216801999864 future=<Future at 0x7e4b40467650 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:39.107276 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999050992999855 future=<Future at 0x7e4b40467650 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:39.109277 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Instance destroyed successfully.
May 28 03:27:39.109654 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lazy-loading 'resources' on Instance uuid b88b0f00-e92b-4eeb-afce-7662c0451b28 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:27:39.611926 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-57861150',display_name='tempest-TestVolumeBootPatternV346-server-57861150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-57861150',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyzAO+lxN7LsCrJLCCk2zRdySgDL1f9PRREBL0OhnLXs4i4VsMTfMxQPf0ZhH5VuHrYfZhsavqBhRKzyKMDltVjiQEbiGXr2zHvRjqbWW7O2Rf6X34mqPrdsToeOCWdBQ==',key_name='tempest-keypair-49666251',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:27:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-c38xgwyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:27:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=b88b0f00-e92b-4eeb-afce-7662c0451b28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:27:39.612332 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "address": "fa:16:3e:44:5f:2d", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf503969f-69", "ovs_interfaceid": "f503969f-6976-4f0e-9fdd-39c13fa9c8f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:27:39.612749 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:5f:2d,bridge_name='br-int',has_traffic_filtering=True,id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf503969f-69') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:27:39.612969 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:5f:2d,bridge_name='br-int',has_traffic_filtering=True,id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf503969f-69') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:27:39.614259 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:39.614521 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf503969f-69, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:27:39.615500 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:39.616240 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:27:39.616885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:39.617015 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=223e664d-835c-4ece-b02f-9029b03ef8f3) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:27:39.617414 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:39.617844 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:27:39.619497 np0000001589 nova-compute[98297]: INFO os_vif [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:5f:2d,bridge_name='br-int',has_traffic_filtering=True,id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf503969f-69')
May 28 03:27:39.621265 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:27:39.621569 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:27:39.621703 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:27:39.622043 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:27:39.622326 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fcc8644e-012f-452c-b5da-879f4ccd3af0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:27:39.622458 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:27:39.645748 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:39.645748 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:39.645748 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:39.645748 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:39.645748 np0000001589 nova-compute[98297]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:27:39.645748 np0000001589 nova-compute[98297]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:27:39.645748 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:27:39.645953 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:39.645953 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:39.645953 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:39.645953 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:39.645953 np0000001589 nova-compute[98297]: tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:27:39.645953 np0000001589 nova-compute[98297]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0 (non-flash)
May 28 03:27:39.645953 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:27:39.646081 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', '223'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', '224'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', '226')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:27:39.646136 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', '225')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:27:39.646984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0', '226')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:27:39.647653 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b4069a980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'): ({'sdg'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:27:39.647837 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Removing multipathed devices sdf, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:27:39.648028 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flush multipath device 330000000e46da4b2 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:27:39.703512 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:27:39.744544 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:27:39.793472 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:27:39.793690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:27:39.794659 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:27:39.805309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:27:39.805550 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:27:39.816181 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:39.842848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.40.100,3260]
May 28 03:27:39.842848 np0000001589 nova-compute[98297]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.40.100,3260] successful.
May 28 03:27:39.842848 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:39.856485 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:39.866272 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:39.891987 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.50.100,3260]
May 28 03:27:39.891987 np0000001589 nova-compute[98297]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-fcc8644e-012f-452c-b5da-879f4ccd3af0, portal: 192.168.50.100,3260] successful.
May 28 03:27:39.891987 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:39.904819 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:39.905064 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:27:39.905222 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== disconnect_volume: return (283ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:27:39.905389 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:27:39.905681 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Deleting instance files /opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28_del
May 28 03:27:39.906170 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Deletion of /opt/stack/data/nova/instances/b88b0f00-e92b-4eeb-afce-7662c0451b28_del complete
May 28 03:27:40.411687 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Took 1.62 seconds to destroy the instance on the hypervisor.
May 28 03:27:40.412315 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:27:40.412659 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:27:40.412837 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:27:40.413087 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:40.468256 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:40.973514 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-vif-unplugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:40.973839 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] Acquiring lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:40.973982 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:40.974088 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:40.974193 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] No waiting events found dispatching network-vif-unplugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:27:40.974314 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-vif-unplugged-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:27:40.974467 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Received event network-vif-deleted-f503969f-6976-4f0e-9fdd-39c13fa9c8f9 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:40.974561 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Neutron deleted interface f503969f-6976-4f0e-9fdd-39c13fa9c8f9; detaching it from the instance and deleting it from the info cache
May 28 03:27:40.976166 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-75d5a1ef-3f09-4222-9fe1-73837363c1f4 req-375cdcfd-a86e-4c02-9726-1220007eb307 service nova] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Detach interface failed, port_id=f503969f-6976-4f0e-9fdd-39c13fa9c8f9, reason: Instance b88b0f00-e92b-4eeb-afce-7662c0451b28 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:27:41.284550 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:27:41.786254 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Took 1.37 seconds to deallocate network for instance.
May 28 03:27:42.325907 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:27:42.830486 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:42.831280 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:42.983600 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:27:42.983828 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:27:43.486289 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:27:43.993091 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.162s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:44.036140 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Deleted allocations for instance b88b0f00-e92b-4eeb-afce-7662c0451b28
May 28 03:27:44.619634 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:44.735219 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:45.043051 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e8ba8dc4-9787-4350-a206-7269a8a6f5b8 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "b88b0f00-e92b-4eeb-afce-7662c0451b28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.757s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:46.137641 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:46.138073 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:27:47.816464 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:47.816938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:47.816938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:47.817130 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:47.817332 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:47.819690 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Terminating instance
May 28 03:27:48.323004 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:27:48.337265 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:48.338322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:48.350256 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:48.441546 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cdfb5627-a2d2-49b4-b3bb-7edd885c4c52 req-7eb6f822-41a0-4023-af71-1e36b5c316d3 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-vif-unplugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:48.441784 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cdfb5627-a2d2-49b4-b3bb-7edd885c4c52 req-7eb6f822-41a0-4023-af71-1e36b5c316d3 service nova] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:48.442042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cdfb5627-a2d2-49b4-b3bb-7edd885c4c52 req-7eb6f822-41a0-4023-af71-1e36b5c316d3 service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:48.442706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cdfb5627-a2d2-49b4-b3bb-7edd885c4c52 req-7eb6f822-41a0-4023-af71-1e36b5c316d3 service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:48.443100 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cdfb5627-a2d2-49b4-b3bb-7edd885c4c52 req-7eb6f822-41a0-4023-af71-1e36b5c316d3 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] No waiting events found dispatching network-vif-unplugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:27:48.443259 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cdfb5627-a2d2-49b4-b3bb-7edd885c4c52 req-7eb6f822-41a0-4023-af71-1e36b5c316d3 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-vif-unplugged-f5845eab-c92f-461f-99f4-e5fb607de388 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:27:48.475105 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:48.480191 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:48.629830 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999733042000116 future=<Future at 0x7e4b644ec530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:48.631524 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: e1317970-b47b-43df-853a-ce29f491d580] Instance destroyed successfully.
May 28 03:27:48.631981 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lazy-loading 'resources' on Instance uuid e1317970-b47b-43df-853a-ce29f491d580 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:27:49.134185 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-598858517',display_name='tempest-TestVolumeBootPatternV346-server-598858517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-598858517',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEjI1lis5G9QoDIuJg/49T1+OQdTifTSztkBQTKAnqchN++G0z+YX8cHJsUR92py0h0Yt+KLF5zKUu7Y3AWj8167HwWr9WDSm1MG82s5k2frf9wzQTOib1YnBE7luVLYA==',key_name='tempest-keypair-1811695906',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:26:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-hsk2cuyt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:26:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=e1317970-b47b-43df-853a-ce29f491d580,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:27:49.134715 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "f5845eab-c92f-461f-99f4-e5fb607de388", "address": "fa:16:3e:d5:10:ca", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5845eab-c9", "ovs_interfaceid": "f5845eab-c92f-461f-99f4-e5fb607de388", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:27:49.134901 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:10:ca,bridge_name='br-int',has_traffic_filtering=True,id=f5845eab-c92f-461f-99f4-e5fb607de388,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845eab-c9') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:27:49.135126 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:10:ca,bridge_name='br-int',has_traffic_filtering=True,id=f5845eab-c92f-461f-99f4-e5fb607de388,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845eab-c9') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:27:49.136107 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:49.136434 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5845eab-c9, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:27:49.137973 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:49.138759 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:27:49.139295 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:49.139489 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0c9cd86-8d6c-40c7-8399-060768f69962) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:27:49.139961 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:49.140878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:27:49.142159 np0000001589 nova-compute[98297]: INFO os_vif [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:10:ca,bridge_name='br-int',has_traffic_filtering=True,id=f5845eab-c92f-461f-99f4-e5fb607de388,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5845eab-c9')
May 28 03:27:49.143498 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:27:49.143752 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:27:49.143863 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:27:49.144144 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:27:49.144403 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:27:49.144516 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:27:49.168243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:49.168243 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:49.168243 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:49.168243 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:49.168243 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:27:49.168452 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:49.168452 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:49.168452 np0000001589 nova-compute[98297]: tcp: [223] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:49.168452 np0000001589 nova-compute[98297]: tcp: [224] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2 (non-flash)
May 28 03:27:49.168452 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:27:49.168547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '222'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', '223'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', '224')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:27:49.168643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', '224')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:27:49.169395 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2', '223')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:27:49.170021 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40531580>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'): ({'sdd'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:27:49.170185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:27:49.170469 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flush multipath device 3300000000fb1bd29 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:27:49.216283 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:27:49.253646 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:27:49.288505 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:27:49.288727 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:27:49.289535 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:27:49.300703 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:27:49.300875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:27:49.311721 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:49.335927 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 224, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.40.100,3260]
May 28 03:27:49.335927 np0000001589 nova-compute[98297]: Logout of [sid: 224, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.40.100,3260] successful.
May 28 03:27:49.335927 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:49.347701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:49.357383 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:49.390896 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.50.100,3260]
May 28 03:27:49.390896 np0000001589 nova-compute[98297]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-46f3ab54-bef1-4f31-b0b5-8a3a59ec71e2, portal: 192.168.50.100,3260] successful.
May 28 03:27:49.390896 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:49.402032 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:49.402244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:27:49.402360 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== disconnect_volume: return (258ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:27:49.402472 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:27:49.402744 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Deleting instance files /opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580_del
May 28 03:27:49.403172 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Deletion of /opt/stack/data/nova/instances/e1317970-b47b-43df-853a-ce29f491d580_del complete
May 28 03:27:49.908797 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Took 1.59 seconds to destroy the instance on the hypervisor.
May 28 03:27:49.909482 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:27:49.909786 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: e1317970-b47b-43df-853a-ce29f491d580] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:27:49.909866 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: e1317970-b47b-43df-853a-ce29f491d580] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:27:49.910114 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:49.966350 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:50.325649 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5641aab8-99c8-476a-8aa4-9daaf398700a req-75047fef-efdf-4f48-b5bf-754e476f0822 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-vif-deleted-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:50.326593 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-5641aab8-99c8-476a-8aa4-9daaf398700a req-75047fef-efdf-4f48-b5bf-754e476f0822 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Neutron deleted interface f5845eab-c92f-461f-99f4-e5fb607de388; detaching it from the instance and deleting it from the info cache
May 28 03:27:50.328309 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-5641aab8-99c8-476a-8aa4-9daaf398700a req-75047fef-efdf-4f48-b5bf-754e476f0822 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Detach interface failed, port_id=f5845eab-c92f-461f-99f4-e5fb607de388, reason: Instance e1317970-b47b-43df-853a-ce29f491d580 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:27:50.492823 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b47dfb6d-bdef-43c3-bd4e-f852c8f5c48d req-aaf60bf1-75b3-448d-9dcf-f161f2a6f742 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-vif-unplugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:50.493218 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b47dfb6d-bdef-43c3-bd4e-f852c8f5c48d req-aaf60bf1-75b3-448d-9dcf-f161f2a6f742 service nova] Acquiring lock "e1317970-b47b-43df-853a-ce29f491d580-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:50.493396 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b47dfb6d-bdef-43c3-bd4e-f852c8f5c48d req-aaf60bf1-75b3-448d-9dcf-f161f2a6f742 service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:50.493509 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b47dfb6d-bdef-43c3-bd4e-f852c8f5c48d req-aaf60bf1-75b3-448d-9dcf-f161f2a6f742 service nova] Lock "e1317970-b47b-43df-853a-ce29f491d580-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:50.493933 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b47dfb6d-bdef-43c3-bd4e-f852c8f5c48d req-aaf60bf1-75b3-448d-9dcf-f161f2a6f742 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] No waiting events found dispatching network-vif-unplugged-f5845eab-c92f-461f-99f4-e5fb607de388 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:27:50.493933 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b47dfb6d-bdef-43c3-bd4e-f852c8f5c48d req-aaf60bf1-75b3-448d-9dcf-f161f2a6f742 service nova] [instance: e1317970-b47b-43df-853a-ce29f491d580] Received event network-vif-unplugged-f5845eab-c92f-461f-99f4-e5fb607de388 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:27:50.784964 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: e1317970-b47b-43df-853a-ce29f491d580] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:27:51.286991 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: e1317970-b47b-43df-853a-ce29f491d580] Took 1.38 seconds to deallocate network for instance.
May 28 03:27:51.786776 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:27:51.827699 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:27:52.332907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:52.333033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:52.452288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:27:52.452499 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:27:52.955086 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:27:53.137620 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:53.137783 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:27:53.139056 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:53.460409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.127s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:53.502935 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Deleted allocations for instance e1317970-b47b-43df-853a-ce29f491d580
May 28 03:27:53.642825 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:53.642978 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:53.643072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:53.643190 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:27:54.106814 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003498299997772847 future=<Future at 0x7e4b40467650 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:54.107258 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Emitting event <LifecycleEvent: 1779938859.10622, b88b0f00-e92b-4eeb-afce-7662c0451b28 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:27:54.107436 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:54.107636 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] VM Stopped (Lifecycle Event)
May 28 03:27:54.108741 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.520834154000113 future=<Future at 0x7e4b644ec530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:54.108815 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.5207111550003 future=<Future at 0x7e4b644ec530 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:54.141220 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:54.510408 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3e280f88-257a-483e-b38d-ba953a9e0dfb tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "e1317970-b47b-43df-853a-ce29f491d580" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.694s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:54.610350 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cf2cedf6-5d02-4935-8307-125c448f37f7 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: b88b0f00-e92b-4eeb-afce-7662c0451b28] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:27:54.659052 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:27:54.660422 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:27:54.661138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:27:54.706294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:27:54.706645 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13687MB free_disk=72.62489318847656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:27:54.706800 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:54.707018 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:55.758032 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 912d0a97-5d11-4483-b87a-0408f6db2569 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:27:55.758385 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:27:55.758385 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:27:54 up 55 min,  2 users,  load average: 0.44, 1.49, 3.01\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_db67427fcf5b43bfbd3bad3aeccdef20': '1', 'io_workload': '0'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:27:55.836542 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:27:55.836757 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:27:56.339133 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:27:56.844624 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:27:56.845166 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.138s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:56.845166 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:57.219465 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:57.219677 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:57.219872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:57.220003 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:57.220111 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:57.222268 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Terminating instance
May 28 03:27:57.346626 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:27:57.725129 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:27:57.739096 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:57.752024 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:57.754736 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:57.769921 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:57.853539 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-544bf42a-ec1f-477f-8a8c-640298148e70 req-1aa88451-86d4-495e-879a-ca36e07a5408 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-vif-unplugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:57.854048 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-544bf42a-ec1f-477f-8a8c-640298148e70 req-1aa88451-86d4-495e-879a-ca36e07a5408 service nova] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:57.854048 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-544bf42a-ec1f-477f-8a8c-640298148e70 req-1aa88451-86d4-495e-879a-ca36e07a5408 service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:57.854048 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-544bf42a-ec1f-477f-8a8c-640298148e70 req-1aa88451-86d4-495e-879a-ca36e07a5408 service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:57.854344 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-544bf42a-ec1f-477f-8a8c-640298148e70 req-1aa88451-86d4-495e-879a-ca36e07a5408 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] No waiting events found dispatching network-vif-unplugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:27:57.854491 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-544bf42a-ec1f-477f-8a8c-640298148e70 req-1aa88451-86d4-495e-879a-ca36e07a5408 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-vif-unplugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:27:58.029445 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999693237999963 future=<Future at 0x7e4b8011dfa0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:27:58.031259 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Instance destroyed successfully.
May 28 03:27:58.032083 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lazy-loading 'resources' on Instance uuid 912d0a97-5d11-4483-b87a-0408f6db2569 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:27:58.534136 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:24:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-162011668',display_name='tempest-TestVolumeBootPatternV346-server-162011668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-testvolumebootpatternv346-server-162011668',id=77,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNYBVxCSbZYk2LG0rFTuTTc8WLLgrX56LmT7hYbtQ6r5x1z4dKwUR/uqPzltwFlk4lVw7/mlNNibks+Hfp62siJvmFHQvUJoCrgrUVzJXjyo0ElFbLK4SJrpd3pReLSag==',key_name='tempest-keypair-5272716',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:25:00Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db67427fcf5b43bfbd3bad3aeccdef20',ramdisk_id='',reservation_id='r-9ei0ivhn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-548403211',owner_user_name='tempest-TestVolumeBootPatternV346-548403211-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:25:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='052e09fc1fe54c2d8d325f6fb32a482a',uuid=912d0a97-5d11-4483-b87a-0408f6db2569,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:27:58.534391 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converting VIF {"id": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "address": "fa:16:3e:6a:58:b5", "network": {"id": "343e1dec-f01f-4512-bca3-3697297e359c", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-803349563-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "db67427fcf5b43bfbd3bad3aeccdef20", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap314334ec-c0", "ovs_interfaceid": "314334ec-c09e-450a-a8be-5b6fc9ad3172", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:27:58.534914 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:58:b5,bridge_name='br-int',has_traffic_filtering=True,id=314334ec-c09e-450a-a8be-5b6fc9ad3172,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314334ec-c0') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:27:58.535126 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:58:b5,bridge_name='br-int',has_traffic_filtering=True,id=314334ec-c09e-450a-a8be-5b6fc9ad3172,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314334ec-c0') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:27:58.536166 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:58.536364 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap314334ec-c0, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:27:58.537583 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:58.538669 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:27:58.539048 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:27:58.539165 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4735c90e-6bd4-472d-8901-387ed7b21c3d) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:27:58.540332 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:27:58.542096 np0000001589 nova-compute[98297]: INFO os_vif [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:58:b5,bridge_name='br-int',has_traffic_filtering=True,id=314334ec-c09e-450a-a8be-5b6fc9ad3172,network=Network(343e1dec-f01f-4512-bca3-3697297e359c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap314334ec-c0')
May 28 03:27:58.543486 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:27:58.543774 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:27:58.543894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:27:58.544252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:27:58.544522 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1cd83f50-cd83-46ed-833a-42092027809c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:27:58.544643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:27:58.564391 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:58.564391 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:58.564391 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:27:58.564567 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsi session list stdout=tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:58.564567 np0000001589 nova-compute[98297]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c (non-flash)
May 28 03:27:58.564567 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:27:58.564635 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '222')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:27:58.564689 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '221')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:27:58.565393 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c', '222')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:27:58.565935 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40675260>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:27:58.566104 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:27:58.566298 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Flush multipath device 33000000036913385 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:27:58.625526 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:27:58.662680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:27:58.709551 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:27:58.709756 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:27:58.710453 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:27:58.722717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:27:58.722919 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:27:58.734899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:58.757922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.40.100,3260]
May 28 03:27:58.757922 np0000001589 nova-compute[98297]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.40.100,3260] successful.
May 28 03:27:58.757922 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:58.769041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:58.779247 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:58.803390 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.50.100,3260]
May 28 03:27:58.803390 np0000001589 nova-compute[98297]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-1cd83f50-cd83-46ed-833a-42092027809c, portal: 192.168.50.100,3260] successful.
May 28 03:27:58.803390 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:58.813846 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:27:58.814788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:27:58.814788 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] <== disconnect_volume: return (270ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:27:58.814788 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:27:58.814939 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Deleting instance files /opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569_del
May 28 03:27:58.815679 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Deletion of /opt/stack/data/nova/instances/912d0a97-5d11-4483-b87a-0408f6db2569_del complete
May 28 03:27:59.322056 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Took 1.60 seconds to destroy the instance on the hypervisor.
May 28 03:27:59.322578 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:27:59.322917 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:27:59.323029 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:27:59.323322 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:59.346540 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:59.346761 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:59.346956 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:59.347193 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:59.347465 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:27:59.347681 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.79 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:27:59.381392 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:27:59.763458 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7a785579-1129-43d3-a544-2024bdc2c701 req-bfe2e176-e87b-4657-b8f8-22a334c75502 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-vif-deleted-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:59.763663 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-7a785579-1129-43d3-a544-2024bdc2c701 req-bfe2e176-e87b-4657-b8f8-22a334c75502 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Neutron deleted interface 314334ec-c09e-450a-a8be-5b6fc9ad3172; detaching it from the instance and deleting it from the info cache
May 28 03:27:59.765300 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-7a785579-1129-43d3-a544-2024bdc2c701 req-bfe2e176-e87b-4657-b8f8-22a334c75502 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Detach interface failed, port_id=314334ec-c09e-450a-a8be-5b6fc9ad3172, reason: Instance 912d0a97-5d11-4483-b87a-0408f6db2569 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:27:59.907805 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52899f7a-6b93-43ab-8443-313518075dec req-dd72e8b4-d8d0-477a-a0e5-173e2050b8d8 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-vif-unplugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:27:59.908173 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52899f7a-6b93-43ab-8443-313518075dec req-dd72e8b4-d8d0-477a-a0e5-173e2050b8d8 service nova] Acquiring lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:27:59.908828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52899f7a-6b93-43ab-8443-313518075dec req-dd72e8b4-d8d0-477a-a0e5-173e2050b8d8 service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:27:59.908828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-52899f7a-6b93-43ab-8443-313518075dec req-dd72e8b4-d8d0-477a-a0e5-173e2050b8d8 service nova] Lock "912d0a97-5d11-4483-b87a-0408f6db2569-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:27:59.908828 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52899f7a-6b93-43ab-8443-313518075dec req-dd72e8b4-d8d0-477a-a0e5-173e2050b8d8 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] No waiting events found dispatching network-vif-unplugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:27:59.908828 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-52899f7a-6b93-43ab-8443-313518075dec req-dd72e8b4-d8d0-477a-a0e5-173e2050b8d8 service nova] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Received event network-vif-unplugged-314334ec-c09e-450a-a8be-5b6fc9ad3172 for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:28:00.220415 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:28:00.722339 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Took 1.40 seconds to deallocate network for instance.
May 28 03:28:01.261628 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Took 0.54 seconds to detach 1 volumes for instance.
May 28 03:28:01.766319 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:01.766794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:01.844753 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:28:01.844968 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:28:02.347197 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:28:02.853998 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.087s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:02.894587 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Deleted allocations for instance 912d0a97-5d11-4483-b87a-0408f6db2569
May 28 03:28:03.541365 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:03.629983 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00040378699986831634 future=<Future at 0x7e4b644ec530 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:28:03.630122 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:28:03.630187 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.39891242900012 future=<Future at 0x7e4b8011dfa0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:28:03.630300 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=9.398805900999832 future=<Future at 0x7e4b8011dfa0 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:28:03.630604 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938868.629475, e1317970-b47b-43df-853a-ce29f491d580 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:28:03.630790 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] VM Stopped (Lifecycle Event)
May 28 03:28:03.902300 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-051a167d-5ff4-484e-98e3-ef06c5f4cd21 tempest-TestVolumeBootPatternV346-548403211 tempest-TestVolumeBootPatternV346-548403211-project-member] Lock "912d0a97-5d11-4483-b87a-0408f6db2569" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.683s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:04.132886 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-cb72b24a-5415-45c6-8ef9-5b1a020bc70d tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: e1317970-b47b-43df-853a-ce29f491d580] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:28:04.137966 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:04.138240 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:28:06.263111 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:07.773726 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:08.137817 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:08.137941 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 03:28:08.542801 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:08.640576 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] There are 0 instances to clean {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 03:28:08.640932 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:08.641121 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98297) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 03:28:09.143027 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 20.26 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:28:10.946572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:12.804163 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:13.029441 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003125230000478041 future=<Future at 0x7e4b8011dfa0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:28:13.029570 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:28:13.029967 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779938878.029035, 912d0a97-5d11-4483-b87a-0408f6db2569 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:28:13.030114 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] VM Stopped (Lifecycle Event)
May 28 03:28:13.532514 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-be09bee8-0997-4a9d-a2f8-964fe6ec072f tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 912d0a97-5d11-4483-b87a-0408f6db2569] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:28:13.544045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:13.833498 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:15.631322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:17.007842 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:18.546032 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:18.836209 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:19.988661 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:19.989053 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:20.490379 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:28:21.040138 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:21.040482 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:21.043300 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:28:21.043462 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Claim successful on node np0000001589
May 28 03:28:22.127499 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:28:22.127819 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:28:22.630354 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:28:23.136535 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.096s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:23.137104 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:28:23.547262 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:23.642932 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:28:23.645682 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:28:23.646022 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:28:23.646260 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:28:23.706380 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b072fd3968240558761e1092daeadbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae4c26a96294aac9f0e41aa1f588ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:28:23.837164 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:24.084094 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Successfully created port: 1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:28:24.144905 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:28:24.491649 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Successfully updated port: 1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:28:24.533006 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-changed-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:28:24.533133 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Refreshing instance network info cache due to event network-changed-1c484d65-fb3c-4479-b3e8-e806c283851a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:28:24.533519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] Acquiring lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:28:24.533519 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] Acquired lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:28:24.534030 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Refreshing network info cache for port 1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:28:24.647675 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:28:24.993440 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:28:25.035746 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:28:25.086135 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:28:25.195330 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:28:25.656284 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:28:25.656661 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:28:25.656906 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Creating image(s)
May 28 03:28:25.657353 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "/opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:25.657522 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "/opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:25.657947 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "/opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:25.658390 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:28:25.660708 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:28:25.661641 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:25.698306 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-11e59326-2d75-4a51-b19e-2d573541da6c req-ce5b4ff6-f91d-4218-86bb-2f7753350514 service nova] Releasing lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:28:25.699134 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquired lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:28:25.699469 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:28:25.745033 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:25.745444 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:25.745873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:25.746250 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:28:25.748533 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:28:25.748867 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:25.834016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.085s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:25.834634 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:25.887430 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk 1073741824" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:25.887894 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:25.888213 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:25.970006 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.081s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:25.970480 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:28:25.970708 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:26.058192 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:26.058586 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Cannot resize image /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:28:26.058993 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:28:26.059166 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Ensure instance console log exists: /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:28:26.059459 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:26.059672 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:26.060031 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:26.262738 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:28:26.387266 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:28:26.500808 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating instance_info_cache with network_info: [{"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:28:27.003240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Releasing lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:28:27.003538 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Instance network_info: |[{"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:28:27.005380 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Start _get_guest_xml network_info=[{"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:28:27.009497 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:28:27.010755 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-807502994', uuid='21280f86-03dd-4c76-a5ff-c534416cfe39'), owner=OwnerMeta(userid='5b072fd3968240558761e1092daeadbf', username='tempest-VolumeMultiattachTests-1834139013-project-member', projectid='2ae4c26a96294aac9f0e41aa1f588ec0', projectname='tempest-VolumeMultiattachTests-1834139013'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938907.0104048) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:28:27.011906 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:28:27.012239 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:28:27.013188 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:28:27.013400 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:28:27.014272 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:28:27.014529 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:28:27.014658 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:28:27.014737 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:28:27.014852 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:28:27.014932 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:28:27.015019 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:28:27.015191 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:28:27.015300 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:28:27.015426 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:28:27.015516 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:28:27.015638 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:28:27.026539 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-807502994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-807502994',id=80,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM24eDE9sS5vvA85LYIkaJte3O7AFfswDzhDm546D+D7IttHOOMEVSSGB01TkUZrHZawL0jpOPsR67vY2YQl6dqa0FDurgG/PeoJTjLOIk7WSXI+drc1rwsOTcvWZaZhRA==',key_name='tempest-keypair-935238549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-6ey1e2dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=21280f86-03dd-4c76-a5ff-c534416cfe39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:28:27.026693 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:28:27.027289 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=1c484d65-fb3c-4479-b3e8-e806c283851a,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c484d65-fb') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:28:27.027858 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'pci_devices' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:28:27.530294 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] End _get_guest_xml xml=<domain type="qemu">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <uuid>21280f86-03dd-4c76-a5ff-c534416cfe39</uuid>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <name>instance-00000050</name>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumeMultiattachTests-server-807502994</nova:name>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:28:27</nova:creationTime>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:user uuid="5b072fd3968240558761e1092daeadbf">tempest-VolumeMultiattachTests-1834139013-project-member</nova:user>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:project uuid="2ae4c26a96294aac9f0e41aa1f588ec0">tempest-VolumeMultiattachTests-1834139013</nova:project>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         <nova:port uuid="1c484d65-fb3c-4479-b3e8-e806c283851a">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <system>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <entry name="serial">21280f86-03dd-4c76-a5ff-c534416cfe39</entry>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <entry name="uuid">21280f86-03dd-4c76-a5ff-c534416cfe39</entry>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </system>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <os>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   </os>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <features>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   </features>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   <devices>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </disk>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk.config"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </disk>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:af:79:fe"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <target dev="tap1c484d65-fb"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </interface>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/console.log" append="off"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </serial>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <video>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </video>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </rng>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:   </devices>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]: </domain>
May 28 03:28:27.530294 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Preparing to wait for external event network-vif-plugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-807502994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-807502994',id=80,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM24eDE9sS5vvA85LYIkaJte3O7AFfswDzhDm546D+D7IttHOOMEVSSGB01TkUZrHZawL0jpOPsR67vY2YQl6dqa0FDurgG/PeoJTjLOIk7WSXI+drc1rwsOTcvWZaZhRA==',key_name='tempest-keypair-935238549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-6ey1e2dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:28:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=21280f86-03dd-4c76-a5ff-c534416cfe39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=1c484d65-fb3c-4479-b3e8-e806c283851a,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c484d65-fb') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:28:27.532433 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=1c484d65-fb3c-4479-b3e8-e806c283851a,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c484d65-fb') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:28:27.532743 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:27.532976 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:28:27.533385 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:28:27.533871 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:27.534050 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdab7fae-68d3-5e0a-8d46-ff6bab60e59c', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:28:27.534818 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:27.535474 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:28:27.535980 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:27.537702 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:27.537877 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c484d65-fb, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:28:27.538204 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c484d65-fb, col_values=(('qos', UUID('1416347f-0a8f-4e28-8c4a-4370f2068de1')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:28:27.538406 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c484d65-fb, col_values=(('external_ids', {'iface-id': '1c484d65-fb3c-4479-b3e8-e806c283851a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:79:fe', 'vm-uuid': '21280f86-03dd-4c76-a5ff-c534416cfe39'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:28:27.539097 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:27.540151 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:28:27.544103 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:27.544716 np0000001589 nova-compute[98297]: INFO os_vif [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=1c484d65-fb3c-4479-b3e8-e806c283851a,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c484d65-fb')
May 28 03:28:28.837758 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:29.058300 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:28:29.058300 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:28:29.058300 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:af:79:fe, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:28:29.058551 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Using config drive
May 28 03:28:29.400638 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:29.563677 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:28:29.669883 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Creating config drive at /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk.config
May 28 03:28:29.673874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1oyk3_ql {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:29.728871 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1oyk3_ql" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:29.904535 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.84 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:28:30.105906 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:30.122340 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:30.203074 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:30.207663 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:30.251782 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14bd5505-da2a-4cb2-9928-0349a2d712d8 req-69f8cd93-0359-4e59-885a-79fa118b04f3 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-vif-plugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:28:30.252390 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14bd5505-da2a-4cb2-9928-0349a2d712d8 req-69f8cd93-0359-4e59-885a-79fa118b04f3 service nova] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:30.252598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14bd5505-da2a-4cb2-9928-0349a2d712d8 req-69f8cd93-0359-4e59-885a-79fa118b04f3 service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:30.252729 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-14bd5505-da2a-4cb2-9928-0349a2d712d8 req-69f8cd93-0359-4e59-885a-79fa118b04f3 service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:30.252869 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-14bd5505-da2a-4cb2-9928-0349a2d712d8 req-69f8cd93-0359-4e59-885a-79fa118b04f3 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Processing event network-vif-plugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:28:30.407164 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:30.410791 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:30.421730 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:30.737405 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938910.7370071, 21280f86-03dd-4c76-a5ff-c534416cfe39 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:28:30.737538 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] VM Started (Lifecycle Event)
May 28 03:28:30.739173 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:28:30.742935 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:28:30.745857 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Instance spawned successfully.
May 28 03:28:30.746168 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:28:31.240190 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:28:31.242141 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:28:31.252004 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:28:31.252254 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:28:31.252733 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:28:31.252874 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:28:31.253169 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:28:31.253486 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:28:31.744448 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:28:31.744722 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938911.74452, 21280f86-03dd-4c76-a5ff-c534416cfe39 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:28:31.744861 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] VM Paused (Lifecycle Event)
May 28 03:28:31.759404 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Took 6.10 seconds to spawn the instance on the hypervisor.
May 28 03:28:31.759570 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:28:32.247118 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:28:32.249028 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779938912.24879, 21280f86-03dd-4c76-a5ff-c534416cfe39 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:28:32.249139 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] VM Resumed (Lifecycle Event)
May 28 03:28:32.267481 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Took 11.27 seconds to build instance.
May 28 03:28:32.312469 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fb7a5870-2436-4fd8-be27-248276048575 req-57908985-8048-4368-8a2a-e6b456e97be9 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-vif-plugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:28:32.312643 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb7a5870-2436-4fd8-be27-248276048575 req-57908985-8048-4368-8a2a-e6b456e97be9 service nova] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:32.312806 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb7a5870-2436-4fd8-be27-248276048575 req-57908985-8048-4368-8a2a-e6b456e97be9 service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:32.312956 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-fb7a5870-2436-4fd8-be27-248276048575 req-57908985-8048-4368-8a2a-e6b456e97be9 service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:32.313072 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-fb7a5870-2436-4fd8-be27-248276048575 req-57908985-8048-4368-8a2a-e6b456e97be9 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] No waiting events found dispatching network-vif-plugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:28:32.313251 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-fb7a5870-2436-4fd8-be27-248276048575 req-57908985-8048-4368-8a2a-e6b456e97be9 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received unexpected event network-vif-plugged-1c484d65-fb3c-4479-b3e8-e806c283851a for instance with vm_state active and task_state None.
May 28 03:28:32.539927 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:32.744943 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:32.751587 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:28:32.753877 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-changed-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:28:32.754060 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Refreshing instance network info cache due to event network-changed-1c484d65-fb3c-4479-b3e8-e806c283851a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:28:32.754241 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] Acquiring lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:28:32.754348 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] Acquired lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:28:32.754467 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Refreshing network info cache for port 1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:28:32.760644 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:28:32.769308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-1c8716a1-cff3-4711-8050-f245699fcb02 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.780s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:33.249020 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Triggering sync for uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 28 03:28:33.249378 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:33.249483 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:33.250628 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 15.39 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:28:33.256758 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:28:33.510161 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:28:33.617648 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updated VIF entry in instance network info cache for port 1c484d65-fb3c-4479-b3e8-e806c283851a. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:28:33.617948 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating instance_info_cache with network_info: [{"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:28:33.752706 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.503s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:33.839181 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:34.119805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-634c9747-38a9-4998-b983-62ba23ebbf5f req-e8be8f17-a0c1-48a4-a64e-8cb54d894d14 service nova] Releasing lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:28:37.541511 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:38.841874 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:42.543155 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:43.842031 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:47.545296 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:48.643512 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:48.644267 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.49 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:28:48.843715 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:52.546149 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:53.138243 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:53.641787 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:53.643598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:53.643598 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:53.643598 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:28:53.845626 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:54.662247 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:54.752015 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:54.755308 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:54.838778 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:54.842860 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:28:54.844082 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:28:54.890188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:28:54.890787 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13691MB free_disk=72.58323287963867GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:28:54.891180 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:28:54.891563 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:28:56.002249 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 21280f86-03dd-4c76-a5ff-c534416cfe39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:28:56.002249 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:28:56.002249 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:28:54 up 56 min,  2 users,  load average: 0.77, 1.39, 2.87\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_2ae4c26a96294aac9f0e41aa1f588ec0': '1', 'io_workload': '0'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:28:56.042427 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Refreshing inventories for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 28 03:28:56.081713 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Updating ProviderTree inventory for provider 672703c4-2150-4765-9740-44d3bdb44a8c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 28 03:28:56.082433 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Updating inventory in ProviderTree for provider 672703c4-2150-4765-9740-44d3bdb44a8c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 28 03:28:56.120246 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Refreshing aggregate associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, aggregates: None {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 28 03:28:56.168253 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Refreshing trait associations for resource provider 672703c4-2150-4765-9740-44d3bdb44a8c, traits: COMPUTE_SOUND_MODEL_ICH6,HW_CPU_X86_SSE42,COMPUTE_NODE,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_ARCH_S390X,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ARCH_AARCH64,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_SB16,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_ARCH_RISCV64,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SOUND_MODEL_USB,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_SOUND_MODEL_AC97,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_RESCUE_BFV,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_NET_VIF_MODEL_VIRTIO {{(pid=98297) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 28 03:28:56.246991 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:28:56.246991 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:28:56.751249 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:28:57.254688 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:28:57.254688 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.363s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:28:57.255524 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:28:57.547968 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:58.255596 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:58.256570 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:58.256570 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:58.256939 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:58.257200 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:28:58.257503 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:28:58.847704 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:28:59.138213 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:28:59.138618 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:29:02.549305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:03.849200 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:05.137970 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:29:05.138656 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:29:07.550285 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:08.850523 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:12.551372 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:12.719870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:12.720738 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:13.223741 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:29:13.851262 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:14.228028 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.507s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:15.314284 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:15.314644 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:15.314644 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attaching volume ec3f7e83-084f-4c04-a618-b5d6103005a2 to /dev/vdb
May 28 03:29:15.348354 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:29:15.357886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:29:15.376271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:15.420810 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:29:15.421113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:29:15.429521 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:29:15.430425 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feaf:79fe', 'fe80::dc29:e5ff:fec2:3a61'] 
May 28 03:29:15.430565 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:29:15.430703 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:29:15.431003 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:29:15.431293 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating existing volume attachment record: c2177502-bcac-43ec-b329-85c934c873f0 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:29:15.975355 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:29:15.975692 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3f7e83-084f-4c04-a618-b5d6103005a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:29:15.975833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:15.976277 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:15.976453 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3f7e83-084f-4c04-a618-b5d6103005a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:29:15.987148 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:15.987966 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:15.988447 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:15.988641 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:29:15.989360 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:15.989360 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:29:15.998237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:29:15.998237 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:16.002356 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:29:16.002356 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:16.008974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2] added
May 28 03:29:16.008974 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:29:16.008974 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:16.008974 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:16.008974 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:16.008974 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:16.008974 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:16.009161 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:29:16.009483 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0207(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:29:16.009788 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:29:16.012932 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2] added
May 28 03:29:16.012932 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:29:16.012932 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:16.012932 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:16.012932 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:16.012932 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:16.012932 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:16.013108 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:29:16.013187 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0239(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:29:16.013331 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:29:17.010158 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:29:17.013750 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:29:17.020823 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:29:17.020823 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:29:17.026237 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:29:17.026237 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:17.031632 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:17.036099 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:17.041321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:29:17.041321 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:17.041472 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:29:17.041472 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:17.041599 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:29:17.041599 np0000001589 nova-compute[98297]: 
May 28 03:29:17.045582 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:29:17.045582 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:17.045717 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:29:17.045717 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:17.045771 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:29:17.045771 np0000001589 nova-compute[98297]: 
May 28 03:29:17.552815 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:18.070364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.40.100,3260]
May 28 03:29:18.070364 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.40.100,3260] successful.
May 28 03:29:18.070364 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:18.070977 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.50.100,3260]
May 28 03:29:18.070977 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.50.100,3260] successful.
May 28 03:29:18.070977 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:18.081013 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:18.085238 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:18.092077 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.092077 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.092077 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:18.092205 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.092205 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.092205 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:18.092520 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.103s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:18.092636 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:29:18.093104 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('8', '-', '-', 0) found on session 228 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:29:18.093202 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:29:18.097200 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.097200 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.097200 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:18.097346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.097346 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:18.097346 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:18.097600 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.109s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:18.097701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:29:18.098145 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('7', '-', '-', 0) found on session 227 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:29:18.098258 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:29:18.106162 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 228 and hctl ['8', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:18.111475 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 227 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:18.111475 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3f7e83-084f-4c04-a618-b5d6103005a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:29:19.106705 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 228 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:19.107203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ec3f7e83-084f-4c04-a618-b5d6103005a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:29:20.002676 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found WWN 3300000002b3b2a79 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:29:20.002912 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.027s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:20.003061 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== connect_volume: return (4027ms) {'type': 'block', 'scsi_wwn': '3300000002b3b2a79', 'path': '/dev/dm-0', 'multipath_id': '3300000002b3b2a79'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:29:20.003181 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002b3b2a79', 'path': '/dev/dm-0', 'multipath_id': '3300000002b3b2a79'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:29:20.005867 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:29:20.509607 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attempting to attach volume ec3f7e83-084f-4c04-a618-b5d6103005a2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:29:20.511079 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:29:20.511079 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:29:20.511079 np0000001589 nova-compute[98297]:   <alias name="ua-ec3f7e83-084f-4c04-a618-b5d6103005a2"/>
May 28 03:29:20.511079 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:29:20.511079 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:29:20.511079 np0000001589 nova-compute[98297]:   <serial>ec3f7e83-084f-4c04-a618-b5d6103005a2</serial>
May 28 03:29:20.511079 np0000001589 nova-compute[98297]: </disk>
May 28 03:29:20.511079 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:29:22.145111 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:22.145568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:22.145568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:22.145568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:af:79:fe, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:29:22.553215 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:23.538072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:23.688406 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-bc9ad744-43f2-4e61-9f82-0c93962eaa12 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.374s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:23.689326 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.151s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:24.192372 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:29:25.197029 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:26.118144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:26.118346 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:26.118537 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attaching volume 35e22727-b673-4cba-9832-4b5497b0beca to /dev/vdc
May 28 03:29:26.149618 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:29:26.160097 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:29:26.179344 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:26.222295 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:29:26.222690 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:29:26.230602 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:29:26.231459 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feaf:79fe', 'fe80::dc29:e5ff:fec2:3a61'] 
May 28 03:29:26.231586 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:29:26.231706 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:29:26.231948 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:29:26.232177 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating existing volume attachment record: 002405b3-995f-40fc-b52c-678c15af44f8 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:29:26.798296 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '21280f86-03dd-4c76-a5ff-c534416cfe39', 'attached_at': '', 'detached_at': '', 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'serial': '35e22727-b673-4cba-9832-4b5497b0beca'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:29:26.801146 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:29:26.801500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:29:26.801610 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:26.802017 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:26.802182 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:29:26.814130 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:26.814688 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:26.815087 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:26.815325 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:29:26.815605 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:26.815752 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:29:26.826146 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:29:26.826146 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:26.830368 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:29:26.830368 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:26.837722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca] added
May 28 03:29:26.837722 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:29:26.837722 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:26.837722 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:26.837722 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:26.837722 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:26.837722 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:26.838059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:29:26.838201 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0228(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:29:26.838510 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:29:26.841867 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca] added
May 28 03:29:26.841867 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:29:26.841867 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:26.841867 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:26.841867 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:26.841867 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:26.841867 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:26.842093 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:29:26.842093 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:29:26.842242 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:29:27.554516 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:27.838971 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:29:27.842537 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:29:27.850535 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:29:27.850535 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:29:27.855324 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:29:27.855324 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.861760 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.866155 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.874798 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.874798 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.874798 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:27.874932 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.874932 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.874932 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:27.881773 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.881773 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.881773 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:27.881974 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.881974 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.881974 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:27.906418 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.40.100,3260]
May 28 03:29:27.906418 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.40.100,3260] successful.
May 28 03:29:27.906418 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.911580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.50.100,3260]
May 28 03:29:27.911580 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.50.100,3260] successful.
May 28 03:29:27.911580 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.917917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.923399 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:27.931346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.931346 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.931346 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.931346 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.931346 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:27.931546 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.931546 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.931546 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.931546 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.931546 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:27.931728 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.117s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:27.931794 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:29:27.932400 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('9', '-', '-', 0) found on session 229 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:29:27.932495 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:29:27.937113 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.937113 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.937113 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.937113 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.937113 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:27.937312 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.937312 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:27.937312 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.937312 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:27.937312 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:27.937577 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.122s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:27.937729 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:29:27.938321 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('10', '-', '-', 0) found on session 230 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:29:27.938464 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:29:27.947185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 229 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:27.947185 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:29:27.953668 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 230 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:27.953668 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:29:28.815853 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:29:29.829936 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found WWN 3300000009dd28eae for multipath device dm-1 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:29:29.830397 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:29.830991 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '3300000009dd28eae', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000009dd28eae'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:29:29.831126 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009dd28eae', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '3300000009dd28eae'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:29:29.833161 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:29:29.833392 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:29:29.833530 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:29:29.851405 np0000001589 nova-compute[98297]: WARNING os_brick.encryptors.luks [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 28 03:29:29.851653 np0000001589 nova-compute[98297]: WARNING stevedore.named [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 28 03:29:29.851791 np0000001589 nova-compute[98297]: WARNING castellan.key_manager [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:29:29.851919 np0000001589 nova-compute[98297]: WARNING nova.keymgr.conf_key_mgr [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 28 03:29:29.852328 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7e4b4055e1b0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '21280f86-03dd-4c76-a5ff-c534416cfe39', 'attached_at': '', 'detached_at': '', 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'serial': '35e22727-b673-4cba-9832-4b5497b0beca'} {{(pid=98297) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 28 03:29:29.852436 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors.luks [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98297) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 28 03:29:32.555574 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:33.633892 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Secret XML: <secret ephemeral="no" private="no">
May 28 03:29:33.633892 np0000001589 nova-compute[98297]:   <usage type="volume">
May 28 03:29:33.633892 np0000001589 nova-compute[98297]:     <volume>35e22727-b673-4cba-9832-4b5497b0beca</volume>
May 28 03:29:33.633892 np0000001589 nova-compute[98297]:   </usage>
May 28 03:29:33.633892 np0000001589 nova-compute[98297]: </secret>
May 28 03:29:33.633892 np0000001589 nova-compute[98297]:  {{(pid=98297) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 28 03:29:33.639014 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:29:34.142478 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attempting to attach volume 35e22727-b673-4cba-9832-4b5497b0beca with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:29:34.143797 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:   <alias name="ua-35e22727-b673-4cba-9832-4b5497b0beca"/>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:   <serial>35e22727-b673-4cba-9832-4b5497b0beca</serial>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="ac77f2c0-7684-4fc1-98b1-64cb6e871bc2"/>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]: </disk>
May 28 03:29:34.143797 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:29:36.800946 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:36.801367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:36.801367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:36.801367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:36.801367 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:af:79:fe, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:29:37.556165 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:38.340761 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-882ca787-d9c7-4369-b507-5d8838e329ed tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.222s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:38.855263 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:38.975058 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:38.975260 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:39.478985 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:29:40.484000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:41.559974 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:41.560414 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:41.560925 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attaching volume d7414add-39f0-4a2d-9339-a9f1868401d3 to /dev/vdd
May 28 03:29:41.592922 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:29:41.603137 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:29:41.623726 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:41.667951 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:29:41.668204 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:29:41.676457 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:29:41.677300 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feaf:79fe', 'fe80::dc29:e5ff:fec2:3a61'] 
May 28 03:29:41.677407 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:29:41.677500 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:29:41.677705 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:29:41.677939 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating existing volume attachment record: d08e9820-1696-414d-8d03-c7fd8286a6a6 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:29:42.220599 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:29:42.220917 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:29:42.221119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:42.221563 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:42.221751 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:29:42.233128 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:42.233640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:42.233840 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:29:42.234281 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:29:42.234770 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:29:42.234992 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:29:42.244214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:29:42.244214 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:42.248277 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:29:42.248277 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:42.255412 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3] added
May 28 03:29:42.255412 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:29:42.255412 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:42.255412 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:42.255412 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:42.255412 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:42.255412 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:42.255606 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:29:42.255832 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0219(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:29:42.255894 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:29:42.259357 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3] added
May 28 03:29:42.259357 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:29:42.259357 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:42.259357 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:42.259357 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:29:42.259357 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:29:42.259357 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:42.259519 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:29:42.259636 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:29:42.259758 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:29:42.557354 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:43.256337 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:29:43.260187 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:29:43.268307 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:29:43.268307 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:29:43.273435 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:29:43.273435 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.278951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.283777 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.290702 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.290702 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.290702 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.290702 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.290702 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:43.290889 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.290889 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.290889 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.290889 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.290889 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:43.296300 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.296300 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.296300 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.296300 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.296300 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:43.296410 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.296410 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.296410 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.296410 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.296410 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:43.324119 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.40.100,3260]
May 28 03:29:43.324119 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.40.100,3260] successful.
May 28 03:29:43.324119 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.334298 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.50.100,3260]
May 28 03:29:43.334298 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.50.100,3260] successful.
May 28 03:29:43.334298 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.334875 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.346082 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:29:43.350741 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.350741 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.350741 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.350741 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.350741 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.350741 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.350741 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:43.350951 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.350951 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.350951 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.350951 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.350951 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.350951 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.350951 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:43.351098 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.118s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:43.351243 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:29:43.351885 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('11', '-', '-', 0) found on session 231 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:29:43.351989 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:29:43.359743 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.359743 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.359743 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.359743 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.359743 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.359743 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.359743 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:29:43.360015 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.360015 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:29:43.360015 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.360015 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:29:43.360015 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.360015 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:29:43.360015 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:29:43.360511 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.126s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:43.360754 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:29:43.362695 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('12', '-', '-', 0) found on session 232 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:29:43.362695 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:29:43.362992 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 231 and hctl ['11', '*', '*', 0] yield: None {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:43.375376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 232 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:43.375376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:29:43.857150 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:44.363722 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 231 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:29:44.364106 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:29:45.249153 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found WWN 33000000003a36a17 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:29:45.249475 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:29:45.249673 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '33000000003a36a17', 'path': '/dev/dm-2', 'multipath_id': '33000000003a36a17'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:29:45.249842 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000003a36a17', 'path': '/dev/dm-2', 'multipath_id': '33000000003a36a17'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:29:45.252525 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:29:45.756290 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attempting to attach volume d7414add-39f0-4a2d-9339-a9f1868401d3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:29:45.757764 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:29:45.757764 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:29:45.757764 np0000001589 nova-compute[98297]:   <alias name="ua-d7414add-39f0-4a2d-9339-a9f1868401d3"/>
May 28 03:29:45.757764 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:29:45.757764 np0000001589 nova-compute[98297]:   <target dev="vdd" bus="virtio"/>
May 28 03:29:45.757764 np0000001589 nova-compute[98297]:   <serial>d7414add-39f0-4a2d-9339-a9f1868401d3</serial>
May 28 03:29:45.757764 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:29:45.757764 np0000001589 nova-compute[98297]: </disk>
May 28 03:29:45.757764 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:29:47.385288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:47.385288 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:47.385780 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:47.385780 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:47.385780 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:29:47.385780 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:af:79:fe, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:29:47.558271 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:48.857288 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:48.924925 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fbcd71f8-6142-40ec-98b9-42a4245b46a8 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.365s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:49.137815 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:29:49.138309 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:29:51.189481 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:51.189834 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:51.691252 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:29:51.789015 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:29:52.232123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:52.232397 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:52.235118 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:29:52.235250 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Claim successful on node np0000001589
May 28 03:29:52.559899 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:53.137804 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:29:53.354946 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:29:53.355244 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:29:53.641592 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:53.857550 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:29:53.861648 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:54.364042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.132s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:54.364607 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.723s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:54.364826 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:29:54.366870 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:54.367073 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:29:54.870048 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:29:54.870510 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:29:54.871081 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:29:54.871525 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:29:54.942513 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b072fd3968240558761e1092daeadbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae4c26a96294aac9f0e41aa1f588ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:29:55.221631 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:55.370746 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:29:55.375669 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Successfully created port: 72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:29:55.384652 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:55.473829 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:55.474253 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:55.562806 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:55.563299 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:29:55.563420 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:29:55.563479 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-2 (vdd) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:29:55.567794 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:29:55.568846 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:55.614427 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:55.614936 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13672MB free_disk=72.57920455932617GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:29:55.615149 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:55.615536 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:55.794661 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Successfully updated port: 72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:29:55.838305 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-changed-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:29:55.839188 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Refreshing instance network info cache due to event network-changed-72c27193-48fd-4ea4-bb00-717282894cff. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:29:55.839188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] Acquiring lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:29:55.839188 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] Acquired lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:29:55.839188 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Refreshing network info cache for port 72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:29:55.873539 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:29:56.296646 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:29:56.341518 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:29:56.395290 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:29:56.516740 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:29:56.666063 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 21280f86-03dd-4c76-a5ff-c534416cfe39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:29:56.666198 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 472ca025-33f3-46ec-a975-4c28abdf3b7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:29:56.666376 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:29:56.666509 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:29:55 up 57 min,  2 users,  load average: 0.72, 1.24, 2.73\n', 'num_instances': '2', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_2ae4c26a96294aac9f0e41aa1f588ec0': '2', 'io_workload': '1', 'num_vm_building': '1', 'num_task_networking': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:29:56.782659 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:29:56.782927 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:29:56.882071 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:29:56.883070 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:29:56.883318 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Creating image(s)
May 28 03:29:56.883973 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "/opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:56.884135 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "/opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:56.884697 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "/opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:56.885221 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:29:56.887666 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:29:56.888658 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:56.971368 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:56.971795 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:56.972271 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:56.972668 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:29:56.975033 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:29:56.975337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:57.019409 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-42f727f9-15cc-4b62-8ea1-344180bb794d req-3e3f5664-d652-45fb-8b2b-9123dccc1412 service nova] Releasing lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:29:57.020310 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquired lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:29:57.020542 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:29:57.059144 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:57.059534 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:57.110761 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk 1073741824" returned: 0 in 0.051s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:57.111240 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.139s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:57.111552 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:57.199246 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:57.199653 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:29:57.199938 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:29:57.282839 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:29:57.283236 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Cannot resize image /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:29:57.283829 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:29:57.284010 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Ensure instance console log exists: /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:29:57.284282 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:57.284495 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:57.284612 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:57.286115 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:29:57.560111 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:57.575534 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:29:57.697388 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:29:57.792751 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:29:57.792932 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.177s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:57.793377 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:29:57.802441 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Updating instance_info_cache with network_info: [{"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:29:58.304095 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Releasing lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:29:58.304384 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Instance network_info: |[{"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:29:58.306251 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Start _get_guest_xml network_info=[{"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:29:58.310351 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:29:58.311568 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-2078370995', uuid='472ca025-33f3-46ec-a975-4c28abdf3b7e'), owner=OwnerMeta(userid='5b072fd3968240558761e1092daeadbf', username='tempest-VolumeMultiattachTests-1834139013-project-member', projectid='2ae4c26a96294aac9f0e41aa1f588ec0', projectname='tempest-VolumeMultiattachTests-1834139013'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779938998.3111947) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:29:58.312568 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:29:58.312866 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:29:58.313660 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:29:58.313826 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:29:58.314900 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:29:58.315221 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:29:58.315379 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:29:58.315464 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:29:58.315574 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:29:58.315650 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:29:58.315738 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:29:58.315892 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:29:58.315984 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:29:58.316079 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:29:58.316212 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:29:58.316363 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:29:58.327008 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2078370995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-2078370995',id=81,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM24eDE9sS5vvA85LYIkaJte3O7AFfswDzhDm546D+D7IttHOOMEVSSGB01TkUZrHZawL0jpOPsR67vY2YQl6dqa0FDurgG/PeoJTjLOIk7WSXI+drc1rwsOTcvWZaZhRA==',key_name='tempest-keypair-935238549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-ck82oswz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=472ca025-33f3-46ec-a975-4c28abdf3b7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:29:58.327215 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:29:58.327746 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:84:3e,bridge_name='br-int',has_traffic_filtering=True,id=72c27193-48fd-4ea4-bb00-717282894cff,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c27193-48') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:29:58.328655 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'pci_devices' on Instance uuid 472ca025-33f3-46ec-a975-4c28abdf3b7e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:29:58.831026 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] End _get_guest_xml xml=<domain type="qemu">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <uuid>472ca025-33f3-46ec-a975-4c28abdf3b7e</uuid>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <name>instance-00000051</name>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumeMultiattachTests-server-2078370995</nova:name>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:29:58</nova:creationTime>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:user uuid="5b072fd3968240558761e1092daeadbf">tempest-VolumeMultiattachTests-1834139013-project-member</nova:user>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:project uuid="2ae4c26a96294aac9f0e41aa1f588ec0">tempest-VolumeMultiattachTests-1834139013</nova:project>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         <nova:port uuid="72c27193-48fd-4ea4-bb00-717282894cff">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <system>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <entry name="serial">472ca025-33f3-46ec-a975-4c28abdf3b7e</entry>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <entry name="uuid">472ca025-33f3-46ec-a975-4c28abdf3b7e</entry>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </system>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <os>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   </os>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <features>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   </features>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   <devices>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </disk>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk.config"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </disk>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:60:84:3e"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <target dev="tap72c27193-48"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </interface>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/console.log" append="off"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </serial>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <video>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </video>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </rng>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:   </devices>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]: </domain>
May 28 03:29:58.831026 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:29:58.833162 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Preparing to wait for external event network-vif-plugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:29:58.833162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:29:58.833162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:29:58.833162 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:29:58.833162 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2078370995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-2078370995',id=81,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM24eDE9sS5vvA85LYIkaJte3O7AFfswDzhDm546D+D7IttHOOMEVSSGB01TkUZrHZawL0jpOPsR67vY2YQl6dqa0FDurgG/PeoJTjLOIk7WSXI+drc1rwsOTcvWZaZhRA==',key_name='tempest-keypair-935238549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-ck82oswz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:29:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=472ca025-33f3-46ec-a975-4c28abdf3b7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:29:58.833162 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:29:58.833406 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:84:3e,bridge_name='br-int',has_traffic_filtering=True,id=72c27193-48fd-4ea4-bb00-717282894cff,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c27193-48') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:29:58.833574 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:84:3e,bridge_name='br-int',has_traffic_filtering=True,id=72c27193-48fd-4ea4-bb00-717282894cff,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c27193-48') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:29:58.834045 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:58.834357 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:29:58.834643 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:29:58.835300 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:58.835457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56416d79-7621-5f77-a950-000f232dd569', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:29:58.836466 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:58.837695 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:29:58.839065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:58.839191 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72c27193-48, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:29:58.839495 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72c27193-48, col_values=(('qos', UUID('88e2fcc5-f179-484c-b8bc-4f1f82c2c514')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:29:58.839646 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72c27193-48, col_values=(('external_ids', {'iface-id': '72c27193-48fd-4ea4-bb00-717282894cff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:84:3e', 'vm-uuid': '472ca025-33f3-46ec-a975-4c28abdf3b7e'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:29:58.841475 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:29:58.844933 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:29:58.845646 np0000001589 nova-compute[98297]: INFO os_vif [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:84:3e,bridge_name='br-int',has_traffic_filtering=True,id=72c27193-48fd-4ea4-bb00-717282894cff,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c27193-48')
May 28 03:29:59.793397 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:29:59.793765 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:29:59.794053 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:29:59.794395 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:29:59.794616 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:29:59.794915 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.34 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:30:00.138244 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:30:00.138834 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:30:00.139115 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:30:00.360074 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:30:00.360219 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:30:00.360343 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:60:84:3e, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:30:00.360722 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Using config drive
May 28 03:30:00.865853 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:30:00.966815 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Creating config drive at /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk.config
May 28 03:30:00.970429 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprrjbzkga {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:30:01.023985 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprrjbzkga" returned: 0 in 0.053s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:30:01.408118 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:01.422885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:01.424577 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:01.519515 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:01.541484 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b1b729d7-c543-4fe0-bbca-1a7271573279 req-a1bf2d10-5f5b-4e79-9065-76f194d9809d service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-vif-plugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:30:01.541758 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b1b729d7-c543-4fe0-bbca-1a7271573279 req-a1bf2d10-5f5b-4e79-9065-76f194d9809d service nova] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:01.541993 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b1b729d7-c543-4fe0-bbca-1a7271573279 req-a1bf2d10-5f5b-4e79-9065-76f194d9809d service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:01.542142 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b1b729d7-c543-4fe0-bbca-1a7271573279 req-a1bf2d10-5f5b-4e79-9065-76f194d9809d service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:01.542311 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b1b729d7-c543-4fe0-bbca-1a7271573279 req-a1bf2d10-5f5b-4e79-9065-76f194d9809d service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Processing event network-vif-plugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:30:01.561506 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:01.562308 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:02.087497 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779939002.087084, 472ca025-33f3-46ec-a975-4c28abdf3b7e => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:30:02.087973 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:30:02.088443 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] VM Started (Lifecycle Event)
May 28 03:30:02.090094 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:30:02.094059 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Instance spawned successfully.
May 28 03:30:02.094459 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:30:02.591464 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:30:02.593355 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:30:02.599957 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:30:02.600077 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:30:02.600344 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:30:02.600617 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:30:02.600878 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:30:02.601157 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:30:03.095391 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:30:03.095526 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779939003.0953982, 472ca025-33f3-46ec-a975-4c28abdf3b7e => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:30:03.095653 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] VM Paused (Lifecycle Event)
May 28 03:30:03.105859 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Took 6.22 seconds to spawn the instance on the hypervisor.
May 28 03:30:03.106498 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:30:03.592180 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-35d7a81a-c163-4e90-b4d1-f7b88c2b2858 req-107077eb-6ebb-4343-b94a-25789f95ec98 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-vif-plugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:30:03.592714 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-35d7a81a-c163-4e90-b4d1-f7b88c2b2858 req-107077eb-6ebb-4343-b94a-25789f95ec98 service nova] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:03.592780 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-35d7a81a-c163-4e90-b4d1-f7b88c2b2858 req-107077eb-6ebb-4343-b94a-25789f95ec98 service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:03.592908 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-35d7a81a-c163-4e90-b4d1-f7b88c2b2858 req-107077eb-6ebb-4343-b94a-25789f95ec98 service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:03.592992 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-35d7a81a-c163-4e90-b4d1-f7b88c2b2858 req-107077eb-6ebb-4343-b94a-25789f95ec98 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] No waiting events found dispatching network-vif-plugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:30:03.593090 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-35d7a81a-c163-4e90-b4d1-f7b88c2b2858 req-107077eb-6ebb-4343-b94a-25789f95ec98 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received unexpected event network-vif-plugged-72c27193-48fd-4ea4-bb00-717282894cff for instance with vm_state active and task_state None.
May 28 03:30:03.598103 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:30:03.601799 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779939003.601606, 472ca025-33f3-46ec-a975-4c28abdf3b7e => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:30:03.601971 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] VM Resumed (Lifecycle Event)
May 28 03:30:03.616137 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Took 11.42 seconds to build instance.
May 28 03:30:03.842332 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:03.859540 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:03.955052 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-changed-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:30:03.955216 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Refreshing instance network info cache due to event network-changed-1c484d65-fb3c-4479-b3e8-e806c283851a. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:30:03.955442 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] Acquiring lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:30:03.955588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] Acquired lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:30:03.955762 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Refreshing network info cache for port 1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:30:04.105584 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:30:04.107558 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:30:04.117558 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.928s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:04.457979 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:30:04.724811 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:30:04.837394 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updated VIF entry in instance network info cache for port 1c484d65-fb3c-4479-b3e8-e806c283851a. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:30:04.837647 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating instance_info_cache with network_info: [{"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:30:05.340168 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-85876f03-88f8-48fa-84c0-4227a475fecd req-55fcf21f-01b0-438a-815a-1552e20a9eb8 service nova] Releasing lock "refresh_cache-21280f86-03dd-4c76-a5ff-c534416cfe39" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:30:06.006529 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-changed-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:30:06.006889 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Refreshing instance network info cache due to event network-changed-72c27193-48fd-4ea4-bb00-717282894cff. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:30:06.006889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] Acquiring lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:30:06.006889 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] Acquired lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:30:06.007091 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Refreshing network info cache for port 72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:30:06.508908 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:30:06.781291 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:30:06.890951 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Updated VIF entry in instance network info cache for port 72c27193-48fd-4ea4-bb00-717282894cff. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:30:06.891208 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Updating instance_info_cache with network_info: [{"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:30:07.137872 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:30:07.138330 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:30:07.393021 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-a1653d1e-d439-4071-91fe-603327493bbe req-2bfb263f-fcf8-499f-8f06-cbce49ab1787 service nova] Releasing lock "refresh_cache-472ca025-33f3-46ec-a975-4c28abdf3b7e" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:30:08.844590 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:08.861664 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:13.847079 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:13.864052 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:18.849471 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:18.864470 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:23.852063 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:23.865486 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:28.855311 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:28.866737 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:33.857772 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:33.867308 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:38.858366 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:40.594904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:40.594904 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:41.098278 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 472ca025-33f3-46ec-a975-4c28abdf3b7e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:30:42.102203 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:43.166392 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:43.166765 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:43.166765 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Attaching volume d7414add-39f0-4a2d-9339-a9f1868401d3 to /dev/vdb
May 28 03:30:43.199698 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:30:43.209981 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:30:43.229626 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:30:43.273243 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:30:43.273543 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:30:43.281241 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:30:43.282171 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:feaf:79fe', 'fe80::dc29:e5ff:fec2:3a61', 'fe80::fc16:3eff:fe60:843e'] 
May 28 03:30:43.282299 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:30:43.282432 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:30:43.282649 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:30:43.282898 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Updating existing volume attachment record: 9cf3351a-0975-4857-8c7a-c77ef3b147d6 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:30:43.830391 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:30:43.830745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:30:43.830922 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:30:43.831382 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:30:43.831576 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:30:43.842572 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:30:43.843203 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:30:43.843633 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:30:43.843860 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:30:43.844308 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:30:43.844517 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:30:43.855245 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:30:43.855245 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:30:43.859740 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.startup = automatic
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.scan = manual
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:30:43.860891 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:30:43.860891 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:30:43.866824 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:30:43.868317 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:43.874695 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:30:43.882523 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.882523 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.882523 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.882523 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.882523 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.882523 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.882523 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:30:43.882833 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.882833 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.882833 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.882833 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.882833 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.882833 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.882833 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:30:43.883066 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.039s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:30:43.883066 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:30:43.883537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('11', '0', '0', 0) found on session 231 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:30:43.883651 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:30:43.888874 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.888874 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.888874 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.888874 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.888874 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.888874 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.888874 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:30:43.889039 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.889039 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:30:43.889039 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.889039 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:30:43.889039 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.889039 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:30:43.889039 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:30:43.889257 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.045s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:30:43.889373 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:30:43.889779 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('12', '0', '0', 0) found on session 232 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:30:43.889881 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:30:43.894285 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 231 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:30:43.894434 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:30:43.897720 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 232 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:30:43.897848 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:30:44.844124 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:30:45.858123 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found WWN 33000000003a36a17 for multipath device dm-2 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:30:45.858548 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.027s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:30:45.858548 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== connect_volume: return (2027ms) {'type': 'block', 'scsi_wwn': '33000000003a36a17', 'path': '/dev/dm-2', 'multipath_id': '33000000003a36a17'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:30:45.858623 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000003a36a17', 'path': '/dev/dm-2', 'multipath_id': '33000000003a36a17'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:30:45.861128 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 472ca025-33f3-46ec-a975-4c28abdf3b7e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:30:46.364245 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Attempting to attach volume d7414add-39f0-4a2d-9339-a9f1868401d3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:30:46.365591 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:30:46.365591 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:30:46.365591 np0000001589 nova-compute[98297]:   <alias name="ua-d7414add-39f0-4a2d-9339-a9f1868401d3"/>
May 28 03:30:46.365591 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:30:46.365591 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:30:46.365591 np0000001589 nova-compute[98297]:   <serial>d7414add-39f0-4a2d-9339-a9f1868401d3</serial>
May 28 03:30:46.365591 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:30:46.365591 np0000001589 nova-compute[98297]: </disk>
May 28 03:30:46.365591 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:30:47.995564 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:30:47.996076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:30:47.996076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:30:47.996076 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:60:84:3e, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:30:48.861400 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:49.137949 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:30:49.138844 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:30:49.565324 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-4c7c76d9-1082-451d-9ee8-fc4dbc2ac771 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.399s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:51.146313 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:51.146752 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:51.648629 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Detaching volume d7414add-39f0-4a2d-9339-a9f1868401d3
May 28 03:30:51.690686 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Attempting to driver detach volume d7414add-39f0-4a2d-9339-a9f1868401d3 from mountpoint /dev/vdb
May 28 03:30:51.694542 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdb by alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:30:51.695743 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdb by alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:30:51.695890 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Attempting to detach device vdb from instance 472ca025-33f3-46ec-a975-4c28abdf3b7e from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:30:51.696114 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:   <alias name="ua-d7414add-39f0-4a2d-9339-a9f1868401d3"/>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:   <serial>d7414add-39f0-4a2d-9339-a9f1868401d3</serial>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]: </disk>
May 28 03:30:51.696114 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:30:51.702259 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdb from instance 472ca025-33f3-46ec-a975-4c28abdf3b7e from the persistent domain config.
May 28 03:30:51.702630 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] (1/8): Attempting to detach device vdb with device alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 from instance 472ca025-33f3-46ec-a975-4c28abdf3b7e from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:30:51.702943 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:   <alias name="ua-d7414add-39f0-4a2d-9339-a9f1868401d3"/>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:   <serial>d7414add-39f0-4a2d-9339-a9f1868401d3</serial>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]: </disk>
May 28 03:30:51.702943 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:30:52.158715 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779939052.1583126, 472ca025-33f3-46ec-a975-4c28abdf3b7e => ua-d7414add-39f0-4a2d-9339-a9f1868401d3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:30:52.159657 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 for instance 472ca025-33f3-46ec-a975-4c28abdf3b7e {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:30:52.161774 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdb from instance 472ca025-33f3-46ec-a975-4c28abdf3b7e from the live domain config.
May 28 03:30:52.692187 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Detected multiple connections on this host for volume: d7414add-39f0-4a2d-9339-a9f1868401d3, skipping target disconnect.
May 28 03:30:53.236981 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 472ca025-33f3-46ec-a975-4c28abdf3b7e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:30:53.863122 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:30:53.869033 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:54.138007 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:30:54.242828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-b25e48cb-77b4-4cdc-be10-a1d9b97e7bda tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.096s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:54.349350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:54.349350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:54.349350 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:54.349588 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:54.349696 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:54.351497 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Terminating instance
May 28 03:30:54.642069 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:54.642211 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:54.642370 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:54.642471 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:30:54.853978 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:30:54.875106 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:54.876457 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:54.886495 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:54.995862 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f722ee03-a406-4d02-b582-d3dbe902bfd7 req-9c50b757-4028-4745-a027-a9c84538e820 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-vif-unplugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:30:54.996123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f722ee03-a406-4d02-b582-d3dbe902bfd7 req-9c50b757-4028-4745-a027-a9c84538e820 service nova] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:54.996256 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f722ee03-a406-4d02-b582-d3dbe902bfd7 req-9c50b757-4028-4745-a027-a9c84538e820 service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:54.996388 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-f722ee03-a406-4d02-b582-d3dbe902bfd7 req-9c50b757-4028-4745-a027-a9c84538e820 service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:54.996505 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f722ee03-a406-4d02-b582-d3dbe902bfd7 req-9c50b757-4028-4745-a027-a9c84538e820 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] No waiting events found dispatching network-vif-unplugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:30:54.996606 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-f722ee03-a406-4d02-b582-d3dbe902bfd7 req-9c50b757-4028-4745-a027-a9c84538e820 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-vif-unplugged-72c27193-48fd-4ea4-bb00-717282894cff for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:30:55.023778 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:55.029305 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:55.162947 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999718715999734 future=<Future at 0x7e4b645cc620 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:30:55.164096 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998674053999821 future=<Future at 0x7e4b645cc620 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:30:55.164096 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.998525406999761 future=<Future at 0x7e4b645cc620 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:30:55.164726 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Instance destroyed successfully.
May 28 03:30:55.165139 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'resources' on Instance uuid 472ca025-33f3-46ec-a975-4c28abdf3b7e {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:30:55.661198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:30:55.674671 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-2078370995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-2078370995',id=81,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM24eDE9sS5vvA85LYIkaJte3O7AFfswDzhDm546D+D7IttHOOMEVSSGB01TkUZrHZawL0jpOPsR67vY2YQl6dqa0FDurgG/PeoJTjLOIk7WSXI+drc1rwsOTcvWZaZhRA==',key_name='tempest-keypair-935238549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:30:03Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-ck82oswz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:30:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=472ca025-33f3-46ec-a975-4c28abdf3b7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:30:55.674905 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "72c27193-48fd-4ea4-bb00-717282894cff", "address": "fa:16:3e:60:84:3e", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap72c27193-48", "ovs_interfaceid": "72c27193-48fd-4ea4-bb00-717282894cff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:30:55.676029 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:84:3e,bridge_name='br-int',has_traffic_filtering=True,id=72c27193-48fd-4ea4-bb00-717282894cff,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c27193-48') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:30:55.676355 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:84:3e,bridge_name='br-int',has_traffic_filtering=True,id=72c27193-48fd-4ea4-bb00-717282894cff,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c27193-48') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:30:55.678854 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:55.679162 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72c27193-48, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:30:55.680705 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:55.681928 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:30:55.682593 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:55.682716 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88e2fcc5-f179-484c-b8bc-4f1f82c2c514) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:30:55.683106 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:55.683585 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:30:55.683783 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:55.685736 np0000001589 nova-compute[98297]: INFO os_vif [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:84:3e,bridge_name='br-int',has_traffic_filtering=True,id=72c27193-48fd-4ea4-bb00-717282894cff,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72c27193-48')
May 28 03:30:55.686131 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Deleting instance files /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e_del
May 28 03:30:55.686933 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Deletion of /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e_del complete
May 28 03:30:55.747123 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:30:55.747511 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:30:55.830242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:30:55.830667 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:30:55.830784 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-1 (vdc) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:30:55.830911 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] skipping disk /dev/dm-2 (vdd) as it is a volume {{(pid=98297) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 28 03:30:55.834977 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000051, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/472ca025-33f3-46ec-a975-4c28abdf3b7e/disk
May 28 03:30:55.836751 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:30:55.837747 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:30:55.883316 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:30:55.883771 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13328MB free_disk=72.54779434204102GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:30:55.883946 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:55.884184 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:56.193365 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Took 1.34 seconds to destroy the instance on the hypervisor.
May 28 03:30:56.194064 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:30:56.194379 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:30:56.194521 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:30:56.194896 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:30:56.279669 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:30:56.593026 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:30:56.664312 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-166615fb-7692-497f-aaec-78f5f05d93be req-32fc8da1-2105-4d42-a8e0-d936efd44bc5 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-vif-deleted-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:30:56.664605 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-166615fb-7692-497f-aaec-78f5f05d93be req-32fc8da1-2105-4d42-a8e0-d936efd44bc5 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Neutron deleted interface 72c27193-48fd-4ea4-bb00-717282894cff; detaching it from the instance and deleting it from the info cache
May 28 03:30:56.666057 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-166615fb-7692-497f-aaec-78f5f05d93be req-32fc8da1-2105-4d42-a8e0-d936efd44bc5 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Detach interface failed, port_id=72c27193-48fd-4ea4-bb00-717282894cff, reason: Instance 472ca025-33f3-46ec-a975-4c28abdf3b7e could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:30:56.932944 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 21280f86-03dd-4c76-a5ff-c534416cfe39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:30:56.933059 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance 472ca025-33f3-46ec-a975-4c28abdf3b7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:30:56.933213 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:30:56.933365 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:30:55 up 58 min,  2 users,  load average: 0.77, 1.17, 2.61\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '1', 'num_os_type_None': '2', 'num_proj_2ae4c26a96294aac9f0e41aa1f588ec0': '2', 'io_workload': '0', 'num_task_deleting': '1'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:30:57.047189 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:30:57.047483 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:30:57.051566 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8595a42-65b7-427b-9259-84977873161c req-da29cbc6-e9d9-4150-a481-e1ebc87c5ec4 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-vif-unplugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:30:57.052200 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b8595a42-65b7-427b-9259-84977873161c req-da29cbc6-e9d9-4150-a481-e1ebc87c5ec4 service nova] Acquiring lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:57.052289 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b8595a42-65b7-427b-9259-84977873161c req-da29cbc6-e9d9-4150-a481-e1ebc87c5ec4 service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:57.052458 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b8595a42-65b7-427b-9259-84977873161c req-da29cbc6-e9d9-4150-a481-e1ebc87c5ec4 service nova] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:57.052644 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8595a42-65b7-427b-9259-84977873161c req-da29cbc6-e9d9-4150-a481-e1ebc87c5ec4 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] No waiting events found dispatching network-vif-unplugged-72c27193-48fd-4ea4-bb00-717282894cff {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:30:57.052828 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b8595a42-65b7-427b-9259-84977873161c req-da29cbc6-e9d9-4150-a481-e1ebc87c5ec4 service nova] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Received event network-vif-unplugged-72c27193-48fd-4ea4-bb00-717282894cff for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:30:57.121590 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:30:57.550579 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:30:57.623180 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Took 1.43 seconds to deallocate network for instance.
May 28 03:30:58.057029 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:30:58.057499 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.173s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:58.057499 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:30:58.128490 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:30:58.128796 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:30:58.245327 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:30:58.245540 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:30:58.747946 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:30:59.255264 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.126s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:30:59.296019 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Deleted allocations for instance 472ca025-33f3-46ec-a975-4c28abdf3b7e
May 28 03:31:00.057247 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:00.057461 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:00.057653 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:00.057770 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:31:00.058034 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.08 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:31:00.303428 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-6d645b57-b14a-4c73-8bbd-320938c88cd0 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "472ca025-33f3-46ec-a975-4c28abdf3b7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.954s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:00.683892 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:01.137955 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:01.138247 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:31:01.317101 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:01.317649 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:01.819614 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Detaching volume d7414add-39f0-4a2d-9339-a9f1868401d3
May 28 03:31:01.853156 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attempting to driver detach volume d7414add-39f0-4a2d-9339-a9f1868401d3 from mountpoint /dev/vdd
May 28 03:31:01.857144 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdd by alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:31:01.858152 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdd by alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:31:01.858269 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Attempting to detach device vdd from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:31:01.858510 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:   <alias name="ua-d7414add-39f0-4a2d-9339-a9f1868401d3"/>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:   <target dev="vdd" bus="virtio"/>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:   <serial>d7414add-39f0-4a2d-9339-a9f1868401d3</serial>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]: </disk>
May 28 03:31:01.858510 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:31:01.863968 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdd from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the persistent domain config.
May 28 03:31:01.864122 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] (1/8): Attempting to detach device vdd with device alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:31:01.864336 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:   <alias name="ua-d7414add-39f0-4a2d-9339-a9f1868401d3"/>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-2"/>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:   <target dev="vdd" bus="virtio"/>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:   <serial>d7414add-39f0-4a2d-9339-a9f1868401d3</serial>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]: </disk>
May 28 03:31:01.864336 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:31:02.138126 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:02.138445 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 7.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:31:02.299346 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779939062.298958, 21280f86-03dd-4c76-a5ff-c534416cfe39 => ua-d7414add-39f0-4a2d-9339-a9f1868401d3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:31:02.300287 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-d7414add-39f0-4a2d-9339-a9f1868401d3 for instance 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:31:02.302421 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdd from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the live domain config.
May 28 03:31:02.327934 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:31:02.328265 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:31:02.328344 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:31:02.328643 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:31:02.328906 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd7414add-39f0-4a2d-9339-a9f1868401d3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:31:02.329036 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:31:02.357000 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:02.357000 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:02.357000 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:02.357000 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:02.357000 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:31:02.357000 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:31:02.357000 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:31:02.357222 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:02.357222 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:02.357222 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:02.357222 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:02.357222 np0000001589 nova-compute[98297]: tcp: [231] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:31:02.357222 np0000001589 nova-compute[98297]: tcp: [232] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3 (non-flash)
May 28 03:31:02.357222 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:31:02.357398 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', '230'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', '231'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', '232')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:31:02.357460 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', '231')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:31:02.358259 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3', '232')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:31:02.358894 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40533880>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'): ({'sdg'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:31:02.359063 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Removing multipathed devices sdf, sdg {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:31:02.359244 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flush multipath device 33000000003a36a17 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:31:02.387179 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:31:02.425479 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:31:02.467579 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:31:02.467812 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:31:02.468724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:31:02.479055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:31:02.479315 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:31:02.490886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:02.517936 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 231, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.40.100,3260]
May 28 03:31:02.517936 np0000001589 nova-compute[98297]: Logout of [sid: 231, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.40.100,3260] successful.
May 28 03:31:02.517936 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:02.531994 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:02.543637 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:02.585252 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 232, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.50.100,3260]
May 28 03:31:02.585252 np0000001589 nova-compute[98297]: Logout of [sid: 232, target: iqn.2023-03.storpool.com:os--volume-d7414add-39f0-4a2d-9339-a9f1868401d3, portal: 192.168.50.100,3260] successful.
May 28 03:31:02.585252 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:02.599913 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:02.600178 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:31:02.600364 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== disconnect_volume: return (271ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:31:02.600474 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:31:03.140985 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:31:04.147269 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-c7ee2654-c92a-4bd9-856d-011434f9f1f3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.830s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:04.555294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:04.555498 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:05.057714 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Detaching volume 35e22727-b673-4cba-9832-4b5497b0beca
May 28 03:31:05.089799 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attempting to driver detach volume 35e22727-b673-4cba-9832-4b5497b0beca from mountpoint /dev/vdc
May 28 03:31:05.115159 np0000001589 nova-compute[98297]: DEBUG os_brick.encryptors [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '21280f86-03dd-4c76-a5ff-c534416cfe39', 'attached_at': '', 'detached_at': '', 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'serial': '35e22727-b673-4cba-9832-4b5497b0beca'} {{(pid=98297) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 28 03:31:05.118784 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdc by alias ua-35e22727-b673-4cba-9832-4b5497b0beca {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:31:05.119924 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdc by alias ua-35e22727-b673-4cba-9832-4b5497b0beca {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:31:05.120027 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Attempting to detach device vdc from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:31:05.120242 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   <alias name="ua-35e22727-b673-4cba-9832-4b5497b0beca"/>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   <serial>35e22727-b673-4cba-9832-4b5497b0beca</serial>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="ac77f2c0-7684-4fc1-98b1-64cb6e871bc2"/>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]: </disk>
May 28 03:31:05.120242 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:31:05.125066 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdc from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the persistent domain config.
May 28 03:31:05.125173 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] (1/8): Attempting to detach device vdc with device alias ua-35e22727-b673-4cba-9832-4b5497b0beca from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:31:05.125404 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   <alias name="ua-35e22727-b673-4cba-9832-4b5497b0beca"/>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   <target dev="vdc" bus="virtio"/>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   <serial>35e22727-b673-4cba-9832-4b5497b0beca</serial>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   <encryption format="luks">
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:     <secret type="passphrase" uuid="ac77f2c0-7684-4fc1-98b1-64cb6e871bc2"/>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:   </encryption>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]: </disk>
May 28 03:31:05.125404 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:31:05.564308 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779939065.563983, 21280f86-03dd-4c76-a5ff-c534416cfe39 => ua-35e22727-b673-4cba-9832-4b5497b0beca> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:31:05.565443 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-35e22727-b673-4cba-9832-4b5497b0beca for instance 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:31:05.567582 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdc from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the live domain config.
May 28 03:31:05.569612 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:31:05.569914 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:31:05.570043 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:31:05.570377 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:31:05.570656 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '35e22727-b673-4cba-9832-4b5497b0beca', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:31:05.570776 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:31:05.592954 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:05.592954 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:05.592954 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:05.592954 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:05.592954 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:31:05.593156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:05.593156 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:05.593156 np0000001589 nova-compute[98297]: tcp: [229] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:05.593156 np0000001589 nova-compute[98297]: tcp: [230] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca (non-flash)
May 28 03:31:05.593156 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:31:05.593295 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '228'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', '229'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', '230')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:31:05.593365 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', '229')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:31:05.594146 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca', '230')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:31:05.594829 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40675440>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'): ({'sde'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:31:05.595010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Removing multipathed devices sde, sdd {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:31:05.595214 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flush multipath device 3300000009dd28eae {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:31:05.622686 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:31:05.662575 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:31:05.685460 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:05.702536 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:31:05.702691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:31:05.703316 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:31:05.713554 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:31:05.713704 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:31:05.723358 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:05.752850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 229, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.40.100,3260]
May 28 03:31:05.752850 np0000001589 nova-compute[98297]: Logout of [sid: 229, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.40.100,3260] successful.
May 28 03:31:05.752850 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:05.764791 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:05.774346 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:05.798976 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 230, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.50.100,3260]
May 28 03:31:05.798976 np0000001589 nova-compute[98297]: Logout of [sid: 230, target: iqn.2023-03.storpool.com:os--volume-35e22727-b673-4cba-9832-4b5497b0beca, portal: 192.168.50.100,3260] successful.
May 28 03:31:05.798976 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:05.810733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:05.811491 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.241s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:31:05.811597 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== disconnect_volume: return (241ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:31:05.811696 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:31:06.351555 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:31:07.357126 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-d537130e-f36a-4138-b280-99c5d894d13e tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.801s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:07.822789 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:07.822929 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:08.325163 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Detaching volume ec3f7e83-084f-4c04-a618-b5d6103005a2
May 28 03:31:08.358111 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Attempting to driver detach volume ec3f7e83-084f-4c04-a618-b5d6103005a2 from mountpoint /dev/vdb
May 28 03:31:08.362378 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdb by alias ua-ec3f7e83-084f-4c04-a618-b5d6103005a2 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:31:08.363438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdb by alias ua-ec3f7e83-084f-4c04-a618-b5d6103005a2 {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:31:08.363534 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Attempting to detach device vdb from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:31:08.363715 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:31:08.363715 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:31:08.363715 np0000001589 nova-compute[98297]:   <alias name="ua-ec3f7e83-084f-4c04-a618-b5d6103005a2"/>
May 28 03:31:08.363715 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:31:08.363715 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:31:08.363715 np0000001589 nova-compute[98297]:   <serial>ec3f7e83-084f-4c04-a618-b5d6103005a2</serial>
May 28 03:31:08.363715 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:31:08.363715 np0000001589 nova-compute[98297]: </disk>
May 28 03:31:08.363715 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:31:08.368411 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdb from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the persistent domain config.
May 28 03:31:08.368517 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] (1/8): Attempting to detach device vdb with device alias ua-ec3f7e83-084f-4c04-a618-b5d6103005a2 from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:31:08.368705 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:31:08.368705 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:31:08.368705 np0000001589 nova-compute[98297]:   <alias name="ua-ec3f7e83-084f-4c04-a618-b5d6103005a2"/>
May 28 03:31:08.368705 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:31:08.368705 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:31:08.368705 np0000001589 nova-compute[98297]:   <serial>ec3f7e83-084f-4c04-a618-b5d6103005a2</serial>
May 28 03:31:08.368705 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:31:08.368705 np0000001589 nova-compute[98297]: </disk>
May 28 03:31:08.368705 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:31:08.792946 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779939068.7925653, 21280f86-03dd-4c76-a5ff-c534416cfe39 => ua-ec3f7e83-084f-4c04-a618-b5d6103005a2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:31:08.794009 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-ec3f7e83-084f-4c04-a618-b5d6103005a2 for instance 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:31:08.795927 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdb from instance 21280f86-03dd-4c76-a5ff-c534416cfe39 from the live domain config.
May 28 03:31:08.796928 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:31:08.797183 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3f7e83-084f-4c04-a618-b5d6103005a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:31:08.797334 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:31:08.797614 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:31:08.797908 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ec3f7e83-084f-4c04-a618-b5d6103005a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:31:08.798041 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:31:08.820767 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:08.820767 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:08.820767 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:31:08.820877 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:08.820877 np0000001589 nova-compute[98297]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2 (non-flash)
May 28 03:31:08.820877 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:31:08.820984 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '228')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:31:08.821078 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '227')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:31:08.821733 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2', '228')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:31:08.822309 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b646bb9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:31:08.822469 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:31:08.822640 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flush multipath device 3300000002b3b2a79 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:31:08.855744 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:31:08.907724 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:31:08.942675 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:31:08.942850 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:31:08.943430 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:31:08.953537 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:31:08.953791 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:31:08.963858 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:09.002878 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.40.100,3260]
May 28 03:31:09.002878 np0000001589 nova-compute[98297]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.40.100,3260] successful.
May 28 03:31:09.002878 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:09.013588 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:09.023245 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:09.045756 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.50.100,3260]
May 28 03:31:09.045756 np0000001589 nova-compute[98297]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-ec3f7e83-084f-4c04-a618-b5d6103005a2, portal: 192.168.50.100,3260] successful.
May 28 03:31:09.045756 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:09.054886 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:31:09.055079 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:31:09.055188 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== disconnect_volume: return (257ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:31:09.055314 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:31:09.137793 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:09.138129 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:31:09.592786 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:31:10.163010 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.00032289299997501075 future=<Future at 0x7e4b645cc620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:31:10.163376 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Emitting event <LifecycleEvent: 1779939055.1625752, 472ca025-33f3-46ec-a975-4c28abdf3b7e => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:31:10.163500 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:31:10.163613 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] VM Stopped (Lifecycle Event)
May 28 03:31:10.598149 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-fe249fa4-18b5-4556-b71b-f9c2f1b29066 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.775s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:10.665819 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-e26b1eef-bbbd-413b-8bbf-cefd35e54779 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 472ca025-33f3-46ec-a975-4c28abdf3b7e] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:31:10.686502 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:14.349203 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:14.349751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:14.349751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:14.349751 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:14.349923 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:14.351750 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Terminating instance
May 28 03:31:14.854460 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:31:14.867456 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:14.868733 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:14.879658 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:14.882917 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:14.917847 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:15.004245 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2e632e22-7641-4f3b-b75a-965ca7536085 req-fbb335c2-37f4-4408-8312-33ee8da1d78b service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-vif-unplugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:31:15.004623 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2e632e22-7641-4f3b-b75a-965ca7536085 req-fbb335c2-37f4-4408-8312-33ee8da1d78b service nova] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:15.004763 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2e632e22-7641-4f3b-b75a-965ca7536085 req-fbb335c2-37f4-4408-8312-33ee8da1d78b service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:15.004872 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-2e632e22-7641-4f3b-b75a-965ca7536085 req-fbb335c2-37f4-4408-8312-33ee8da1d78b service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:15.005214 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2e632e22-7641-4f3b-b75a-965ca7536085 req-fbb335c2-37f4-4408-8312-33ee8da1d78b service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] No waiting events found dispatching network-vif-unplugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:31:15.005214 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-2e632e22-7641-4f3b-b75a-965ca7536085 req-fbb335c2-37f4-4408-8312-33ee8da1d78b service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-vif-unplugged-1c484d65-fb3c-4479-b3e8-e806c283851a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:31:15.165589 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99975062600015 future=<Future at 0x7e4b406da420 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:31:15.165878 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999449105000167 future=<Future at 0x7e4b406da420 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:31:15.166072 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999240477000058 future=<Future at 0x7e4b406da420 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:31:15.167814 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Instance destroyed successfully.
May 28 03:31:15.168327 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'resources' on Instance uuid 21280f86-03dd-4c76-a5ff-c534416cfe39 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:31:15.670492 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:28:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-807502994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-807502994',id=80,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM24eDE9sS5vvA85LYIkaJte3O7AFfswDzhDm546D+D7IttHOOMEVSSGB01TkUZrHZawL0jpOPsR67vY2YQl6dqa0FDurgG/PeoJTjLOIk7WSXI+drc1rwsOTcvWZaZhRA==',key_name='tempest-keypair-935238549',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:28:31Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-6ey1e2dv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=21280f86-03dd-4c76-a5ff-c534416cfe39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:31:15.671177 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "1c484d65-fb3c-4479-b3e8-e806c283851a", "address": "fa:16:3e:af:79:fe", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c484d65-fb", "ovs_interfaceid": "1c484d65-fb3c-4479-b3e8-e806c283851a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:31:15.671177 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=1c484d65-fb3c-4479-b3e8-e806c283851a,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c484d65-fb') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:31:15.671416 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=1c484d65-fb3c-4479-b3e8-e806c283851a,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c484d65-fb') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:31:15.672580 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:15.672923 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c484d65-fb, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:31:15.674080 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:15.674793 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:31:15.675387 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:15.675506 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1416347f-0a8f-4e28-8c4a-4370f2068de1) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:31:15.675887 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:15.676277 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:31:15.676420 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:15.678030 np0000001589 nova-compute[98297]: INFO os_vif [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=1c484d65-fb3c-4479-b3e8-e806c283851a,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c484d65-fb')
May 28 03:31:15.678325 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Deleting instance files /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39_del
May 28 03:31:15.678997 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Deletion of /opt/stack/data/nova/instances/21280f86-03dd-4c76-a5ff-c534416cfe39_del complete
May 28 03:31:16.184694 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 03:31:16.185462 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:31:16.185753 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:31:16.185844 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:31:16.186051 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:16.278536 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:16.497670 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bb0171f2-8744-41c4-815f-6454923d85da req-fd466035-4884-493a-ad52-2a9cd527d09e service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-vif-deleted-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:31:16.498064 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-bb0171f2-8744-41c4-815f-6454923d85da req-fd466035-4884-493a-ad52-2a9cd527d09e service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Neutron deleted interface 1c484d65-fb3c-4479-b3e8-e806c283851a; detaching it from the instance and deleting it from the info cache
May 28 03:31:16.499531 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-bb0171f2-8744-41c4-815f-6454923d85da req-fd466035-4884-493a-ad52-2a9cd527d09e service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Detach interface failed, port_id=1c484d65-fb3c-4479-b3e8-e806c283851a, reason: Instance 21280f86-03dd-4c76-a5ff-c534416cfe39 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:31:16.957053 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:31:17.054496 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-32b4a1b9-31d9-4c1d-bcd4-7b0dfb105b57 req-96bec8f1-248e-4c5a-84d5-698d6e57bea7 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-vif-unplugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:31:17.054901 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-32b4a1b9-31d9-4c1d-bcd4-7b0dfb105b57 req-96bec8f1-248e-4c5a-84d5-698d6e57bea7 service nova] Acquiring lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:17.055056 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-32b4a1b9-31d9-4c1d-bcd4-7b0dfb105b57 req-96bec8f1-248e-4c5a-84d5-698d6e57bea7 service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:17.055156 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-32b4a1b9-31d9-4c1d-bcd4-7b0dfb105b57 req-96bec8f1-248e-4c5a-84d5-698d6e57bea7 service nova] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:17.055304 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-32b4a1b9-31d9-4c1d-bcd4-7b0dfb105b57 req-96bec8f1-248e-4c5a-84d5-698d6e57bea7 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] No waiting events found dispatching network-vif-unplugged-1c484d65-fb3c-4479-b3e8-e806c283851a {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:31:17.055405 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-32b4a1b9-31d9-4c1d-bcd4-7b0dfb105b57 req-96bec8f1-248e-4c5a-84d5-698d6e57bea7 service nova] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Received event network-vif-unplugged-1c484d65-fb3c-4479-b3e8-e806c283851a for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:31:17.458282 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Took 1.27 seconds to deallocate network for instance.
May 28 03:31:17.963064 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:17.963451 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:18.042750 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:31:18.042949 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:31:18.545293 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:31:19.052182 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.089s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:19.093297 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Deleted allocations for instance 21280f86-03dd-4c76-a5ff-c534416cfe39
May 28 03:31:20.100362 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-f41f70db-cf53-4058-ac0c-30d3ff4668c3 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "21280f86-03dd-4c76-a5ff-c534416cfe39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.751s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:20.677241 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:23.909948 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:23.911305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:24.412115 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Starting instance... {{(pid=98297) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 28 03:31:24.955072 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:24.955431 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:24.958278 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98297) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 28 03:31:24.958424 np0000001589 nova-compute[98297]: INFO nova.compute.claims [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Claim successful on node np0000001589
May 28 03:31:25.679087 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:26.037458 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:31:26.037847 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:31:26.539822 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:31:27.046019 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.090s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:27.046457 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Start building networks asynchronously for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 28 03:31:27.551460 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Allocating IP information in the background. {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 28 03:31:27.551838 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] allocate_for_instance() {{(pid=98297) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 28 03:31:27.552092 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:27.552329 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:27.612724 np0000001589 nova-compute[98297]: DEBUG nova.policy [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b072fd3968240558761e1092daeadbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ae4c26a96294aac9f0e41aa1f588ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98297) authorize /opt/stack/nova/nova/policy.py:192}}
May 28 03:31:28.052283 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 28 03:31:28.064247 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Successfully created port: ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 28 03:31:28.471724 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Successfully updated port: ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 28 03:31:28.511712 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-changed-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:31:28.511850 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Refreshing instance network info cache due to event network-changed-ef40ce7c-73d1-48b3-bfef-d43543abe3ab. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:31:28.512016 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] Acquiring lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:31:28.512129 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] Acquired lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:31:28.512420 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Refreshing network info cache for port ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:31:28.555626 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Start building block device mappings for instance. {{(pid=98297) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 28 03:31:28.973597 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:31:29.013994 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:29.065567 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:31:29.174926 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:31:29.562629 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Start spawning the instance on the hypervisor. {{(pid=98297) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 28 03:31:29.563416 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Creating instance directory {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 28 03:31:29.563624 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Creating image(s)
May 28 03:31:29.564008 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "/opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:29.564143 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "/opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:29.564531 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "/opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:29.564966 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:31:29.567460 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:31:29.568198 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:29.651670 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.083s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:29.652042 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "d2c3046029c70851fb0cfa95daea18373d15f06a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:29.652516 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:29.652962 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:31:29.655414 np0000001589 nova-compute[98297]: DEBUG oslo_utils.imageutils.format_inspector [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98297) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 28 03:31:29.655680 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:29.678288 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-95706abb-f1d0-4b25-a184-9dbedfda120b req-7edd29c8-5c45-4f4f-96ea-98c1046f67a1 service nova] Releasing lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:31:29.679242 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquired lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:31:29.679521 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Building network info cache for instance {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 28 03:31:29.739828 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:29.740208 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk 1073741824 {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:29.792506 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a,backing_fmt=raw /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk 1073741824" returned: 0 in 0.052s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:29.793014 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "d2c3046029c70851fb0cfa95daea18373d15f06a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.140s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:29.793337 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:29.879535 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d2c3046029c70851fb0cfa95daea18373d15f06a --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:29.879915 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk. size=1073741824 {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 28 03:31:29.880150 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:29.964437 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:29.964814 np0000001589 nova-compute[98297]: DEBUG nova.virt.disk.api [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Cannot resize image /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk to a smaller size. {{(pid=98297) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 28 03:31:29.965193 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Created local disks {{(pid=98297) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 28 03:31:29.965374 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Ensure instance console log exists: /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/console.log {{(pid=98297) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 28 03:31:29.965618 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:29.965830 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:29.966000 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:30.165747 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.0003973309999310004 future=<Future at 0x7e4b406da420 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:31:30.166578 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] Emitting event <LifecycleEvent: 1779939075.1652536, 21280f86-03dd-4c76-a5ff-c534416cfe39 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:31:30.166752 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:31:30.166895 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] VM Stopped (Lifecycle Event)
May 28 03:31:30.236247 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Instance cache missing network info. {{(pid=98297) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 28 03:31:30.364641 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:30.471095 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Updating instance_info_cache with network_info: [{"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:31:30.674534 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ab6e551f-886e-4d5a-bd45-defe52b76775 tempest-TestVolumeBootPattern-273662808 tempest-TestVolumeBootPattern-273662808-project-member] [instance: 21280f86-03dd-4c76-a5ff-c534416cfe39] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:31:30.681244 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:30.973585 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Releasing lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:31:30.973916 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Instance network_info: |[{"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98297) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 28 03:31:30.975627 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Start _get_guest_xml network_info=[{"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'encrypted': False, 'boot_index': 0, 'image_id': 'f91efa2d-3177-46c9-add1-8d87d786068d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 28 03:31:30.977930 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:31:30.979061 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='f91efa2d-3177-46c9-add1-8d87d786068d', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-407471889', uuid='df2b52e5-4609-44b6-99a2-6271e1b5f2e4'), owner=OwnerMeta(userid='5b072fd3968240558761e1092daeadbf', username='tempest-VolumeMultiattachTests-1834139013-project-member', projectid='2ae4c26a96294aac9f0e41aa1f588ec0', projectname='tempest-VolumeMultiattachTests-1834139013'), image=ImageMeta(id='f91efa2d-3177-46c9-add1-8d87d786068d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779939090.9787412) {{(pid=98297) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 28 03:31:30.980014 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V1... {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 28 03:31:30.980315 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU controller missing on host. {{(pid=98297) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 28 03:31:30.981154 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching host: 'np0000001589' for CPU controller through CGroups V2... {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 28 03:31:30.981329 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.host [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU controller found on host. {{(pid=98297) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 28 03:31:30.982149 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98297) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 28 03:31:30.982443 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-28T02:58:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-28T02:57:53Z,direct_url=<?>,disk_format='qcow2',id=f91efa2d-3177-46c9-add1-8d87d786068d,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='822424ecd9204db1935b0bcd511780ee',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-28T02:57:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 28 03:31:30.982573 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flavor limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 28 03:31:30.982670 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Image limits 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 28 03:31:30.982779 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flavor pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 28 03:31:30.982868 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Image pref 0:0:0 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 28 03:31:30.982952 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98297) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 28 03:31:30.983093 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 28 03:31:30.983192 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 28 03:31:30.983312 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Got 1 possible topologies {{(pid=98297) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 28 03:31:30.983407 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 28 03:31:30.983513 np0000001589 nova-compute[98297]: DEBUG nova.virt.hardware [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98297) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 28 03:31:30.992714 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-407471889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-407471889',id=82,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNserJvb2Sb6t6hlxqc2IGJFTNBlBuE0xptuG0DgqQmOgVrwPZnouN+QOhnV7pj7UTLX9UbxUCp3rHtiskGaqGjrtOXxkJN+v9pZdzfpEl+0Bk5PoKesk+31sTdARCnYA==',key_name='tempest-keypair-1978459873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-vyhgfkx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=df2b52e5-4609-44b6-99a2-6271e1b5f2e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98297) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 28 03:31:30.992930 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:31:30.993407 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1e:da,bridge_name='br-int',has_traffic_filtering=True,id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40ce7c-73') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:31:30.993880 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'pci_devices' on Instance uuid df2b52e5-4609-44b6-99a2-6271e1b5f2e4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:31:31.496413 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] End _get_guest_xml xml=<domain type="qemu">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <uuid>df2b52e5-4609-44b6-99a2-6271e1b5f2e4</uuid>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <name>instance-00000052</name>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <memory>196608</memory>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <vcpu>1</vcpu>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <metadata>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:package version="33.1.0"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:name>tempest-VolumeMultiattachTests-server-407471889</nova:name>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:creationTime>2026-05-28 03:31:30</nova:creationTime>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:flavor name="m1.nano" id="42">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:memory>192</nova:memory>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:disk>1</nova:disk>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:swap>0</nova:swap>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:ephemeral>0</nova:ephemeral>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:vcpus>1</nova:vcpus>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:extraSpecs>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         </nova:extraSpecs>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       </nova:flavor>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:image uuid="f91efa2d-3177-46c9-add1-8d87d786068d">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:containerFormat>bare</nova:containerFormat>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:minDisk>1</nova:minDisk>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:minRam>0</nova:minRam>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:properties>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         </nova:properties>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       </nova:image>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:owner>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:user uuid="5b072fd3968240558761e1092daeadbf">tempest-VolumeMultiattachTests-1834139013-project-member</nova:user>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:project uuid="2ae4c26a96294aac9f0e41aa1f588ec0">tempest-VolumeMultiattachTests-1834139013</nova:project>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       </nova:owner>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:root type="image" uuid="f91efa2d-3177-46c9-add1-8d87d786068d"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <nova:ports>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         <nova:port uuid="ef40ce7c-73d1-48b3-bfef-d43543abe3ab">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:         </nova:port>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       </nova:ports>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </nova:instance>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   </metadata>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <sysinfo type="smbios">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <system>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <entry name="product">OpenStack Nova</entry>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <entry name="version">33.1.0</entry>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <entry name="serial">df2b52e5-4609-44b6-99a2-6271e1b5f2e4</entry>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <entry name="uuid">df2b52e5-4609-44b6-99a2-6271e1b5f2e4</entry>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <entry name="family">Virtual Machine</entry>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </system>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   </sysinfo>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <os>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <type arch="x86_64" machine="pc">hvm</type>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <boot dev="hd"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <smbios mode="sysinfo"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   </os>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <features>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <acpi/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <tcg>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <tb-cache unit="MiB">128</tb-cache>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </tcg>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <vmcoreinfo/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   </features>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <iothreads>1</iothreads>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <clock offset="utc"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <cpu mode="custom" match="exact">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <model>Nehalem</model>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <topology sockets="1" cores="1" threads="1"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   </cpu>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   <devices>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <disk type="file" device="disk">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <driver name="qemu" type="qcow2" cache="none"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <target dev="vda" bus="virtio"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </disk>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <disk type="file" device="cdrom">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <driver name="qemu" type="raw" cache="none"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <source file="/opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk.config"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <target dev="hda" bus="ide"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </disk>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <interface type="ethernet">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <mac address="fa:16:3e:a9:1e:da"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <driver name="qemu"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <mtu size="1372"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <target dev="tapef40ce7c-73"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </interface>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <serial type="pty">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <log file="/opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/console.log" append="off"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </serial>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <video>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <model type="virtio"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </video>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <rng model="virtio">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <backend model="random">/dev/urandom</backend>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </rng>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <controller type="usb" index="0" model="none"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:       <stats period="10"/>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:     </memballoon>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:   </devices>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]: </domain>
May 28 03:31:31.496413 np0000001589 nova-compute[98297]:  {{(pid=98297) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Preparing to wait for external event network-vif-plugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-28T03:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-407471889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-407471889',id=82,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNserJvb2Sb6t6hlxqc2IGJFTNBlBuE0xptuG0DgqQmOgVrwPZnouN+QOhnV7pj7UTLX9UbxUCp3rHtiskGaqGjrtOXxkJN+v9pZdzfpEl+0Bk5PoKesk+31sTdARCnYA==',key_name='tempest-keypair-1978459873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-vyhgfkx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-28T03:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=df2b52e5-4609-44b6-99a2-6271e1b5f2e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1e:da,bridge_name='br-int',has_traffic_filtering=True,id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40ce7c-73') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1e:da,bridge_name='br-int',has_traffic_filtering=True,id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40ce7c-73') {{(pid=98297) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 28 03:31:31.500001 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:31.500641 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e68d24f-62f7-5075-b8c1-0053bea77ceb', '_type': 'linux-noop'}}, row=False) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:31:31.500906 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:31.501615 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:31:31.503760 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:31.503880 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef40ce7c-73, may_exist=True, interface_attrs={}) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:31:31.504196 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef40ce7c-73, col_values=(('qos', UUID('fbfcfaaa-9588-4375-b3a2-fc28a5cd150b')),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:31:31.504388 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef40ce7c-73, col_values=(('external_ids', {'iface-id': 'ef40ce7c-73d1-48b3-bfef-d43543abe3ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:1e:da', 'vm-uuid': 'df2b52e5-4609-44b6-99a2-6271e1b5f2e4'}),), if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:31:31.505114 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:31.506033 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:31:31.509883 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:31.510684 np0000001589 nova-compute[98297]: INFO os_vif [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:1e:da,bridge_name='br-int',has_traffic_filtering=True,id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40ce7c-73')
May 28 03:31:33.024058 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:31:33.024454 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:31:33.024454 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:a9:1e:da, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:31:33.024695 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Using config drive
May 28 03:31:33.529429 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:33.632700 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Creating config drive at /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk.config
May 28 03:31:33.636303 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphhve9bqz {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:33.691941 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphhve9bqz" returned: 0 in 0.055s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:34.039261 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.054619 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.132501 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.139649 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.195609 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cbd96b6f-b990-4dc6-883b-06ab1920c4c4 req-a84e867c-adcd-4b9c-8fc5-9e98be24fa6d service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-vif-plugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:31:34.196154 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cbd96b6f-b990-4dc6-883b-06ab1920c4c4 req-a84e867c-adcd-4b9c-8fc5-9e98be24fa6d service nova] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:34.196371 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cbd96b6f-b990-4dc6-883b-06ab1920c4c4 req-a84e867c-adcd-4b9c-8fc5-9e98be24fa6d service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:34.196475 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-cbd96b6f-b990-4dc6-883b-06ab1920c4c4 req-a84e867c-adcd-4b9c-8fc5-9e98be24fa6d service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:34.196579 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-cbd96b6f-b990-4dc6-883b-06ab1920c4c4 req-a84e867c-adcd-4b9c-8fc5-9e98be24fa6d service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Processing event network-vif-plugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 28 03:31:34.330259 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.331767 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.333336 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.345525 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:34.685695 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779939094.6852956, df2b52e5-4609-44b6-99a2-6271e1b5f2e4 => Started> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:31:34.686211 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98297) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 28 03:31:34.686407 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] VM Started (Lifecycle Event)
May 28 03:31:34.688174 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Guest created on hypervisor {{(pid=98297) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 28 03:31:34.692310 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Instance spawned successfully.
May 28 03:31:34.692561 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 28 03:31:35.192841 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:31:35.196509 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:31:35.201046 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Found default for hw_cdrom_bus of ide {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:31:35.201169 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Found default for hw_disk_bus of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:31:35.201504 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Found default for hw_input_bus of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:31:35.201781 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Found default for hw_pointer_model of None {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:31:35.202144 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Found default for hw_video_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:31:35.202463 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Found default for hw_vif_model of virtio {{(pid=98297) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 28 03:31:35.700568 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] During sync_power_state the instance has a pending task (spawning). Skip.
May 28 03:31:35.700810 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779939095.7006476, df2b52e5-4609-44b6-99a2-6271e1b5f2e4 => Paused> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:31:35.700911 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] VM Paused (Lifecycle Event)
May 28 03:31:35.707330 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Took 6.14 seconds to spawn the instance on the hypervisor.
May 28 03:31:35.707559 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:31:36.202785 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:31:36.204650 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Emitting event <LifecycleEvent: 1779939096.204493, df2b52e5-4609-44b6-99a2-6271e1b5f2e4 => Resumed> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:31:36.204758 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] VM Resumed (Lifecycle Event)
May 28 03:31:36.216259 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Took 11.30 seconds to build instance.
May 28 03:31:36.257148 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-250ed9cf-c402-4581-8524-9fd2d064837a req-a506e59b-6ee1-4e7c-911c-2a95d8b093c3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-vif-plugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:31:36.257546 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-250ed9cf-c402-4581-8524-9fd2d064837a req-a506e59b-6ee1-4e7c-911c-2a95d8b093c3 service nova] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:36.257643 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-250ed9cf-c402-4581-8524-9fd2d064837a req-a506e59b-6ee1-4e7c-911c-2a95d8b093c3 service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:36.257782 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-250ed9cf-c402-4581-8524-9fd2d064837a req-a506e59b-6ee1-4e7c-911c-2a95d8b093c3 service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:36.257982 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-250ed9cf-c402-4581-8524-9fd2d064837a req-a506e59b-6ee1-4e7c-911c-2a95d8b093c3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] No waiting events found dispatching network-vif-plugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:31:36.258086 np0000001589 nova-compute[98297]: WARNING nova.compute.manager [req-250ed9cf-c402-4581-8524-9fd2d064837a req-a506e59b-6ee1-4e7c-911c-2a95d8b093c3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received unexpected event network-vif-plugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab for instance with vm_state active and task_state None.
May 28 03:31:36.507041 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:36.647381 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-changed-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:31:36.647580 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Refreshing instance network info cache due to event network-changed-ef40ce7c-73d1-48b3-bfef-d43543abe3ab. {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}}
May 28 03:31:36.647679 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] Acquiring lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 28 03:31:36.647756 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] Acquired lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 28 03:31:36.647883 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Refreshing network info cache for port ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 28 03:31:36.706999 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:31:36.709055 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98297) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 28 03:31:36.717805 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-3be8c444-e1b3-4b86-9893-602368423c81 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.807s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:37.151478 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:37.436672 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:31:37.547165 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Updated VIF entry in instance network info cache for port ef40ce7c-73d1-48b3-bfef-d43543abe3ab. {{(pid=98297) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 28 03:31:37.547452 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Updating instance_info_cache with network_info: [{"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:31:38.049207 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-ad24d43f-859c-43e9-9475-e54156020531 req-38383803-d6f5-48f8-8fa0-9c48b37034a3 service nova] Releasing lock "refresh_cache-df2b52e5-4609-44b6-99a2-6271e1b5f2e4" {{(pid=98297) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 28 03:31:38.872446 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:41.509809 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:43.884569 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:46.513248 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:48.886837 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:50.137709 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:50.138025 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:31:51.515322 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:51.791947 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:31:53.897708 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:55.137679 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:31:55.641728 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:55.641874 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:55.642023 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:55.642161 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:31:56.517936 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:56.658610 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:56.746305 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:56.746794 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk --force-share --output=json {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:56.832907 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:56.837507 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:31:56.838873 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:31:56.888953 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:31:56.889430 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=13675MB free_disk=72.56706237792969GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:31:56.889616 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:31:56.889901 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:31:57.940087 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98297) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 28 03:31:57.940458 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:31:57.940458 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:31:56 up 59 min,  2 users,  load average: 0.69, 1.06, 2.48\n', 'num_instances': '1', 'num_vm_active': '1', 'num_task_None': '1', 'num_os_type_None': '1', 'num_proj_2ae4c26a96294aac9f0e41aa1f588ec0': '1', 'io_workload': '0'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:31:58.019080 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:31:58.019332 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:31:58.522056 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:31:58.912914 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:31:59.028811 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:31:59.028811 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.139s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:31:59.029852 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:32:01.523541 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:02.029857 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:02.030095 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:02.030321 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:02.030548 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:02.030695 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:32:02.030939 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:32:02.137978 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:02.138241 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:32:03.695294 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:03.695753 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:03.922662 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:04.137979 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:04.138356 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:32:04.198865 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid df2b52e5-4609-44b6-99a2-6271e1b5f2e4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:32:05.204121 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:06.255986 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:06.256367 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:06.256402 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Attaching volume 03b83651-6d6c-4c8f-9402-82be4cf185ef to /dev/vdb
May 28 03:32:06.287464 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.55', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001589', 'execute': None}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:32:06.299691 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.scaleio [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98297) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 28 03:32:06.320721 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Running cmd (subprocess): nvme version {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:32:06.367493 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] 'nvme version' failed. Not Retrying. {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 28 03:32:06.367831 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] nvme not present on system {{(pid=98297) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 28 03:32:06.376168 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98297) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 28 03:32:06.377118 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.lightos [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Current host hostNQN  and IP(s) are ['10.4.3.55', 'fe80::f816:3eff:fe2b:d047', '192.168.40.6', 'fe80::f816:3eff:fe1b:f907', '192.168.50.6', 'fe80::f816:3eff:fea3:f693', '192.168.10.6', 'fe80::f816:3eff:fe4f:36c3', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f01a:67ff:fea0:5c40', 'fe80::fc16:3eff:fea9:1eda', 'fe80::dc29:e5ff:fec2:3a61'] 
May 28 03:32:06.377247 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 28 03:32:06.377385 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.lightos [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] LIGHTOS: no hostnqn found. {{(pid=98297) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 28 03:32:06.377609 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.55', 'host': 'np0000001589', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:c9b1441b472', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '21e70235-3bc1-4e72-a52e-e48deb412863', 'nvme_native_multipath': False} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:32:06.377844 np0000001589 nova-compute[98297]: DEBUG nova.virt.block_device [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Updating existing volume attachment record: 6e93cf04-84e9-441e-a59e-b5614bdff266 {{(pid=98297) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 28 03:32:06.535604 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:06.923898 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Calling os-brick to attach iSCSI Volume {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 28 03:32:06.924260 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03b83651-6d6c-4c8f-9402-82be4cf185ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:32:06.924425 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:32:06.924824 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:32:06.925010 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03b83651-6d6c-4c8f-9402-82be4cf185ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 28 03:32:06.937003 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:32:06.937634 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:32:06.938179 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:32:06.938626 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:32:06.938883 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:32:06.939159 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:32:06.949313 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:32:06.949313 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:06.953960 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 28 03:32:06.953960 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:06.960055 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef] added
May 28 03:32:06.960055 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:32:06.960055 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:32:06.960055 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:32:06.960055 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:32:06.960055 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:32:06.960055 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:06.960585 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:32:06.960585 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0218(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:32:06.960585 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:32:06.964182 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef] added
May 28 03:32:06.964182 np0000001589 nova-compute[98297]:  stderr=iscsiadm: Config file line 363 does not have value
May 28 03:32:06.964182 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:32:06.964182 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:32:06.964182 np0000001589 nova-compute[98297]: iscsiadm: Config file line 363 does not have value
May 28 03:32:06.964182 np0000001589 nova-compute[98297]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 28 03:32:06.964182 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:06.964376 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98297) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 28 03:32:06.964479 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 28 03:32:06.964601 np0000001589 nova-compute[98297]: DEBUG os_brick.utils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98297) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 28 03:32:07.960966 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 28 03:32:07.965181 np0000001589 nova-compute[98297]: INFO os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.40.100
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:32:07.972591 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:32:07.972591 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.name = iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.tpgt = -1
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.startup = manual
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.leading_login = No
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.iscsi_ifacename = default
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.net_ifacename = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.ipaddress = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.prefix_len = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.hwaddress = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.transport_name = tcp
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.initiatorname = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.state = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.vlan_id = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.vlan_priority = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.vlan_state = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.iface_num = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.mtu = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.port = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.bootproto = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.subnet_mask = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.gateway = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id_state = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_alt_client_id = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_dns = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_learn_iqn = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_req_vendor_id_state = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id_state = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_vendor_id = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.dhcp_slp_da = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.fragmentation = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.gratuitous_arp = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.incoming_forwarding = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.tos_state = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.tos = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.ttl = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.delayed_ack = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.tcp_nagle = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.tcp_wsf_state = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.tcp_wsf = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.tcp_timer_scale = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.tcp_timestamp = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.redirect = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.def_task_mgmt_timeout = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.header_digest = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.data_digest = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.immediate_data = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.initial_r2t = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.data_seq_inorder = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.data_pdu_inorder = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.erl = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.max_receive_data_len = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.first_burst_len = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.max_outstanding_r2t = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.max_burst_len = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.chap_auth = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.bidi_chap = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.strict_login_compliance = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.discovery_auth = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: iface.discovery_logout = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.discovery_address = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.discovery_port = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.discovery_type = fw
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.initial_cmdsn = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.initial_login_retry_max = 8
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.xmit_thread_priority = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.cmds_max = 128
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.queue_depth = 32
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.nr_sessions = 1
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.auth.authmethod = None
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.auth.username = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.auth.password = ***
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.auth.username_in = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.auth.password_in = <empty>
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.auth.chap_algs = SHA256
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.timeo.replacement_timeout = 120
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.err_timeo.abort_timeout = 15
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.err_timeo.lu_reset_timeout = 30
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.err_timeo.tgt_reset_timeout = 30
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.err_timeo.host_reset_timeout = 60
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.FastAbort = Yes
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.InitialR2T = No
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.ImmediateData = Yes
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.FirstBurstLength = 262144
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.MaxBurstLength = 16776192
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Retain = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.DefaultTime2Wait = 2
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.MaxConnections = 1
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.MaxOutstandingR2T = 1
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.iscsi.ERL = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.scan = auto
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.session.reopen_max = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].address = 192.168.50.100
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].port = 3260
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].startup = manual
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].tcp.window_size = 524288
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].tcp.type_of_service = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].timeo.logout_timeout = 15
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].timeo.login_timeout = 15
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].timeo.auth_timeout = 45
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_interval = 5
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].timeo.noop_out_timeout = 5
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].iscsi.HeaderDigest = None
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].iscsi.DataDigest = None
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].iscsi.IFMarker = No
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: node.conn[0].iscsi.OFMarker = No
May 28 03:32:07.978562 np0000001589 nova-compute[98297]: # END RECORD
May 28 03:32:07.978562 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:07.983476 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:07.989176 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:07.993836 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:32:07.993836 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:32:07.993944 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:32:07.993944 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:32:07.994063 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:32:07.994063 np0000001589 nova-compute[98297]: 
May 28 03:32:07.998809 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 28 03:32:07.998809 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:32:07.998928 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 28 03:32:07.998928 np0000001589 nova-compute[98297]:  {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:32:07.999037 np0000001589 nova-compute[98297]: WARNING os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 28 03:32:07.999037 np0000001589 nova-compute[98297]: 
May 28 03:32:09.028330 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.50.100,3260]
May 28 03:32:09.028330 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.50.100,3260] successful.
May 28 03:32:09.028330 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:09.028778 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.40.100,3260]
May 28 03:32:09.028778 np0000001589 nova-compute[98297]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.40.100,3260] successful.
May 28 03:32:09.028778 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:09.039160 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:09.043644 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:09.051192 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.051192 np0000001589 nova-compute[98297]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.051192 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:32:09.051332 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.051332 np0000001589 nova-compute[98297]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.051332 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:32:09.051562 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.113s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:32:09.051680 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.50.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:32:09.052156 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('8', '-', '-', 0) found on session 234 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:32:09.052274 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:32:09.056699 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.056699 np0000001589 nova-compute[98297]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.056699 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:32:09.056791 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.056791 np0000001589 nova-compute[98297]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:09.056791 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:32:09.056994 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.119s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:32:09.057098 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to 192.168.40.100:3260 {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 28 03:32:09.057497 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] HCTL ('7', '-', '-', 0) found on session 233 with lun 0 {{(pid=98297) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 28 03:32:09.057583 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98297) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 28 03:32:09.066400 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 234 and hctl ['8', '*', '*', 0] yield: sdb {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:32:09.066400 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '03b83651-6d6c-4c8f-9402-82be4cf185ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:32:09.072532 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Searching for a device in session 233 and hctl ['7', '*', '*', 0] yield: sdc {{(pid=98297) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 28 03:32:09.072532 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03b83651-6d6c-4c8f-9402-82be4cf185ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98297) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 28 03:32:09.137724 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:09.138123 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:32:09.938528 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 28 03:32:10.953496 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found WWN 330000000c0837da3 for multipath device dm-0 {{(pid=98297) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 28 03:32:10.953952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.029s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:32:10.953952 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== connect_volume: return (4029ms) {'type': 'block', 'scsi_wwn': '330000000c0837da3', 'path': '/dev/dm-0', 'multipath_id': '330000000c0837da3'} {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:32:10.954023 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c0837da3', 'path': '/dev/dm-0', 'multipath_id': '330000000c0837da3'} {{(pid=98297) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 28 03:32:10.956396 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid df2b52e5-4609-44b6-99a2-6271e1b5f2e4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:32:11.459523 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Attempting to attach volume 03b83651-6d6c-4c8f-9402-82be4cf185ef with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98297) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 28 03:32:11.460786 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] attach device xml: <disk type="block" device="disk">
May 28 03:32:11.460786 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:32:11.460786 np0000001589 nova-compute[98297]:   <alias name="ua-03b83651-6d6c-4c8f-9402-82be4cf185ef"/>
May 28 03:32:11.460786 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:32:11.460786 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:32:11.460786 np0000001589 nova-compute[98297]:   <serial>03b83651-6d6c-4c8f-9402-82be4cf185ef</serial>
May 28 03:32:11.460786 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:32:11.460786 np0000001589 nova-compute[98297]: </disk>
May 28 03:32:11.460786 np0000001589 nova-compute[98297]:  {{(pid=98297) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 28 03:32:11.541330 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:32:11.541572 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:32:11.541620 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98297) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 03:32:11.541692 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:32:11.553238 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:11.553418 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:32:13.101438 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:32:13.101817 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:32:13.101817 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No BDM found with device name hda, not building metadata. {{(pid=98297) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 28 03:32:13.101817 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] No VIF found with MAC fa:16:3e:a9:1e:da, not building metadata {{(pid=98297) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 28 03:32:14.642179 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-7da60876-b3a4-4db0-95ec-545f4ac5c1a5 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.386s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:15.161244 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:15.161411 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:15.663622 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Detaching volume 03b83651-6d6c-4c8f-9402-82be4cf185ef
May 28 03:32:15.696725 np0000001589 nova-compute[98297]: INFO nova.virt.block_device [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Attempting to driver detach volume 03b83651-6d6c-4c8f-9402-82be4cf185ef from mountpoint /dev/vdb
May 28 03:32:15.700731 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdb by alias ua-03b83651-6d6c-4c8f-9402-82be4cf185ef {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:32:15.701763 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Found disk vdb by alias ua-03b83651-6d6c-4c8f-9402-82be4cf185ef {{(pid=98297) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 28 03:32:15.701888 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Attempting to detach device vdb from instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4 from the persistent domain config. {{(pid=98297) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 28 03:32:15.702084 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:   <alias name="ua-03b83651-6d6c-4c8f-9402-82be4cf185ef"/>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:   <serial>03b83651-6d6c-4c8f-9402-82be4cf185ef</serial>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]: </disk>
May 28 03:32:15.702084 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:32:15.706948 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdb from instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4 from the persistent domain config.
May 28 03:32:15.707069 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] (1/8): Attempting to detach device vdb with device alias ua-03b83651-6d6c-4c8f-9402-82be4cf185ef from instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4 from the live domain config. {{(pid=98297) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 28 03:32:15.707298 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.guest [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] detach device xml: <disk type="block" device="disk">
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:   <alias name="ua-03b83651-6d6c-4c8f-9402-82be4cf185ef"/>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:   <source dev="/dev/dm-0"/>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:   <target dev="vdb" bus="virtio"/>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:   <serial>03b83651-6d6c-4c8f-9402-82be4cf185ef</serial>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:   <shareable/>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]: </disk>
May 28 03:32:15.707298 np0000001589 nova-compute[98297]:  {{(pid=98297) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 28 03:32:16.140692 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Received event <DeviceRemovedEvent: 1779939136.140314, df2b52e5-4609-44b6-99a2-6271e1b5f2e4 => ua-03b83651-6d6c-4c8f-9402-82be4cf185ef> from libvirt while the driver is waiting for it; dispatched. {{(pid=98297) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 28 03:32:16.141996 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-03b83651-6d6c-4c8f-9402-82be4cf185ef for instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4 {{(pid=98297) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 28 03:32:16.143788 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully detached device vdb from instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4 from the live domain config.
May 28 03:32:16.168909 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] calling os-brick to detach iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 28 03:32:16.169162 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7e4b645d7a40>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03b83651-6d6c-4c8f-9402-82be4cf185ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 28 03:32:16.169283 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 28 03:32:16.169540 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 28 03:32:16.169777 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '03b83651-6d6c-4c8f-9402-82be4cf185ef', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 28 03:32:16.169899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', 0)] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 28 03:32:16.191595 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:16.191595 np0000001589 nova-compute[98297]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:16.191595 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 28 03:32:16.191865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsi session list stdout=tcp: [233] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:16.191865 np0000001589 nova-compute[98297]: tcp: [234] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef (non-flash)
May 28 03:32:16.191865 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 28 03:32:16.191865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', '233'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', '234')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 28 03:32:16.191865 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', '233')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:32:16.192547 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef', '234')] {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 28 03:32:16.193677 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7e4b40675bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef'): ({'sdb'}, set())}) {{(pid=98297) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 28 03:32:16.193844 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Removing multipathed devices sdc, sdb {{(pid=98297) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 28 03:32:16.194059 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Flush multipath device 330000000c0837da3 {{(pid=98297) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 28 03:32:16.227580 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:32:16.261665 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98297) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 28 03:32:16.305029 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 28 03:32:16.305192 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] SCSI volumes sdc, sdb have been removed. {{(pid=98297) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 28 03:32:16.305754 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Checking to see if device paths {'sdc', 'sdb'} are still under multipathd monitoring {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 28 03:32:16.319261 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.linuxscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Device paths {'sdc', 'sdb'} have been removed from multipathd monitoring. {{(pid=98297) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 28 03:32:16.319451 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef')] {{(pid=98297) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 28 03:32:16.330486 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:16.355155 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 233, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.40.100,3260]
May 28 03:32:16.355155 np0000001589 nova-compute[98297]: Logout of [sid: 233, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.40.100,3260] successful.
May 28 03:32:16.355155 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:16.366908 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:16.375745 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:16.404254 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 234, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.50.100,3260]
May 28 03:32:16.404254 np0000001589 nova-compute[98297]: Logout of [sid: 234, target: iqn.2023-03.storpool.com:os--volume-03b83651-6d6c-4c8f-9402-82be4cf185ef, portal: 192.168.50.100,3260] successful.
May 28 03:32:16.404254 np0000001589 nova-compute[98297]:  stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:16.414701 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98297) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 28 03:32:16.414899 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.base [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 28 03:32:16.414998 np0000001589 nova-compute[98297]: DEBUG os_brick.initiator.connectors.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] <== disconnect_volume: return (245ms) None {{(pid=98297) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 28 03:32:16.415133 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Disconnected iSCSI Volume {{(pid=98297) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 28 03:32:16.558633 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:32:16.558851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:32:16.558851 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98297) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 28 03:32:16.558953 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:32:16.574690 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:16.574878 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98297) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 28 03:32:16.955777 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'flavor' on Instance uuid df2b52e5-4609-44b6-99a2-6271e1b5f2e4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:32:17.960700 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-76b4e869-8b28-4742-8eb9-ebf3a7e45d08 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.799s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:19.471937 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:19.472343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:19.472343 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:19.472425 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:19.472533 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:19.474318 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Terminating instance
May 28 03:32:19.977599 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Start destroying the instance on the hypervisor. {{(pid=98297) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 28 03:32:19.990763 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:19.992371 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.003795 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.005901 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.022245 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.137459 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56172caf-0e20-43bb-8429-605d86588bb2 req-1da2b748-e9e6-4452-b0d3-a2e2ecd61d5a service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-vif-unplugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:32:20.138521 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-56172caf-0e20-43bb-8429-605d86588bb2 req-1da2b748-e9e6-4452-b0d3-a2e2ecd61d5a service nova] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:20.138705 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-56172caf-0e20-43bb-8429-605d86588bb2 req-1da2b748-e9e6-4452-b0d3-a2e2ecd61d5a service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:20.138838 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-56172caf-0e20-43bb-8429-605d86588bb2 req-1da2b748-e9e6-4452-b0d3-a2e2ecd61d5a service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:20.138974 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56172caf-0e20-43bb-8429-605d86588bb2 req-1da2b748-e9e6-4452-b0d3-a2e2ecd61d5a service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] No waiting events found dispatching network-vif-unplugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:32:20.139090 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-56172caf-0e20-43bb-8429-605d86588bb2 req-1da2b748-e9e6-4452-b0d3-a2e2ecd61d5a service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-vif-unplugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:32:20.282657 np0000001589 nova-compute[98297]: DEBUG nova.utils [None req-3799cb02-6a5a-46cb-899d-d3a0e8e33890 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999728475000211 future=<Future at 0x7e4b6445f740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:32:20.283282 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.999096611000368 future=<Future at 0x7e4b6445f740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:32:20.283457 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=14.99884319900002 future=<Future at 0x7e4b6445f740 state=pending>) {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:32:20.284991 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [-] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Instance destroyed successfully.
May 28 03:32:20.285932 np0000001589 nova-compute[98297]: DEBUG nova.objects.instance [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lazy-loading 'resources' on Instance uuid df2b52e5-4609-44b6-99a2-6271e1b5f2e4 {{(pid=98297) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 28 03:32:20.787829 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.vif [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-28T03:31:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-407471889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001589',hostname='tempest-volumemultiattachtests-server-407471889',id=82,image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNserJvb2Sb6t6hlxqc2IGJFTNBlBuE0xptuG0DgqQmOgVrwPZnouN+QOhnV7pj7UTLX9UbxUCp3rHtiskGaqGjrtOXxkJN+v9pZdzfpEl+0Bk5PoKesk+31sTdARCnYA==',key_name='tempest-keypair-1978459873',keypairs=<?>,launch_index=0,launched_at=2026-05-28T03:31:35Z,launched_on='np0000001589',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001589',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ae4c26a96294aac9f0e41aa1f588ec0',ramdisk_id='',reservation_id='r-vyhgfkx3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='f91efa2d-3177-46c9-add1-8d87d786068d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-1834139013',owner_user_name='tempest-VolumeMultiattachTests-1834139013-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-28T03:31:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b072fd3968240558761e1092daeadbf',uuid=df2b52e5-4609-44b6-99a2-6271e1b5f2e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 28 03:32:20.788389 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converting VIF {"id": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "address": "fa:16:3e:a9:1e:da", "network": {"id": "9619834b-a434-47d3-b3e7-432f4ab1b4b1", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-224385785-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2ae4c26a96294aac9f0e41aa1f588ec0", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapef40ce7c-73", "ovs_interfaceid": "ef40ce7c-73d1-48b3-bfef-d43543abe3ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 28 03:32:20.788678 np0000001589 nova-compute[98297]: DEBUG nova.network.os_vif_util [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:1e:da,bridge_name='br-int',has_traffic_filtering=True,id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40ce7c-73') {{(pid=98297) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 28 03:32:20.788948 np0000001589 nova-compute[98297]: DEBUG os_vif [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:1e:da,bridge_name='br-int',has_traffic_filtering=True,id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40ce7c-73') {{(pid=98297) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 28 03:32:20.791485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.791485 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef40ce7c-73, bridge=br-int, if_exists=True) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:32:20.792261 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.793488 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:32:20.793873 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.793995 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbfcfaaa-9588-4375-b3a2-fc28a5cd150b) {{(pid=98297) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 28 03:32:20.794385 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.794794 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:32:20.794928 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:20.796638 np0000001589 nova-compute[98297]: INFO os_vif [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:1e:da,bridge_name='br-int',has_traffic_filtering=True,id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab,network=Network(9619834b-a434-47d3-b3e7-432f4ab1b4b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef40ce7c-73')
May 28 03:32:20.796932 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Deleting instance files /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4_del
May 28 03:32:20.797650 np0000001589 nova-compute[98297]: INFO nova.virt.libvirt.driver [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Deletion of /opt/stack/data/nova/instances/df2b52e5-4609-44b6-99a2-6271e1b5f2e4_del complete
May 28 03:32:21.303505 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Took 1.33 seconds to destroy the instance on the hypervisor.
May 28 03:32:21.304110 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._common.loopingcall [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98297) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 28 03:32:21.304446 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [-] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Deallocating network for instance {{(pid=98297) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 28 03:32:21.304603 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] deallocate_for_instance() {{(pid=98297) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 28 03:32:21.304907 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:32:21.387590 np0000001589 nova-compute[98297]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 28 03:32:21.674542 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:21.785831 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-41802835-6890-4500-be58-765346a1459e req-95a56bc4-31cd-4c9d-af55-8d31076a5b7b service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-vif-deleted-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:32:21.786024 np0000001589 nova-compute[98297]: INFO nova.compute.manager [req-41802835-6890-4500-be58-765346a1459e req-95a56bc4-31cd-4c9d-af55-8d31076a5b7b service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Neutron deleted interface ef40ce7c-73d1-48b3-bfef-d43543abe3ab; detaching it from the instance and deleting it from the info cache
May 28 03:32:21.787418 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-41802835-6890-4500-be58-765346a1459e req-95a56bc4-31cd-4c9d-af55-8d31076a5b7b service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Detach interface failed, port_id=ef40ce7c-73d1-48b3-bfef-d43543abe3ab, reason: Instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4 could not be found. {{(pid=98297) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}}
May 28 03:32:22.188961 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b5e67709-3604-4bf9-9b60-d3312b23df68 req-150b9677-3530-48f7-9aae-fa87860c6516 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-vif-unplugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}}
May 28 03:32:22.189523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b5e67709-3604-4bf9-9b60-d3312b23df68 req-150b9677-3530-48f7-9aae-fa87860c6516 service nova] Acquiring lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:22.189523 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b5e67709-3604-4bf9-9b60-d3312b23df68 req-150b9677-3530-48f7-9aae-fa87860c6516 service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:22.189777 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [req-b5e67709-3604-4bf9-9b60-d3312b23df68 req-150b9677-3530-48f7-9aae-fa87860c6516 service nova] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:22.189777 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b5e67709-3604-4bf9-9b60-d3312b23df68 req-150b9677-3530-48f7-9aae-fa87860c6516 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] No waiting events found dispatching network-vif-unplugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab {{(pid=98297) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 28 03:32:22.189957 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [req-b5e67709-3604-4bf9-9b60-d3312b23df68 req-150b9677-3530-48f7-9aae-fa87860c6516 service nova] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Received event network-vif-unplugged-ef40ce7c-73d1-48b3-bfef-d43543abe3ab for instance with task_state deleting. {{(pid=98297) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 28 03:32:22.220469 np0000001589 nova-compute[98297]: DEBUG nova.network.neutron [-] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Updating instance_info_cache with network_info: [] {{(pid=98297) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 28 03:32:22.722306 np0000001589 nova-compute[98297]: INFO nova.compute.manager [-] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Took 1.42 seconds to deallocate network for instance.
May 28 03:32:23.228037 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:23.228470 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:23.306794 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:32:23.306990 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:32:23.809310 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:32:24.315070 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.087s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:24.356189 np0000001589 nova-compute[98297]: INFO nova.scheduler.client.report [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Deleted allocations for instance df2b52e5-4609-44b6-99a2-6271e1b5f2e4
May 28 03:32:25.363089 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-ec111940-17f2-477c-bfae-66630b767a30 tempest-VolumeMultiattachTests-1834139013 tempest-VolumeMultiattachTests-1834139013-project-member] Lock "df2b52e5-4609-44b6-99a2-6271e1b5f2e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.891s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:25.795296 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:27.497907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:29.018080 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:30.796936 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:35.282741 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7e4b83644470>>, remaining_delay=-0.000340027999754966 future=<Future at 0x7e4b6445f740 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7e4b823d6a80> {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:32:35.283148 np0000001589 nova-compute[98297]: DEBUG nova.virt.driver [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] Emitting event <LifecycleEvent: 1779939140.282213, df2b52e5-4609-44b6-99a2-6271e1b5f2e4 => Stopped> {{(pid=98297) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 28 03:32:35.283292 np0000001589 nova-compute[98297]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98297) _log /opt/stack/nova/nova/utils.py:1500}}
May 28 03:32:35.283426 np0000001589 nova-compute[98297]: INFO nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] VM Stopped (Lifecycle Event)
May 28 03:32:35.785781 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-69dfa059-9842-4662-9614-8299e5b16637 tempest-TestShelveInstance-1399725326 tempest-TestShelveInstance-1399725326-project-member] [instance: df2b52e5-4609-44b6-99a2-6271e1b5f2e4] Checking state {{(pid=98297) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 28 03:32:35.797495 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:40.798471 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:45.800154 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:50.137642 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:50.137940 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:32:50.802065 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:55.804007 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:32:56.137697 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:56.641786 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:56.641956 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:56.642090 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:56.642237 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Auditing locally available compute resources for np0000001589 (node: np0000001589) {{(pid=98297) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 28 03:32:56.654021 np0000001589 nova-compute[98297]: WARNING nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 28 03:32:56.654902 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 28 03:32:56.702505 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.processutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98297) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 28 03:32:56.702941 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Hypervisor/Node resource view: name=np0000001589 free_ram=14207MB free_disk=72.59348678588867GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}] {{(pid=98297) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 28 03:32:56.703124 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 28 03:32:56.703398 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 28 03:32:57.748879 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 28 03:32:57.749189 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Final resource view: name=np0000001589 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 03:32:56 up  1:00,  1 user,  load average: 0.47, 0.94, 2.35\n'} {{(pid=98297) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 28 03:32:57.790035 np0000001589 nova-compute[98297]: DEBUG nova.virt.libvirt.driver [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98297) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 28 03:32:57.790290 np0000001589 nova-compute[98297]: DEBUG nova.compute.provider_tree [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed in ProviderTree for provider: 672703c4-2150-4765-9740-44d3bdb44a8c {{(pid=98297) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 28 03:32:58.292989 np0000001589 nova-compute[98297]: DEBUG nova.scheduler.client.report [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Inventory has not changed for provider 672703c4-2150-4765-9740-44d3bdb44a8c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98297) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 28 03:32:58.798553 np0000001589 nova-compute[98297]: DEBUG nova.compute.resource_tracker [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Compute_service record updated for np0000001589:np0000001589 {{(pid=98297) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 28 03:32:58.799025 np0000001589 nova-compute[98297]: DEBUG oslo_concurrency.lockutils [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.095s {{(pid=98297) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 28 03:32:58.799025 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:32:59.300446 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:00.806075 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 28 03:33:01.300529 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:01.300717 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:01.300980 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:01.301101 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98297) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 28 03:33:01.301330 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.84 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:02.137900 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:02.138359 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:05.137833 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:05.138141 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:05.806885 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:09.137553 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:09.138078 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:10.138336 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:10.138336 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}}
May 28 03:33:10.640366 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] There are 0 instances to clean {{(pid=98297) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}}
May 28 03:33:10.640684 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 9.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:10.807907 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:15.808591 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:20.137829 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:20.138351 np0000001589 nova-compute[98297]: DEBUG nova.compute.manager [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98297) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}}
May 28 03:33:20.640104 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 30.00 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:20.809553 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:25.810866 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:30.811853 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:35.813104 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:40.813927 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:45.814419 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 28 03:33:50.639965 np0000001589 nova-compute[98297]: DEBUG oslo_service.periodic_task [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98297) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 28 03:33:50.640440 np0000001589 nova-compute[98297]: DEBUG oslo.service.backend._threading.loopingcall [None req-852e04b3-e256-4316-adb0-3bb18ddf9f19 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.50 seconds {{(pid=98297) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 28 03:33:50.815855 np0000001589 nova-compute[98297]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=98297) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}